SOURCE-LINKED INTELLIGENCE

ggml-org/llama.cpp: v0.6.0

GitHub AI software releases · article · Oct 5, 2026 · UTC

## Overview llama.cpp v0.6.0 introduces the new `llama_batch_ext` extended batch API (with `llama_process`) for mixed token/embedding inputs and MTP/deepstack state embeddings, adds support for the GLM-5.3-Flash (GLM5-Next) 320B hybrid model, the Clef decision model (text and vision) and MTP speculative decoding for Qwen4Exp, ships a new `/v1/systemone` server API for decision models (laya, julia-1, lev, openjev, kev, nimble), overhauls the Web UI with a Hugging Face Hub data layer and model download pipeline, adds a Metal tensor-API flash attention kernel for F16 KV, sparse flash attention for quantized K/V on Vulkan, and updates ggml to v0.26.0. ### Highlights - New `llama_batch_ext` extended batch API with `llama_process()`, supporting mixed token/embedding batches and per-token "state" embeddings for MTP and deepstack models [#24669](https://github.com/ggml-org/llama.cpp/pull/24669) - New models: GLM-5.3-Flash (GLM5-Next), a 320B text+vision hybrid model [#27773](https://github.com

Read original source ↗ Open in workspace

recordType

software-release

evidenceStatus

publisher-reported

region

Global