SOURCE-LINKED INTELLIGENCE

Parser States Already Know: Structure-Conditioned KV Persistence for Structured Generation

arXiv · AI, language, vision and robotics · article · Aug 28, 2026 · UTC

Structured generation underpins large language model (LLM) agents that produce JSON, SQL, and function calls, where a single wrong field can cause the downstream action to fail. Constrained decoding already tracks parser transitions to enforce formal validity, and these transitions expose how generated tokens participate in schema-critical decisions such as required fields, arguments, and structural boundaries under the active grammar. Existing KV compression largely leaves this task-relevant structural signal unused. We introduce PASK (Parser-Aware Structural KV Persistence), which turns pars

Read original source ↗ Open in workspace

recordType

paper

region

Global