SOURCE-LINKED INTELLIGENCE

Compile, Don't Memorize: A Context Compilation Architecture (CCA) for In-Context Learning

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Large language models (LLMs) increasingly handle in-context learning (ICL) tasks where a long, novel context defines the rules, knowledge, and output schema for a series of questions. On benchmarks that grade against every detail of the context, even strong open-weights models pass only 12-16% of tasks: a single overlooked rule fails the whole response. We argue this brittleness is structural: the dominant "read-and-reason" paradigm asks the model to extract, plan, generate, and self-verify in one forward pass. We therefore ask whether explicit context compilation can fix it, how it compares t

Read original source ↗ Open in workspace

recordType

paper

region

Global