SOURCE-LINKED INTELLIGENCE

A Universal Context-Reuse Layer for Cross-Model KV Sharing

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

Modern large language model (LLM) serving systems increasingly operate over repeated or shared context, yet each model typically performs its own prefill computation even when another model has already processed the same input. Existing KV-cache reuse mechanisms substantially reduce redundant computation within a single model, but generally assume that the producer and consumer of a cache are identical. We study \emph{cross-model KV sharing}, which translates the KV state produced by a source model into a representation that can be consumed by a different target model, including models that di

Read original source ↗ Open in workspace

recordType

paper

region

Global