SOURCE-LINKED INTELLIGENCE

Scalable Context Orchestration for Serving LLMs Over Voice

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

Voice AI applications are gaining popularity as advances in large language models (LLMs) enable more natural and accessible spoken interactions. Serving these applications requires accounting not only for what users say, but also for how they speak (e.g., speaking rate) and the conditions under which their audio is captured and transmitted (e.g., background noise and packet loss). However, existing LLM systems represent conversation context as a flat, growing sequence of messages, leaving voice-specific context implicit in the audio. As a result, they can generate responses that are poorly ali

Read original source ↗ Open in workspace

recordType

paper

region

Global