AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

RESYNC: Residual Latent-State Synchronization for Deadline-Bound Streaming Inference

arXiv · AI, language, vision and robotics · article · Nov 12, 2026 · UTC

Predicting every observation in a high-rate stream requires a model to finish before the next arrival. A large model may offer better predictions but miss that deadline. We propose RESYNC: the large model runs asynchronously, while a fast path updates its latest exact but stale latent state using the observations received since that state was computed and applies its unchanged prediction head. The updater learns from the frozen model's representations without task labels. Across one real and two synthetic streams and five architecture families, RESYNC beats the best compact or distilled altern

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-11-13T05:52:54.307Z. This is not the publication date.