SOURCE-LINKED INTELLIGENCE

VisCache: Visual KV Cache Pruning for Efficient Vision Large Language Model Inference

arXiv · AI, language, vision and robotics · article · Aug 25, 2026 · UTC

While Vision Large Language Models (VLLMs) have achieved remarkable success in multimodal reasoning, their long-context inference remains prohibitively expensive due to the massive computation and memory overhead of visual Key-Value (KV) caches. Existing KV compression methods often apply uniform pruning across visual tokens and layers, leading to substantial information loss and degraded performance.To address this challenge, we propose \textbf{VisCache}, a plug-and-play framework for coarse-to-fine \textbf{Vis}ual KV \textbf{Cache} pruning without training, which consists of two synergistic

Read original source ↗ Open in workspace

recordType

paper

region

Global