SOURCE-LINKED INTELLIGENCE

LookThere! Sparse Vision by Reinforced Selection

arXiv · AI, language, vision and robotics · article · Sep 4, 2026 · UTC

Vision transformers typically treat every image token as equally important, yet for most tasks in computer vision only a fraction are needed. Adaptive computation methods accelerate inference by choosing which tokens to process, but existing methods struggle at extreme sparsity and require heuristics that may not generalize like token diversity and attention scores. We address these limitations with LookThere, achieving a new pareto frontier in performance-compute trade-offs through an end-to-end reinforcement learning framework that jointly trains a shallow input selector and a deep represent

Read original source ↗ Open in workspace

recordType

paper

region

Global