SOURCE-LINKED INTELLIGENCE

TDDN: Text-aligned Diffused DINO Network for Puzzle Understanding

arXiv · AI, language, vision and robotics · article · Sep 7, 2026 · UTC

Structured visual reasoning, such as image puzzles, demands fine-grained visual perception, an ability current Vision Language Models (VLMs) lack. VLMs built on CLIP-based ViT backbones trade fine-grained detail for high-level semantics, and we show this loss propagates downstream. To recover it, we fuse DINOv3 and CleanDIFT representations into a perception encoder (DiffusedDINO) and align it with RoBERTa-L, yielding a text-aligned model TDDN that preserves this perceptual advantage: with frozen backbones and only $\sim$590K alignment pairs, TDDN matches CLIP on image-text retrieval, surpassi

Read original source ↗ Open in workspace

recordType

paper

region

Global