SOURCE-LINKED INTELLIGENCE

MIDR: Enrichment-Augmented Indexing for Multimodal Document Retrieval

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Retrieval over visually rich documents has a representation problem: important content often lives in tables, charts, figures, and layout relations that plain OCR linearizes, corrupts, or omits. ColPali-family visual retrievers address this with patch-level multi-vector indexes and late-interaction scoring, keeping image-derived retrieval on the query-time serving path. We introduce MIDR (Multimodal Indexing for Document Retrieval), a training-free framework for enrichment-augmented indexing that shifts multimodal reasoning to index time. During ingestion, a multimodal LLM converts rendered pa

Read original source ↗ Open in workspace

recordType

paper

region

Global