SOURCE-LINKED INTELLIGENCE

Imag-Eval: a language-grounded framework for interpretable Text-to-Image instruction following evaluation

arXiv · AI, language, vision and robotics · article · Aug 29, 2026 · UTC

Text-to-Image (T2I) models have recently achieved impressive visual fidelity, yet their evaluation remains constrained by benchmarks that are often difficult to interpret and insufficiently diagnostic. Existing skill-based evaluations tend to overlook critical failure modes that strongly impact usability but fall outside standard taxonomies, such as global incoherence arising from missing parts or physically implausible configurations (e.g., floating objects). In addition, prompt difficulty is typically controlled along a single dimension; either prompt length or the number of elements to gene

Read original source ↗ Open in workspace

recordType

paper

region

Global