SOURCE-LINKED INTELLIGENCE

Fi-ImageNet-1k: An OOD Benchmark From the Inside of the ImageNet-1k Validation Set

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Out-of-distribution (OOD) detection predicts whether a test image belongs to none of the predefined classes. To evaluate this task, benchmarks need images from outside the in-distribution (ID) data; typically, these are defined or collected in an ad hoc fashion. Since no ground truth is perfect, ID-labeled datasets themselves contain a natural source of OOD images. We exploit such annotation errors and present Fi-ImageNet-1k, an OOD dataset built from ImageNet-1k validation images that the recent ReImageNet reannotation effort assigned to no ImageNet-1k class. Each image was examined by expert

Read original source ↗ Open in workspace

recordType

paper

region

Global