SOURCE-LINKED INTELLIGENCE

OntologyBench: Can Dense Retrieval Satisfy Structured Biomedical Constraints?

arXiv · AI, language, vision and robotics · article · Sep 8, 2026 · UTC

We introduce OntologyBench, a tiered biomedical retrieval benchmark comprising 471,854 training and 125,744 evaluation query-document relevance pairs across concept grounding, relational retrieval, and compositional phenotype-based retrieval. Although these tasks can be tractable using ontology-aware reference methods, across task tiers, embedding performance is generally lower on relational and compositional tasks than on concept-grounding tasks. Fine-tuning on ontology-derived supervision improves performance on several relational and compositional tasks, whereas the evaluated reranking and

Read original source ↗ Open in workspace

recordType

paper

region

Global