SOURCE-LINKED INTELLIGENCE

CQ4OE: A benchmark for assessing LLM-assisted ontology generation from competency questions

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

Ontology generation from Competency Questions (CQs) is a central yet labor-intensive phase of Ontology Engineering. While large language models (LLMs) offer promising automation capabilities, current evaluations remain fragmented. Task formulations are heterogeneous, gold standards often lack fine-grained CQ provenance, metrics conflate lexical overlap with structural and logical adequacy, and reference ontologies are not always explicitly designed around the evaluation CQs. Here, we address these limitations with CQ4OE, a benchmark for the systematic and reproducible evaluation of LLM-based o

Read original source ↗ Open in workspace

recordType

paper

region

Global