SOURCE-LINKED INTELLIGENCE

The Path Matters: Evaluating Small Language Models Beyond Answer Accuracy in KGQA

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

Small language models (SLMs) are increasingly paired with knowledge graphs (KGs), yet end-to-end KG question answering conflates graph access, search, navigation, reasoning, and answer generation. This coupling makes it difficult both to determine whether an SLM can faithfully execute the reasoning path implied by a question and to attribute failures to navigation rather than to other stages of the pipeline. We isolate this capability by employing the THESEUS navigation and traceability framework and using frozen, off-the-shelf SLMs as local action policies. At each hop, the environment expose

Read original source ↗ Open in workspace

recordType

paper

region

Global