SOURCE-LINKED INTELLIGENCE

ExecRetrieval: Measuring the Functional-Correctness Gap in Code-Embedding Retrieval

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Embedding-based code retrieval is a core component of coding agents and retrieval-augmented code generation, where retrieving correct code matters more than retrieving lexically similar code. Existing code-retrieval benchmarks do not plant controlled, execution-verified single-edit variants of each query's canonical implementation in the search pool, leaving the question of whether embeddings can functionally discriminate correct from near-clone-but-incorrect code unanswered in a retrieval setting. Resolving this requires a benchmark whose search pool itself contains the relevant counterfactua

Read original source ↗ Open in workspace

recordType

paper

region

Global