SOURCE-LINKED INTELLIGENCE

ISA-Bench: A Benchmark for Computational Reasoning Across Instruction Set Architectures

arXiv · AI, language, vision and robotics · article · Sep 19, 2026 · UTC

Large language model code generation benchmarks primarily evaluate well-resourced languages like Python and Java, where models benefit from abundant training data. They provide limited evidence about reasoning in unfamiliar computational models: deriving arithmetic from a single subtract instruction, coordinating parallel programs across communicating nodes, or wiring logic gates into circuits. We present ISA-Bench, a benchmark of programming games with constrained instruction sets. For each game we provide a full execution stack (parser, VM, and verifier), enabling automated evaluation with s

Read original source ↗ Open in workspace

recordType

paper

region

Global