SOURCE-LINKED INTELLIGENCE

Consistency Without Alignment: Item-Sensitive Language Models Indistinguishable From Random

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Item-sensitivity, defined as whether a model's choice depends on the specific input rather than on its own output prior, is widely reported as evidence of task competence. We show this evidence is necessary but not sufficient using a forced-choice signalling task abstracted from the board game Deception: Murder in Hong Kong. In this environment, the reference points against which a coordinate should be judged (a fit-maximising strategy, a posterior-maximising strategy, and uniform random selection) are all computable in closed form. Across seven language models, two model families, a post-trai

Read original source ↗ Open in workspace

recordType

paper

region

Global