SOURCE-LINKED INTELLIGENCE

Decomposing Error and Style in Automated Clinical Coding

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

In automated clinical coding, where the label space spans tens of thousands of diagnosis and procedure codes, models are currently evaluated against a single gold annotation, treating any deviation as error. But we find when two teams code the same 110 ACI-Bench encounters, they agree on only 73% of codes (Jaccard similarity) for the same note; even after an independent clinical audit removes erroneous codes, agreement rises only to 77%. Is that gap error or something systematic? We model the systematic component as coding style $ψ$, a coder- or site-specific policy over what to code and how m

Read original source ↗ Open in workspace

recordType

paper

region

Global