SOURCE-LINKED INTELLIGENCE

Mind the Gap: Robustness Risks in PII Detection Systems

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

Personally Identifiable Information (PII) detection is a foundational component of data protection infrastructure where missed entities constitute direct privacy and security risks. Although modern PII systems report strong performance on standard benchmarks, we show that these evaluations mask substantial robustness failures under realistic distribution shifts encountered in deployment. Rather than comparing state-of-the-art accuracy, we study how different PII detection paradigms fail under noisy, unstructured, and informal inputs. We construct a stress test benchmark spanning seven categori

Read original source ↗ Open in workspace

recordType

paper

region

Global