AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

BLiMPPI: Benchmark of Linguistic Minimal Pairs for Polarity Items

arXiv · AI, language, vision and robotics · article · Oct 9, 2026 · UTC

Negative polarity items (NPIs), such as "anymore" and "ever", are grammatical only in select environments, predominantly in the context of negation. Because their grammaticality depends on both syntax and semantics, they have a rich, multilingual literature in theoretical linguistics, yet work on NPIs in language models is almost entirely confined to English. We introduce BLiMPPI, a multilingual evaluation suite of over 12,000 NPI minimal pairs in 33 languages, built by a pipeline that discovers NPIs in Universal Dependencies (UD) treebanks, labels their licensing environments, and perturbs th

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-10-13T16:12:24.076Z. This is not the publication date.