SOURCE-LINKED INTELLIGENCE

RAILS: Retrieval-Augmented Incremental LLM Clustering at Scale

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Using a Large Language Model (LLM) as the clusterer at production scale is hard: prompts cannot hold the entire label space, and per-document serial processing does not deliver the throughput real workloads require. We present RAILS, a retrieval-augmented incremental LLM clusterer that turns clustering into a simple loop over a growing label pool and scales through document batching with bounded concurrency. On six public benchmarks RAILS exceeds the strongest prior LLM-clustering method on average, lifting accuracy from 51.2% to 59.3%, NMI from 67.2% to 74.8%, and ARI from 45.4% to 54.7%. We

Read original source ↗ Open in workspace

recordType

paper

region

Global