SOURCE-LINKED INTELLIGENCE

Exploring Bottom-Up Clustering for Creating Semantic IDs

arXiv · AI, language, vision and robotics · article · Sep 8, 2026 · UTC

The success of generative retrieval has largely been attributed to the use of Semantic IDs, which improve over arbitrary item-level identifiers such as hashes by capturing the semantics of items. The main challenges faced when constructing Semantic IDs, however, is in mapping each identifier to a unique product and capturing information valuable to downstream tasks. Past works have appended additional codewords to de-duplicate item identifiers and utilized residual quantization to create hierarchical clusters. In this work, we present an algorithm for generating Semantic IDs that ensure the id

Read original source ↗ Open in workspace

recordType

paper

region

Global