SOURCE-LINKED INTELLIGENCE

Seeing the Unseen: Visual Similarity for Pixel Language Model Adaptation

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

Pixel-based language models (LMs) replace traditional tokenizers by processing rendered images of text, making cross-lingual transfer heavily dependent on the visual and structural properties of writing systems. However, the dynamics of adapting these models to low-resource languages with complex morphology and written in unique scripts are not yet explored. Using Tibetan as a case study, we analyze how continued pre-training of pixel-based LMs is influenced by data scale, initial script exposure, and cross-lingual transfer from languages written in other Brahmic scripts. We introduce four ren

Read original source ↗ Open in workspace

recordType

paper

region

Global