SOURCE-LINKED INTELLIGENCE

Double Trouble: Bilingual Pretraining Leaves Language-Conditioned Effects in Shared-Language Representations

arXiv · AI, language, vision and robotics · article · Aug 27, 2026 · UTC

A concept can carry different associations across languages, while modern language models learn English alongside many other languages during pretraining. Yet comparisons among existing models cannot easily isolate how any one language changes the way these models represent English concepts because their training corpora, compute, architectures, and random seeds all differ. We study this question through a controlled experiment with 40 matched 310M-parameter decoder-only models that share an architecture, tokenizer, training recipe, and English data source. Each bilingual condition adds one of

Read original source ↗ Open in workspace

recordType

paper

region

Global