SOURCE-LINKED INTELLIGENCE

Beetle: A Bilingual Model Suite for Modelling Second-Language Processing

arXiv · AI, language, vision and robotics · article · Sep 18, 2026 · UTC

Bilingual language models (LMs) offer a controlled setting for studying how training conditions shape second-language (L2) behaviour, but prior work typically varies exposure structure, scale, and architecture at once, making it difficult to attribute effects to any single factor. We introduce Beetle, a controlled language model pretraining framework in which tokeniser, target language, training budget, and exposure structure are each independently manipulable, enabling systematic and comparable experimentation of training conditions. Using Beetle, we train and release 285 bilingual and 45 mon

Read original source ↗ Open in workspace

recordType

paper

region

Global