SOURCE-LINKED INTELLIGENCE

Probing Factual Knowledge Transfer with Training Data Interventions

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Do multilingual language models transfer factual knowledge across languages during continued pretraining, or do they mostly recall facts learned directly from the target-language data? To answer this question more reliably, we propose an intervention-based framework: starting from an English-pretrained model, we continue pretraining on Persian data from which specific facts have been systematically removed at varying levels of granularity. We construct SIFT, a resource of 500 triples across 20 relations, stratified by the cultural origin of each fact's subject into general (globally prominent)

Read original source ↗ Open in workspace

recordType

paper

region

Global