SOURCE-LINKED INTELLIGENCE

Topographic Training Concentrates Causal Circuits Without Improving Neuron Monosemanticity

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Mechanistic interpretability of vision transformers seeks to decompose model computation into human-readable units, but learned representations entangle many concepts in each neuron. Feature superposition is widely treated as the central obstacle to this decomposition, yet most mitigations (sparse autoencoders, dictionary learning) are post-hoc and leave the underlying network unchanged. We ask whether a spatial-locality training loss (TopoLoss) can act as a lightweight, training-time prior that improves interpretability of standard mech-interp tools. Training ViT on ImageNet-100 across multip

Read original source ↗ Open in workspace

recordType

paper

region

Global