SOURCE-LINKED INTELLIGENCE

Local Support Learning

arXiv · AI, language, vision and robotics · article · Oct 1, 2026 · UTC

We explore catastrophic forgetting in the context of large pre-trained models. By considering forgetting as a geometric problem in the input space of each weight matrix, we uncover a natural retention objective under which updates produced by gradient-based optimizers are suboptimal. Following this observation, we propose Local Support Learning (LSL), a general-purpose framework that augments gradient-based training for retention of prior capabilities without access to prior data. During a new learning phase, LSL pairs two components with distinct roles: a standard weight adapter, trained as u

Read original source ↗ Open in workspace

recordType

paper

region

Global