AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Joint Null-Space Projection for Data-Free Model Merging

arXiv · AI, language, vision and robotics · article · Nov 12, 2026 · UTC

Merging independently fine-tuned checkpoints into a single multi-task model requires no data, no labels, and no gradient steps. In practice the task vectors of different tasks interfere, and the standard remedies--averaging, magnitude pruning, sign election--operate entry by entry, ignoring that each delta induces a low-dimensional update on the hidden features it acts upon. We recast merging as a subspace interference problem. For every two-dimensional weight tensor we take the top-r right-singular subspace of each task's delta--the input directions along which that task moves the representat

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-11-13T16:53:25.588Z. This is not the publication date.