SOURCE-LINKED INTELLIGENCE

CAMFT: Conflict-Aware Mergeable Fine-Tuning for Large Language Models

arXiv · AI, language, vision and robotics · article · Sep 6, 2026 · UTC

Model merging has emerged as a promising paradigm for integrating multiple task-specific capabilities into a single large language model. However, existing methods predominantly focus on post-hoc processing of independently fine-tuned models, overlooking how the training phase itself impacts cross-task compatibility. Resolving parameter conflicts after fine-tuning is inherently sub-optimal. To address this, we propose CAMFT, a Conflict-Aware Mergeable Fine-Tuning method that makes task adaptation both efficient and mergeaware. CAMFT treats mergeability as a property shaped during fine-tuning,

Read original source ↗ Open in workspace

recordType

paper

region

Global