SOURCE-LINKED INTELLIGENCE

CRAD: Class-wise Reliability-Aware Distillation for Decentralized Heterogeneous Federated Learning

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

Conventional federated learning (FL) relies on parameter averaging, which forces clients to be doubly homogeneous: it demands an identical architecture and degrades under non-IID data. Real-world deployments usually break both assumptions. We sidestep both by building a decentralized knowledge distillation framework in which each client evaluates its peers' model snapshots on its own local data and distills from the resulting soft predictions. Because knowledge is transferred through the shared class posterior, clients are free to run different architectures; and because every teacher is evalu

Read original source ↗ Open in workspace

recordType

paper

region

Global