SOURCE-LINKED INTELLIGENCE

A Distributional Optimisation Perspective on Combining Models in Deep Learning

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Combining predictions from different models can improve performance at machine learning tasks, but the training of the individual models and the rule used to combine them are typically chosen separately, and by ad hoc means. Recent advances in distributional optimisation (i.e. where the optimisation occurs over the set of probability distributions) offer an opportunity for principled joint training, viewing the collection of models as a discrete distribution whose support points are to be optimised, but the potential of these methods is not well-understood. In this paper we (1) cast two standa

Read original source ↗ Open in workspace

recordType

paper

region

Global