SOURCE-LINKED INTELLIGENCE

Representing MAX functions using two-hidden-layer ReLU networks

arXiv · AI, language, vision and robotics · article · Aug 25, 2026 · UTC

We study exact representations of $\mathrm{MAX}_N(x)=\max{x_1,\ldots,x_N}$ using two-hidden-layer ReLU neural networks. This problem has been studied in recent years in an attempt to characterize the exact number of hidden layers required to represent continuous piecewise linear functions. The best lower bound is 2, while the current upper bound is logarithmic in $N$. It remains completely open if the right answer is a constant number of hidden layers (possibly even 2!) or not. In fact, a recent breakthrough was the representation of $\mathrm{MAX}_5$ as a two-hidden-layer ReLU function obtaine

Read original source ↗ Open in workspace

recordType

paper

region

Global