SOURCE-LINKED INTELLIGENCE

Critical initialization destabilizes higher input derivatives in wide scalar-input networks

arXiv · AI, language, vision and robotics · article · Sep 8, 2026 · UTC

The edge-of-chaos condition preserves first-order input perturbations in wide randomly initialized networks, but physics-informed losses, score matching and derivative regularization depend on higher input derivatives. For smooth scalar-input fully connected networks, using a joint Gaussianity of the finite derivative jet that holds in the infinite-width limit at each fixed depth, we derive mean-field recursions through third order that are exact at the variance fixed point, with finite-depth corrections that decay geometrically. At criticality, the first-derivative variance is depth-invariant

Read original source ↗ Open in workspace

recordType

paper

region

Global