AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Natural Gradient Learning in Predictive Coding through Lateral Circuits

arXiv · AI, language, vision and robotics · article · Nov 12, 2026 · UTC

Predictive coding (PC) trains neural networks through local energy-minimization dynamics without depending on a global error signal that backpropagation (BP) requires. Although PC is a promising alternative algorithm for efficient learning, the computational cost of inference dynamics currently outweighs the resulting learning benefits in practice. In this work, we take inspiration from optimization theory to extract more learning benefit from each inference phase. We introduce Natural PC, which augments standard PC with a lateral circuit, enabling exact and efficient natural gradient learning

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-11-13T05:52:54.307Z. This is not the publication date.