SOURCE-LINKED INTELLIGENCE

Prospective Coding Improves Learning in Deep Continuous-Time Recurrent Networks

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

Temporal integration gives continuous-time recurrent networks memory, but in deep stacks it also delays bottom-up signals and attenuates top-down errors. We develop Recursive Quadrature Filters (RQFs), biologically motivated complex-valued temporal filters that are a special case of diagonal state-space models (SSMs), and ask whether this failure mode can be addressed by making each layer's bottom-up input prospective. Starting from an energy model, we derive the RQF dynamics and show that each RQF is a band-pass filter whose learnable parameters control its tuning frequency and bandwidth. We

Read original source ↗ Open in workspace

recordType

paper

region

Global