Sakana AI Introduces PC-ALM: A Layer-Local Alternative to Backpropagation That Scales to 1000-Layer Networks

Sakana AI researchers have published PC-ALM, a training algorithm that replaces backpropagation with a layer-local learning rule derived from predictive coding, successfully training networks up to 1000 layers deep. Traditional backpropagation struggles with very deep networks due to vanishing gradients and sequential dependency between layers, making parallelization difficult. PC-ALM addresses both problems by allowing each layer to update independently based on local prediction errors, opening the door to more hardware-efficient and biologically plausible training. For ML researchers and infrastructure engineers, this is a meaningful step toward training paradigms that could reduce memory bottlenecks and enable new model architectures. The result challenges the assumption that backpropagation is the only viable path to deep network training at scale.