Prime Intellect Ships Prime Mega MoE: Fused MoE Kernel With 3.11x Forward-Pass Speedup

Prime Intellect has released Prime Mega MoE, a trainable fused Mixture-of-Experts kernel that delivers a 3.11x speedup on forward passes compared to standard MoE implementations, with full training support rather than inference-only optimization. The kernel fuses the gating, routing, and expert computation steps into a single GPU operation, dramatically reducing memory bandwidth bottlenecks that typically throttle MoE throughput. This is a meaningful contribution to the open-source MoE ecosystem at a time when sparse mixture models are becoming the dominant architecture for large-scale deployments. Developers training or fine-tuning MoE models can integrate this kernel to cut compute costs substantially without architectural changes. The release positions Prime Intellect as a serious contributor to frontier training infrastructure alongside better-known names.