Zyphra Releases ZYFA: FP8 FlashAttention Delivering Up to 1.76x Speedup on AMD MI355X

Zyphra has open-sourced ZYFA, an FP8-precision FlashAttention implementation specifically optimized for AMD's MI355X GPU, achieving up to 1.76x throughput improvement over baseline attention implementations on that hardware. The release addresses a meaningful gap in the AMD AI software ecosystem, where NVIDIA-focused tooling has historically dominated optimized attention kernels. For developers and infrastructure teams running inference or training workloads on AMD hardware, ZYFA offers an immediately actionable performance improvement without model changes. The FP8 precision support aligns with broader industry trends toward reduced-precision inference to cut memory bandwidth and compute costs. This is particularly relevant for teams exploring AMD as a cost-competitive alternative to NVIDIA for large-scale transformer workloads.