Jina AI Releases jina-ocr-v1: 3.4B MoE Document Parser With Speculative Decoding for Low-Budget GPUs

Jina AI has launched jina-ocr-v1, a 3.4 billion parameter Mixture-of-Experts document parsing model that includes built-in speculative decoding to enable practical inference on consumer and low-budget GPUs. The model targets document understanding pipelines that require high-quality OCR and structured parsing without requiring expensive cloud inference or high-end hardware. Built-in speculative decoding means developers can achieve faster token generation on smaller GPUs without manual optimization, lowering the barrier for local document AI workflows. This is directly relevant for teams building on-premises document processing systems, RAG pipelines with PDF ingestion, or any application where data privacy prevents sending documents to external APIs.