Saluki 27B: A 2-Bit Quantized Qwen3.8-27B That Outperforms the Base Model at Tool Calling

Saluki 27B is a 2-bit quantized version of Qwen3.8-27B that reportedly beats its full-precision parent on tool-calling benchmarks, a striking result that challenges assumptions about quantization-quality tradeoffs. Aggressive quantization to 2-bit typically degrades model capability significantly, making this an unusual and technically notable outcome worth scrutinizing. For developers deploying LLMs in resource-constrained environments — edge hardware, low-VRAM servers, or cost-sensitive cloud workloads — a 2-bit model that matches or exceeds the original at agentic tasks would be a major practical win. The tool-calling advantage specifically matters because function-calling accuracy is a critical bottleneck in agent reliability. This is worth benchmarking directly in your own tool-use pipelines before drawing conclusions from published numbers.