Local LLM Inferencesaw-int4: The Hadamard Trick That Makes 4-Bit KV Caches Work in Real Serving Systems
A system-aware quantization stack that rotates away KV outliers, keeps accuracy close to BF16, and treats inference speed as a kernel problem, not a paper abstraction.
10 min read ยท Apr 22, 2026