feat: Add TurboQuant (quant_policy=42) support for KV Cache Quantization#4510

Open

windreamer wants to merge 14 commits intoInternLM:mainfrom

windreamer:turboquant-integration

Commits on Apr 8, 2026

feat: add TurboQuant K4V2 mixed precision KV cache quantization (quant_policy=42)
windreamer
committed
refactor(tests): reorganize quant_policy==42 tests into dedicated files
windreamer
committed
Add TurboQuant (quant_policy=42) support to KV cache kernels

windreamer
and
openhands-agent
committed
refactor(tests): reorganize quant_policy==42 tests into dedicated files

windreamer
and
openhands-agent
committed
fix: resolve butterfly_rotate_inv and dtype issues in fill_kv_cache.py

windreamer
and
openhands-agent
committed
fix(attention): support quant_policy==42 with butterfly rotation
windreamer
committed
refactor: introduce QuantPolicy enum and consolidate TurboQuant utilities
windreamer
committed

Commits on Apr 10, 2026