WIP: plan KV-cache quantization - #183

WIP: plan KV-cache quantization#183

drunkcoding wants to merge 1 commit into

mainEfficientMoE/MoE-Infinity:mainfrom

plan/kv-cache-quantizationEfficientMoE/MoE-Infinity:plan/kv-cache-quantizationCopy head branch name to clipboard