LoopVQ: Sub 1-bit KV Cache Quantization for Looped Transformers
LoopVQ achieves sub-1-bit KV cache quantization for looped transformers, reducing memory bottleneck via loop-axis redundancy.
·
Search the full wire by company, model, lab, or keyword. Every story we have ever aggregated.
LoopVQ achieves sub-1-bit KV cache quantization for looped transformers, reducing memory bottleneck via loop-axis redundancy.