SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers ACL

Zicong Tang | Shi Luohe | Zuchao Li | Baoyuan Qi | Liu Guoming | Lefei Zhang | Ping Wang |

KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding ACL

Shi Luohe | Zuchao Li | Lefei Zhang | Baoyuan Qi | Liu Guoming | Hai Zhao |