NACL: A General and Effective KV Cache Eviction Framework for LLM at Inference Time ACL

Yilong Chen | Guoxia Wang | Junyuan Shang | Shiyao Cui | Zhenyu Zhang | Tingwen Liu | Shuohuan Wang | Yu Sun | Dianhai Yu | Hua Wu |

LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion ACL

Yilong Chen | Junyuan Shang | Zhenyu Zhang | Shiyao Cui | Tingwen Liu | Shuohuan Wang | Yu Sun | Hua Wu |