Amphista: Bi-directional Multi-head Decoding for Accelerating LLM Inference NAACL

Zeping Li | Xinlong Yang | Ziheng Gao | Ji Liu | Guanchen Li | Zhuang Liu | Dong Li | Jinzhang Peng | Lu Tian | Emad Barsoum |

Self-Taught Agentic Long Context Understanding ACL

Yufan Zhuang | Xiaodong Yu | Jialian Wu | Ximeng Sun | Ze Wang | Jiang Liu | Yusheng Su | Jingbo Shang | Zicheng Liu | Emad Barsoum |

TaDA: Training-free recipe for Decoding with Adaptive KV Cache Compression and Mean-centering ACL

Vinay Joshi | Pratik Prabhanjan Brahma | Zicheng Liu | Emad Barsoum |