Turn Waste into Worth: Rectifying Top-k Router of MoE

Zhiyuan Zeng | Qipeng Guo | Zhaoye Fei | Zhangyue Yin | Yunhua Zhou | Linyang Li | Tianxiang Sun | Hang Yan | Dahua Lin | Xipeng Qiu |