LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-Training EMNLP

Tong Zhu | Xiaoye Qu | Daize Dong | Jiacheng Ruan | Jingqi Tong | Conghui He | Yu Cheng |

Exploring the Compositional Deficiency of Large Language Models in Mathematical Reasoning Through Trap Problems EMNLP

Jun Zhao | Jingqi Tong | Yurong Mou | Ming Zhang | Qi Zhang | Xuanjing Huang |