Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training NAACL

Sun Ao | Weilin Zhao | Xu Han | Cheng Yang | Xinrong Zhang | Zhiyuan Liu | Chuan Shi | Maosong Sun |

APB: Accelerating Distributed Long-Context Inference by Passing Compressed Context Blocks across GPUs ACL

Yuxiang Huang | Mingye Li | Xu Han | Chaojun Xiao | Weilin Zhao | Sun Ao | Hao Zhou | Jie Zhou | Zhiyuan Liu | Maosong Sun |

FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling ACL

Weilin Zhao | Tengyu Pan | Xu Han | Yudi Zhang | Sun Ao | Yuxiang Huang | Kaihuo Zhang | Weilun Zhao | Yuxuan Li | Jie Zhou | Hao Zhou | Jianyong Wang | Maosong Sun | Zhiyuan Liu |