BADGE: Speeding Up BERT Inference after Deployment via Block-wise Bypasses and Divergence-based Early Exiting ACL

Wei Zhu | Peng Wang | Yuan Ni | Guotong Xie | Xiaoling Wang |

Exploring the Impact of Model Scaling on Parameter-Efficient Tuning EMNLP

Yusheng Su | Chi-Min Chan | Jiali Cheng | Yujia Qin | Yankai Lin | Shengding Hu | Zonghan Yang | Ning Ding | Xingzhi Sun | Guotong Xie | Zhiyuan Liu | Maosong Sun |

Unified Demonstration Retriever for In-Context Learning ACL

Xiaonan Li | Kai Lv | Hang Yan | Tianyang Lin | Wei Zhu | Yuan Ni | Guotong Xie | Xiaoling Wang | Xipeng Qiu |

CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark ACL

Ningyu Zhang | Mosha Chen | Zhen Bi | Xiaozhuan Liang | Lei Li | Xin Shang | Kangping Yin | Chuanqi Tan | Jian Xu | Fei Huang | Luo Si | Yuan Ni | Guotong Xie | Zhifang Sui | Baobao Chang | Hui Zong | Zheng Yuan | Linfeng Li | Jun Yan | Hongying Zan | Kunli Zhang | Buzhou Tang | Qingcai Chen |

A Simple Hash-Based Early Exiting Approach For Language Understanding and Generation ACL Findings

Tianxiang Sun | Xiangyang Liu | Wei Zhu | Zhichao Geng | Lingling Wu | Yilong He | Yuan Ni | Guotong Xie | Xuanjing Huang | Xipeng Qiu |

SFE-AI at SemEval-2022 Task 11: Low-Resource Named Entity Recognition using Large Pre-trained Language Models NAACL SemEval

Changyu Hou | Jun Wang | Yixuan Qiao | Peng Jiang | Peng Gao | Guotong Xie | Qizhi Lin | Xiaopeng Wang | Xiandi Jiang | Benqi Wang | Qifeng Xiao |

paht_nlp @ MEDIQA 2021: Multi-grained Query Focused Multi-Answer Summarization BioNLP NAACL

Wei Zhu | Yilong He | Ling Chai | Yunxiao Fan | Yuan Ni | Guotong Xie | Xiaoling Wang |

Discovering Better Model Architectures for Medical Query Understanding NAACL

Wei Zhu | Yuan Ni | Xiaoling Wang | Guotong Xie |

Global Attention Decoder for Chinese Spelling Error Correction Findings

Zhao Guo | Yuan Ni | Keqiang Wang | Wei Zhu | Guotong Xie |

GAML-BERT: Improving BERT Early Exiting by Gradient Aligned Mutual Learning EMNLP

Wei Zhu | Xiaoling Wang | Yuan Ni | Guotong Xie |

Pre-training Entity Relation Encoder with Intra-span and Inter-span Information EMNLP

Yijun Wang | Changzhi Sun | Yuanbin Wu | Junchi Yan | Peng Gao | Guotong Xie |

Pingan Smart Health and SJTU at COIN - Shared Task: utilizing Pre-trained Language Models and Common-sense Knowledge in Machine Reading Tasks EMNLP WS

Xiepeng Li | Zhexi Zhang | Wei Zhu | Zheng Li | Yuan Ni | Peng Gao | Junchi Yan | Guotong Xie |

PANLP at MEDIQA 2019: Pre-trained Language Models, Transfer Learning and Knowledge Distillation ACL WS

Wei Zhu | Xiaofeng Zhou | Keqiang Wang | Xun Luo | Xiepeng Li | Yuan Ni | Guotong Xie |