ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation ACL IJCNLP

Weizhen Qi | Yeyun Gong | Yu Yan | Can Xu | Bolun Yao | Bartuer Zhou | Biao Cheng | Daxin Jiang | Jiusheng Chen | Ruofei Zhang | Houqiang Li | Nan Duan |

POS-Constrained Parallel Decoding for Non-autoregressive Generation ACL IJCNLP

Kexin Yang | Wenqiang Lei | Dayiheng Liu | Weizhen Qi | Jiancheng Lv |

GLGE: A New General Language Generation Evaluation Benchmark Findings

Dayiheng Liu | Yu Yan | Yeyun Gong | Weizhen Qi | Hang Zhang | Jian Jiao | Weizhu Chen | Jie Fu | Linjun Shou | Ming Gong | Pengcheng Wang | Jiusheng Chen | Daxin Jiang | Jiancheng Lv | Ruofei Zhang | Winnie Wu | Ming Zhou | Nan Duan |

Multi-level Alignment Pretraining for Multi-lingual Semantic Parsing COLING

Bo Shao | Yeyun Gong | Weizhen Qi | Nan Duan | Xiaola Lin |

ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-training EMNLP Findings

Weizhen Qi | Yu Yan | Yeyun Gong | Dayiheng Liu | Nan Duan | Jiusheng Chen | Ruofei Zhang | Ming Zhou |

XGLUE: A New Benchmark Datasetfor Cross-lingual Pre-training, Understanding and Generation EMNLP

Yaobo Liang | Nan Duan | Yeyun Gong | Ning Wu | Fenfei Guo | Weizhen Qi | Ming Gong | Linjun Shou | Daxin Jiang | Guihong Cao | Xiaodong Fan | Ruofei Zhang | Rahul Agrawal | Edward Cui | Sining Wei | Taroon Bharti | Ying Qiao | Jiun-Hung Chen | Winnie Wu | Shuguang Liu | Fan Yang | Daniel Campos | Rangan Majumder | Ming Zhou |

Aggregating Bidirectional Encoder Representations Using MatchLSTM for Sequence Matching EMNLP

Bo Shao | Yeyun Gong | Weizhen Qi | Nan Duan | Xiaola Lin |