InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training NAACL

Zewen Chi | Li Dong | Furu Wei | Nan Yang | Saksham Singhal | Wenhui Wang | Xia Song | Xian-Ling Mao | Heyan Huang | Ming Zhou |

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains Findings

Yunzhi Yao | Shaohan Huang | Wenhui Wang | Li Dong | Furu Wei |

MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers Findings

Wenhui Wang | Hangbo Bao | Shaohan Huang | Li Dong | Furu Wei |

Consistency Regularization for Cross-Lingual Fine-Tuning ACL IJCNLP

Bo Zheng | Li Dong | Shaohan Huang | Wenhui Wang | Zewen Chi | Saksham Singhal | Wanxiang Che | Ting Liu | Xia Song | Furu Wei |

Harvesting and Refining Question-Answer Pairs for Unsupervised QA ACL

Zhongli Li | Wenhui Wang | Li Dong | Furu Wei | Ke Xu |

Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension EMNLP WS

Hangbo Bao | Li Dong | Furu Wei | Wenhui Wang | Nan Yang | Lei Cui | Songhao Piao | Ming Zhou |

Learning to Ask Unanswerable Questions for Machine Reading Comprehension ACL

Haichao Zhu | Li Dong | Furu Wei | Wenhui Wang | Bing Qin | Ting Liu |

Improved Dependency Parsing using Implicit Word Connections Learned from Unlabeled Data EMNLP

Wenhui Wang | Baobao Chang | Mairgup Mansur |

Gated Self-Matching Networks for Reading Comprehension and Question Answering ACL

Wenhui Wang | Nan Yang | Furu Wei | Baobao Chang | Ming Zhou |

Graph-based Dependency Parsing with Bidirectional LSTM ACL

Wenhui Wang | Baobao Chang |