DOCmT5: Document-Level Pretraining of Multilingual Language Models Findings NAACL

Chia-Hsuan Lee | Aditya Siddhant | Viresh Ratnakar | Melvin Johnson |

Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages NAACL

Xavier Garcia | Aditya Siddhant | Orhan Firat | Ankur Parikh |

Explicit Alignment Objectives for Multilingual Bidirectional Encoders NAACL

Junjie Hu | Melvin Johnson | Orhan Firat | Aditya Siddhant | Graham Neubig |

mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer NAACL

Linting Xue | Noah Constant | Adam Roberts | Mihir Kale | Rami Al-Rfou | Aditya Siddhant | Aditya Barua | Colin Raffel |

nmT5 - Is parallel data still relevant for pre-training massively multilingual language models? ACL IJCNLP

Mihir Kale | Aditya Siddhant | Rami Al-Rfou | Linting Xue | Noah Constant | Melvin Johnson |

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation EMNLP

Sebastian Ruder | Noah Constant | Jan Botha | Aditya Siddhant | Orhan Firat | Jinlan Fu | Pengfei Liu | Junjie Hu | Dan Garrette | Graham Neubig | Melvin Johnson |

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation ACL

Aditya Siddhant | Ankur Bapna | Yuan Cao | Orhan Firat | Mia Chen | Sneha Kudugunta | Naveen Arivazhagan | Yonghui Wu |

Domain Adaptation of SRL Systems for Biological Processes ACL WS

Dheeraj Rajagopal | Nidhi Vyas | Aditya Siddhant | Anirudha Rayasam | Niket Tandon | Eduard Hovy |

Deep Bayesian Active Learning for Natural Language Processing: Results of a Large-Scale Empirical Study EMNLP

Aditya Siddhant | Zachary C. Lipton |