What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers

Boseop Kim | HyoungSeok Kim | Sang-Woo Lee | Gichang Lee | Donghyun Kwak | Jeon Dong Hyeon | Sunghyun Park | Sungju Kim | Seonhoon Kim | Dongpil Seo | Heungsub Lee | Minyoung Jeong | Sungjae Lee | Minsub Kim | Suk Hyun Ko | Seokhun Kim | Taeyong Park | Jinuk Kim | Soyoung Kang | Na-Hyeon Ryu | Kang Min Yoo | Minsuk Chang | Soobin Suh | Sookyo In | Jinseong Park | Kyungduk Kim | Hiun Kim | Jisu Jeong | Yong Goo Yeo | Donghoon Ham | Dongju Park | Min Young Lee | Jaewook Kang | Inho Kang | Jung-Woo Ha | Woomyoung Park | Nako Sung |

DRIFT: A Toolkit for Diachronic Analysis of Scientific Literature

Abheesht Sharma | Gunjan Chhablani | Harshit Pandey | Rajaswa Patil |

Miðeind’s WMT 2021 Submission

Haukur Barri Símonarson | Vésteinn Snæbjarnarson | Pétur Orri Ragnarson | Haukur Jónsson | Vilhjalmur Thorsteinsson |

HiTRANS: A Hierarchical Transformer Network for Nested Named Entity Recognition

Zhiwei Yang | Jing Ma | Hechang Chen | Yunke Zhang | Yi Chang |

Diverse Distributions of Self-Supervised Tasks for Meta-Learning in NLP

Trapit Bansal | Karthick Prasad Gunasekaran | Tong Wang | Tsendsuren Munkhdalai | Andrew McCallum |

Capturing document context inside sentence-level neural machine translation models with self-training

Elman Mansimov | Gábor Melis | Lei Yu |

RAST: Domain-Robust Dialogue Rewriting as Sequence Tagging

Jie Hao | Linfeng Song | Liwei Wang | Kun Xu | Zhaopeng Tu | Dong Yu |

Conditional probing: measuring usable information beyond a baseline

John Hewitt | Kawin Ethayarajh | Percy Liang | Christopher Manning |

Mapping probability word problems to executable representations

Simon Suster | Pieter Fivez | Pietro Totis | Angelika Kimmig | Jesse Davis | Luc de Raedt | Walter Daelemans |

Overcoming Conflicting Data when Updating a Neural Semantic Parser

David Gaddy | Alex Kouzemtchenko | Pavankumar Reddy Muddireddy | Prateek Kolhar | Rushin Shah |

Cross-Lingual Training of Dense Retrievers for Document Retrieval

Peng Shi | Rui Zhang | He Bai | Jimmy Lin |

Idiosyncratic but not Arbitrary: Learning Idiolects in Online Registers Reveals Distinctive yet Consistent Individual Styles

Jian Zhu | David Jurgens |

BARThez: a Skilled Pretrained French Sequence-to-Sequence Model

Moussa Kamal Eddine | Antoine Tixier | Michalis Vazirgiannis |

SeqScore: Addressing Barriers to Reproducible Named Entity Recognition Evaluation

Chester Palen-Michel | Nolan Holley | Constantine Lignos |

AMuSE-WSD: An All-in-one Multilingual System for Easy Word Sense Disambiguation

Riccardo Orlando | Simone Conia | Fabrizio Brignone | Francesco Cecconi | Roberto Navigli |