Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little

Koustuv Sinha | Robin Jia | Dieuwke Hupkes | Joelle Pineau | Adina Williams | Douwe Kiela |

Paper Details:

Month: November
Year: 2021
Location: Online and Punta Cana, Dominican Republic
Venue: EMNLP |