BabyLM Challenge: Experimenting with Self-Distillation and Reverse-Distillation for Language Model Pre-Training on Constrained Datasets

Aakarsh Nair | Alina Hancharova | Mayank Kumar | Ali Gharaee |

Paper Details:

Month: November
Year: 2024
Location: Miami, FL, USA
Venue: CoNLL | BabyLM | WS |

Citations

URL

No Citations Yet

No URLs Found

Field Of Study