BabyLM Challenge: Experimenting with Self-Distillation and Reverse-Distillation for Language Model Pre-Training on Constrained Datasets CoNLL BabyLM WS

Aakarsh Nair | Alina Hancharova | Mayank Kumar | Ali Gharaee |