Are Pretrained Convolutions Better than Pretrained Transformers?

Yi Tay | Mostafa Dehghani | Jai Prakash Gupta | Vamsi Aribandi | Dara Bahri | Zhen Qin | Donald Metzler |

Paper Details:

Month: August
Year: 2021
Location: Online
Venue: ACL | IJCNLP |

Citations

URL