Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned

Elena Voita | David Talbot | Fedor Moiseev | Rico Sennrich | Ivan Titov |

Paper Details:

Month: July
Year: 2019
Location: Florence, Italy
Venue: ACL |

Citations

URL

No Citations Yet

Field Of Study

Linguistic Trends
Syntax Morphology
Task
Machine Translation
Language
English French