BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training

Pavel Chizhov | Catherine Arnett | Elizaveta Korotkova | Ivan P. Yamshchikov |

Paper Details:

Month: November
Year: 2024
Location: Miami, Florida, USA
Venue: EMNLP |

Citations

URL

No Citations Yet

Field Of Study