Back to Basics: Revisiting REINFORCE-Style Optimization for Learning from Human Feedback in LLMs ACL

Arash Ahmadian | Chris Cremer | Matthias Gallé | Marzieh Fadaee | Julia Kreutzer | Olivier Pietquin | Ahmet Üstün | Sara Hooker |

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning ACL

Shivalika Singh | Freddie Vargus | Daniel D’souza | Börje Karlsson | Abinaya Mahendiran | Wei-Yin Ko | Herumb Shandilya | Jay Patel | Deividas Mataciunas | Laura O’Mahony | Mike Zhang | Ramith Hettiarachchi | Joseph Wilson | Marina Machado | Luisa Moura | Dominik Krzemiński | Hakimeh Fadaei | Irem Ergun | Ifeoma Okoh | Aisha Alaagib | Oshan Mudannayake | Zaid Alyafeai | Vu Chien | Sebastian Ruder | Surya Guthikonda | Emad Alghamdi | Sebastian Gehrmann | Niklas Muennighoff | Max Bartolo | Julia Kreutzer | Ahmet Üstün | Marzieh Fadaee | Sara Hooker |

Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model ACL

Ahmet Üstün | Viraat Aryabumi | Zheng Yong | Wei-Yin Ko | Daniel D’souza | Gbemileke Onilude | Neel Bhandari | Shivalika Singh | Hui-Lee Ooi | Amr Kayid | Freddie Vargus | Phil Blunsom | Shayne Longpre | Niklas Muennighoff | Marzieh Fadaee | Julia Kreutzer | Sara Hooker |

The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harm EMNLP

Aakanksha | Arash Ahmadian | Beyza Ermis | Seraphina Goldfarb-Tarrant | Julia Kreutzer | Marzieh Fadaee | Sara Hooker |

LLM See, LLM Do: Leveraging Active Inheritance to Target Non-Differentiable Objectives EMNLP

Luísa Shimabucoro | Sebastian Ruder | Julia Kreutzer | Marzieh Fadaee | Sara Hooker |