No Need for Explanations: LLMs can implicitly learn from mistakes in-context

Lisa Alazraki | Maximilian Mozes | Jon Ander Campos | Tan Yi-Chern | Marek Rei | Max Bartolo |

Persona-Augmented Benchmarking: Evaluating LLMs Across Diverse Writing Styles

Kimberly Truong | Riccardo Fogliato | Hoda Heidari | Steven Wu |

Prototypical Human-AI Collaboration Behaviors from LLM-Assisted Writing in the Wild

Sheshera Mysore | Debarati Das | Hancheng Cao | Bahareh Sarrafzadeh |

LORAXBENCH: A Multitask, Multilingual Benchmark Suite for 20 Indonesian Languages

Alham Fikri Aji | Trevor Cohn |

Studying Rhetorically Ambiguous Questions

Oghenevovwe Ikumariegbe | Eduardo Blanco | Ellen Riloff |

Diagnosing Memorization in Chain-of-Thought Reasoning, One Token at a Time

Huihan Li | You Chen | Siyuan Wang | Yixin He | Ninareh Mehrabi | Rahul Gupta | Xiang Ren |

AutoQual: An LLM Agent for Automated Discovery of Interpretable Features for Review Quality Assessment

Xiaochong Lan | Jie Feng | Yinxing Liu | Xinleishi | Yong Li |

CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward

Shudong Liu | Hongwei Liu | Junnan Liu | Linchen Xiao | Songyang Gao | Chengqi Lyu | Yuzhe Gu | Wenwei Zhang | Derek F. Wong | Songyang Zhang | Kai Chen |

The Transfer Neurons Hypothesis: An Underlying Mechanism for Language Latent Space Transitions in Multilingual LLMs

Hinata Tezuka | Naoya Inoue |

MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation

Weihao Xuan | Rui Yang | Heli Qi | Qingcheng Zeng | Yunze Xiao | Aosong Feng | Dairui Liu | Yun Xing | Junjue Wang | Fan Gao | Jinghui Lu | Yuang Jiang | Huitao Li | Xin Li | Kunyu Yu | Ruihai Dong | Shangding Gu | Yuekang Li | Xiaofei Xie | Felix Juefei-Xu | Foutse Khomh | Osamu Yoshie | Qingyu Chen | Douglas Teodoro | Nan Liu | Randy Goebel | Lei Ma | Edison Marrese-Taylor | Shijian Lu | Yusuke Iwasawa | Yutaka Matsuo | Irene Li |

Retrieval Enhanced Feedback via In-context Neural Error-book

Jongyeop Hyun | Bumsoo Kim |

Are Checklists Really Useful for Automatic Evaluation of Generative Tasks?

Momoka Furuhashi | Kouta Nakayama | Takashi Kodama | Saku Sugawara |

CMHG: A Dataset and Benchmark for Headline Generation of Minority Languages in China

Guixian Xu | Zeli Su | Ziyin Zhang | Jianing Liu | Xu Han | Ting Zhang | Yushuang Dong |

SEA: Supervised Embedding Alignment for Token-Level Visual-Textual Integration in MLLMs

Yuanyang Yin | Yaqi Zhao | Yajie Zhang | Yuanxing Zhang | Ke Lin | Jiahao Wang | Xin Tao | Pengfei Wan | Wentao Zhang | Feng Zhao |

Refusal-Aware Red Teaming: Exposing Inconsistency in Safety Evaluations

Yongkang Chen | Xiaohu Du | Xiaotian Zou | Chongyang Zhao | Huan Deng | Hu Li | Xiaohui Kuang |