Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence

Junru Lu | Jiazheng Li | Siyu An | Meng Zhao | Yulan He | Di Yin | Xing Sun |

TheoremLlama: Transforming General-Purpose LLMs into Lean4 Experts

Ruida Wang | Jipeng Zhang | Yizhen Jia | Rui Pan | Shizhe Diao | Renjie Pi | Tong Zhang |

How Does the Textual Information Affect the Retrieval of Multimodal In-Context Learning?

Yang Luo | Zangwei Zheng | Zirui Zhu | Yang You |

Pixology: Probing the Linguistic and Visual Capabilities of Pixel-based Language Models

Kushal Tatariya | Vladimir Araujo | Thomas Bauwens | Miryam de Lhoneux |

FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model

Yichen Lu | Jiaqi Song | Chao-Han Huck Yang | Shinji Watanabe |

Tools Fail: Detecting Silent Errors in Faulty Tools

Jimin Sun | So Yeon Min | Yingshan Chang | Yonatan Bisk |

GlossLM: A Massively Multilingual Corpus and Pretrained Model for Interlinear Glossed Text

Michael Ginn | Lindia Tjuatja | Taiqi He | Enora Rice | Graham Neubig | Alexis Palmer | Lori Levin |

SEED: Semantic Knowledge Transfer for Language Model Adaptation to Materials Science

Yeachan Kim | Jun-Hyung Park | SungHo Kim | Juhyeong Park | Sangyun Kim | SangKeun Lee |

You Make me Feel like a Natural Question: Training QA Systems on Transformed Trivia Questions

Tasnim Kabir | Yoo Yeon Sung | Saptarashmi Bandyopadhyay | Hao Zou | Abhranil Chandra | Jordan Lee Boyd-Graber |

ActPlan-1K: Benchmarking the Procedural Planning Ability of Visual Language Models in Household Activities

Ying Su | Zhan Ling | Haochen Shi | Cheng Jiayang | Yauwai Yim | Yangqiu Song |

InferAligner: Inference-Time Alignment for Harmlessness through Cross-Model Guidance

Pengyu Wang | Dong Zhang | Linyang Li | Chenkun Tan | Xinghao Wang | Mozhi Zhang | Ke Ren | Botian Jiang | Xipeng Qiu |

Information Flow Routes: Automatically Interpreting Language Models at Scale

Javier Ferrando | Elena Voita |

INDUS: Effective and Efficient Language Models for Scientific Applications

Bishwaranjan Bhattacharjee | Aashka Trivedi | Masayasu Muraoka | Muthukumaran Ramasubramanian | Takuma Udagawa | Iksha Gurung | Nishan Pantha | Rong Zhang | Bharath Dandala | Rahul Ramachandran | Manil Maskey | Kaylin Bugbee | Michael M. Little | Elizabeth Fancher | Irina Gerasimov | Armin Mehrabian | Lauren Sanders | Sylvain V. Costes | Sergi Blanco-Cuaresma | Kelly Lockhart | Thomas Allen | Felix Grezes | Megan Ansdell | Alberto Accomazzi | Yousef El-Kurdi | Davis Wertheimer | Birgit Pfitzmann | Cesar Berrospi Ramis | Michele Dolfi | Rafael Teixeira De Lima | Panagiotis Vagenas | S. Karthik Mukkavilli | Peter W. J. Staar | Sanaz Vahidinia | Ryan McGranaghan | Tsengdar J. Lee |

Encourage or Inhibit Monosemanticity? Revisit Monosemanticity from a Feature Decorrelation Perspective

Hanqi Yan | Yanzheng Xiang | Guangyi Chen | Yifei Wang | Lin Gui | Yulan He |

Searching for Best Practices in Retrieval-Augmented Generation

Xiaohua Wang | Zhenghua Wang | Xuan Gao | Feiran Zhang | Yixin Wu | Zhibo Xu | Tianyuan Shi | Zhengyuan Wang | Shizheng Li | Qi Qian | Ruicheng Yin | Changze Lv | Xiaoqing Zheng | Xuanjing Huang |