SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training

Nan He | Weichen Xiong | Hanwen Liu | Yi Liao | Lei Ding | Kai Zhang | Guohua Tang | Xiao Han | Yang Wei |

SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs

Yebowen Hu | Kaiqiang Song | Sangwoo Cho | Xiaoyang Wang | Hassan Foroosh | Dong Yu | Fei Liu |

Characterizing Similarities and Divergences in Conversational Tones in Humans and LLMs by Sampling with People

Dun-Ming Huang | Pol Van Rijn | Ilia Sucholutsky | Raja Marjieh | Nori Jacoby |

Blinded by Generated Contexts: How Language Models Merge Generated and Retrieved Contexts When Knowledge Conflicts?

Hexiang Tan | Fei Sun | Wanli Yang | Yuanzhuo Wang | Qi Cao | Xueqi Cheng |

OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Models

Hainiu Xu | Runcong Zhao | Lixing Zhu | Jinhua Du | Yulan He |

Graph Language Models

Moritz Plenz | Anette Frank |

TransliCo: A Contrastive Learning Framework to Address the Script Barrier in Multilingual Pretrained Language Models

Yihong Liu | Chunlan Ma | Haotian Ye | Hinrich Schuetze |

SyllabusQA: A Course Logistics Question Answering Dataset

Nigel Fernandez | Alexander Scarlatos | Andrew Lan |

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning

Shivalika Singh | Freddie Vargus | Daniel D’souza | Börje Karlsson | Abinaya Mahendiran | Wei-Yin Ko | Herumb Shandilya | Jay Patel | Deividas Mataciunas | Laura O’Mahony | Mike Zhang | Ramith Hettiarachchi | Joseph Wilson | Marina Machado | Luisa Moura | Dominik Krzemiński | Hakimeh Fadaei | Irem Ergun | Ifeoma Okoh | Aisha Alaagib | Oshan Mudannayake | Zaid Alyafeai | Vu Chien | Sebastian Ruder | Surya Guthikonda | Emad Alghamdi | Sebastian Gehrmann | Niklas Muennighoff | Max Bartolo | Julia Kreutzer | Ahmet Üstün | Marzieh Fadaee | Sara Hooker |

ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models

Yuanyi Ren | Haoran Ye | Hanjun Fang | Xin Zhang | Guojie Song |

Search-Adaptor: Embedding Customization for Information Retrieval

Jinsung Yoon | Yanfei Chen | Sercan Arik | Tomas Pfister |

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang | Qianhui Wu | Xufang Luo | Dongsheng Li | Chin-Yew Lin | Yuqing Yang | Lili Qiu |

What Does Parameter-free Probing Really Uncover?

Tommi Buder-Gröndahl |

Speech language models lack important brain-relevant semantics

Subba Reddy Oota | Emin Çelik | Fatma Deniz | Mariya Toneva |

Basreh or Basra? Geoparsing Historical Locations in the Svoboda Diaries

Jolie Zhou | Camille Cole | Annie Chen |