LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks ACL

Anna Bavaresco | Raffaella Bernardi | Leonardo Bertolazzi | Desmond Elliott | Raquel Fernández | Albert Gatt | Esam Ghaleb | Mario Giulianelli | Michael Hanna | Alexander Koller | Andre Martins | Philipp Mondorf | Vera Neplenbroek | Sandro Pezzelle | Barbara Plank | David Schlangen | Alessandro Suglia | Aditya K Surikuchi | Ece Takmaz | Alberto Testoni |

Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models ACL

Philipp Mondorf | Sondre Wold | Barbara Plank |

BlackboxNLP-2025 MIB Shared Task: Exploring Ensemble Strategies for Circuit Localization Methods BlackboxNLP WS

Philipp Mondorf | Mingyang Wang | Sebastian Gerstner | Ahmad Dawar Hakimi | Yihong Liu | Leonor Veloso | Shijia Zhou | Hinrich Schuetze | Barbara Plank |

Reason to Rote: Rethinking Memorization in Reasoning EMNLP

Yupei Du | Philipp Mondorf | Silvia Casola | Yuekun Yao | Robert Litschko | Barbara Plank |

The Validation Gap: A Mechanistic Analysis of How Language Models Compute Arithmetic but Fail to Validate It EMNLP

Leonardo Bertolazzi | Philipp Mondorf | Barbara Plank | Raffaella Bernardi |