MILU: A Multi-task Indic Language Understanding Benchmark NAACL

Sshubam Verma | Mohammed Safi Ur Rahman Khan | Vishwajeet Kumar | Rudra Murthy | Jaydeep Sen |

Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languages ACL

Ashwin Sankar | Sparsh Jain | Nikhil Narasimhan | Devilal Choudhary | Dhairya Suman | Mohammed Safi Ur Rahman Khan | Anoop Kunchukuttan | Mitesh M Khapra | Raj Dabre |

FairI Tales: Evaluation of Fairness in Indian Contexts with a Focus on Bias and Stereotypes ACL

Janki Atul Nawale | Mohammed Safi Ur Rahman Khan | Janani D | Mansi Gupta | Danish Pruthi | Mitesh M Khapra |

Can Vision-Language Models Evaluate Handwritten Math? ACL

Oikantik Nath | Hanani Bathina | Mohammed Safi Ur Rahman Khan | Mitesh M Khapra |

Cross-Lingual Auto Evaluation for Assessing Multilingual LLMs ACL

Sumanth Doddapaneni | Mohammed Safi Ur Rahman Khan | Dilip Venkatesh | Raj Dabre | Anoop Kunchukuttan | Mitesh M Khapra |