Intersectionality in AI Safety: Using Multilevel Models to Understand Diverse Perceptions of Safety in Conversational AI NLPerspectives WS

Christopher Homan | Gregory Serapio-Garcia | Lora Aroyo | Mark Diaz | Alicia Parrish | Vinodkumar Prabhakaran | Alex Taylor | Ding Wang |

Diversity-Aware Annotation for Conversational AI Safety Safety4ConvAI WS

Alicia Parrish | Vinodkumar Prabhakaran | Lora Aroyo | Mark Díaz | Christopher M. Homan | Greg Serapio-García | Alex S. Taylor | Ding Wang |

GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives NAACL

Vinodkumar Prabhakaran | Christopher Homan | Lora Aroyo | Aida Mostafazadeh Davani | Alicia Parrish | Alex Taylor | Mark Diaz | Ding Wang | Gregory Serapio-García |

STAR: SocioTechnical Approach to Red Teaming Language Models EMNLP

Laura Weidinger | John F J Mellor | Bernat Guillén Pegueroles | Nahema Marchal | Ravin Kumar | Kristian Lum | Canfer Akbulut | Mark Diaz | A. Stevie Bergman | Mikel D. Rodriguez | Verena Rieser | William Isaac |

D3CODE: Disentangling Disagreements in Data across Cultures on Offensiveness Detection and Evaluation EMNLP

Aida Mostafazadeh Davani | Mark Diaz | Dylan K Baker | Vinodkumar Prabhakaran |