Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates
Aida Davani, Mark Díaz, Dylan Baker, Vinodkumar Prabhakaran
Jun 2024 • The 2024 ACM Conference on Fairness, Accountability, and Transparency, 2007-2021
STAR: SocioTechnical Approach to Red Teaming Language Models
Laura Weidinger, John Mellor, Bernat Guillen Pegueroles, Nahema Marchal, Ravin Kumar, Kristian Lum, Canfer Akbulut, Mark Díaz, Stevie Bergman, Mikel Rodriguez, Verena Rieser, William Isaac
Jun 2024 • arXiv preprint arXiv:2406.11757
The illusion of artificial inclusion
William Agnew, A Stevie Bergman, Jennifer Chien, Mark Díaz, Seliem El-Sayed, Jaylen Pittman, Shakir Mohamed, Kevin R McKee
May 2024 • Proceedings of the CHI Conference on Human Factors in Computing Systems, 1-12
Intersectionality in AI Safety: Using Multilevel Models to Understand Diverse Perceptions of Safety in Conversational AI
Christopher Homan, Gregory Serapio-Garcia, Lora Aroyo, Mark Díaz, Alicia Parrish, Vinodkumar Prabhakaran, Alex Taylor, Ding Wang
May 2024 • Proceedings of the 3rd Workshop on Perspectivist Approaches to NLP (NLPerspectives)@ LREC-COLING 2024, 131-141
Discipline and Label: A WEIRD Genealogy and Social Theory of Data Annotation
Andrew Smart, Ding Wang, Ellis Monk, Mark Díaz, Atoosa Kasirzadeh, Erin Van Liemt, Sonja Schmer-Galunder
Feb 2024 • arXiv preprint arXiv:2402.06811
Dices dataset: Diversity in conversational ai evaluation for safety
Lora Aroyo, Alex Taylor, Mark Díaz, Christopher Homan, Alicia Parrish, Gregory Serapio-García, Vinodkumar Prabhakaran, Ding Wang
Dec 2023 • Advances in Neural Information Processing Systems 36, 53330-53342
PaLM: Scaling language modeling with pathways
Mark Díaz et al.
Oct 2022 • arXiv preprint arXiv:2204.02311
Power to the people? Opportunities and challenges for participatory AI
Abeba Birhane, William Isaac, Vinodkumar Prabhakaran, Mark Díaz, Madeleine Clare Elish, Iason Gabriel, Shakir Mohamed
Oct 2022 • Proceedings of the 2nd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization, 1-8
Accounting for offensive speech as a practice of resistance
Mark Díaz, Razvan Amironesei, Laura Weidinger, Iason Gabriel
Jul 2022 • Proceedings of the sixth workshop on online abuse and harms (woah), 192-202
Crowdworksheets: Accounting for individual and collective identities underlying crowdsourced dataset annotation
Mark Díaz, Ian Kivlichan, Rachel Rosen, Dylan Baker, Razvan Amironesei, Vinodkumar Prabhakaran, Emily Denton
Jun 2022 • Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency, 2342-2351
Lamda: Language models for dialog applications
Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Vincent Zhao, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Pranesh Srinivasan, Laichee Man, Kathleen Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Aguera-Arcas, Claire Cui, Marian Croak, Ed Chi, Quoc Le
Jan 2022 • arXiv preprint arXiv:2201.08239
Whose ground truth? Accounting for individual and collective identities underlying dataset annotation
Remi Denton, Mark Díaz, Ian Kivlichan, Vinodkumar Prabhakaran, Rachel Rosen
Dec 2021 • arXiv preprint arXiv:2112.04554
On Releasing Annotator-Level Labels and Information in Datasets
Vinodkumar Prabhakaran, Aida Mostafazadeh Davani, Mark Díaz
Nov 2021 • Empirical Methods in Natural Language Processing
Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations
Aida Mostafazadeh Davani, Mark Díaz, Vinodkumar Prabhakaran
Oct 2021 • Transactions of the Association of Computational Linguistics 10, 92-110
Platforming Intersectionality
Aymar Jean Christian, Faithe Day, Mark Díaz and Chelsea Peterson-Salahuddin
Aug 2020 • Social Media + Society 6(3)
Whose Walkability?
Challenges in Algorithmically Measuring Subjective Experience
Mark Diaz and Nicholas Diakopoulos
Nov 2019 • Proceedings of the ACM on Human-Computer Interaction – CSCW, 3(126):1-22
“The Cavalry Ain’t Coming in to Save Us” (Copy)
Supporting Capacities and Relationships Through Civic Tech
Jessa Dickinson, Mark Díaz, Christopher A. Le Dantec and Sheena Erete
Nov 2019 • Proceedings of the ACM on Human-Computer Interaction 3(123):1-21
Addressing Age-related Bias in Sentiment Analysis
Mark Diaz, Isaac Johnson, Amanda Lazar, Anne Marie Piper and Darren Gergle
Apr 2018 • Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems 412:1-14
Going gray, failure to hire, and the ick factor: Analyzing how older bloggers talk about ageism
Amanda Lazar, Mark Díaz, Robin Brewer, Chelsea Kim, Anne Marie Piper
Feb 2017 • Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, 655-668