Mark Díaz

Affiliate
Written By Selly Djap

Senior Research Scientist

GOOGLE RESEARCH

Mark Díaz is a Senior Research Scientist at Google Research. His work focuses on social bias and the use of algorithmic technologies to analyze human behavior, particularly the behaviors of underrepresented social groups. Most recently he has focused on values and biases embedded in natural language datasets.

Díaz completed his Ph.D. in Technology & Social Behavior, a joint program in Computer Science and Communication at Northwestern University where he was advised by Darren Gergle. Before completing his doctoral work on age-related biases in sentiment analysis, he worked as a graduate fellow at SMART Chicago, a nonprofit focused on technology access and equity in Chicago. As a graduate fellow he researched perceptions among Black and low-income Chicago residents of city technology policy.

Selected Publication

Featured
Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates
Research Report
Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates
Research Report

Aida Davani, Mark Díaz, Dylan Baker, Vinodkumar Prabhakaran

Jun 2024 • The 2024 ACM Conference on Fairness, Accountability, and Transparency, 2007-2021

Research Report
STAR: SocioTechnical Approach to Red Teaming Language Models
Research Report
STAR: SocioTechnical Approach to Red Teaming Language Models
Research Report

Laura Weidinger, John Mellor, Bernat Guillen Pegueroles, Nahema Marchal, Ravin Kumar, Kristian Lum, Canfer Akbulut, Mark Díaz, Stevie Bergman, Mikel Rodriguez, Verena Rieser, William Isaac

Jun 2024 • arXiv preprint arXiv:2406.11757

Research Report
The illusion of artificial inclusion
Research Report
The illusion of artificial inclusion
Research Report

William Agnew, A Stevie Bergman, Jennifer Chien, Mark Díaz, Seliem El-Sayed, Jaylen Pittman, Shakir Mohamed, Kevin R McKee

May 2024 • Proceedings of the CHI Conference on Human Factors in Computing Systems, 1-12

Research Report
Intersectionality in AI Safety: Using Multilevel Models to Understand Diverse Perceptions of Safety in Conversational AI
Research Report
Intersectionality in AI Safety: Using Multilevel Models to Understand Diverse Perceptions of Safety in Conversational AI
Research Report

Christopher Homan, Gregory Serapio-Garcia, Lora Aroyo, Mark Díaz, Alicia Parrish, Vinodkumar Prabhakaran, Alex Taylor, Ding Wang

May 2024 • Proceedings of the 3rd Workshop on Perspectivist Approaches to NLP (NLPerspectives)@ LREC-COLING 2024, 131-141

Research Report
Discipline and Label: A WEIRD Genealogy and Social Theory of Data Annotation
Research Report
Discipline and Label: A WEIRD Genealogy and Social Theory of Data Annotation
Research Report

Andrew Smart, Ding Wang, Ellis Monk, Mark Díaz, Atoosa Kasirzadeh, Erin Van Liemt, Sonja Schmer-Galunder

Feb 2024 • arXiv preprint arXiv:2402.06811

Research Report
Dices dataset: Diversity in conversational ai evaluation for safety
Peer-reviewed
Dices dataset: Diversity in conversational ai evaluation for safety
Peer-reviewed

Lora Aroyo, Alex Taylor, Mark Díaz, Christopher Homan, Alicia Parrish, Gregory Serapio-García, Vinodkumar Prabhakaran, Ding Wang

Dec 2023 • Advances in Neural Information Processing Systems 36, 53330-53342

Peer-reviewed
PaLM 2 technical report
Research Report
PaLM 2 technical report
Research Report

Mark Díaz et al.

May 2023 • arXiv preprint arXiv:2305.10403

Research Report
PaLM: Scaling language modeling with pathways
Research Report
PaLM: Scaling language modeling with pathways
Research Report

Mark Díaz et al.

Oct 2022 • arXiv preprint arXiv:2204.02311

Research Report
Power to the people? Opportunities and challenges for participatory AI
Research Report
Power to the people? Opportunities and challenges for participatory AI
Research Report

Abeba Birhane, William Isaac, Vinodkumar Prabhakaran, Mark Díaz, Madeleine Clare Elish, Iason Gabriel, Shakir Mohamed

Oct 2022 • Proceedings of the 2nd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization, 1-8

Research Report
Accounting for offensive speech as a practice of resistance
Research Report
Accounting for offensive speech as a practice of resistance
Research Report

Mark Díaz, Razvan Amironesei, Laura Weidinger, Iason Gabriel

Jul 2022 • Proceedings of the sixth workshop on online abuse and harms (woah), 192-202

Research Report
Crowdworksheets: Accounting for individual and collective identities underlying crowdsourced dataset annotation
Research Report
Crowdworksheets: Accounting for individual and collective identities underlying crowdsourced dataset annotation
Research Report

Mark Díaz, Ian Kivlichan, Rachel Rosen, Dylan Baker, Razvan Amironesei, Vinodkumar Prabhakaran, Emily Denton

Jun 2022 • Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency, 2342-2351

Research Report
Lamda: Language models for dialog applications
Research Report
Lamda: Language models for dialog applications
Research Report

Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Vincent Zhao, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Pranesh Srinivasan, Laichee Man, Kathleen Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Aguera-Arcas, Claire Cui, Marian Croak, Ed Chi, Quoc Le

Jan 2022 • arXiv preprint arXiv:2201.08239

Research Report
Whose ground truth? Accounting for individual and collective identities underlying dataset annotation
Research Report
Whose ground truth? Accounting for individual and collective identities underlying dataset annotation
Research Report

Remi Denton, Mark Díaz, Ian Kivlichan, Vinodkumar Prabhakaran, Rachel Rosen

Dec 2021 • arXiv preprint arXiv:2112.04554

Research Report
On Releasing Annotator-Level Labels and Information in Datasets
Research Report
On Releasing Annotator-Level Labels and Information in Datasets
Research Report

Vinodkumar Prabhakaran, Aida Mostafazadeh Davani, Mark Díaz

Nov 2021 • Empirical Methods in Natural Language Processing

Research Report
Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations
Peer-reviewed
Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations
Peer-reviewed

Aida Mostafazadeh Davani, Mark Díaz, Vinodkumar Prabhakaran

Oct 2021 • Transactions of the Association of Computational Linguistics 10, 92-110

Peer-reviewed
Platforming Intersectionality
Peer-reviewed
Platforming Intersectionality
Peer-reviewed

Aymar Jean Christian, Faithe Day, Mark Díaz and Chelsea Peterson-Salahuddin

Aug 2020 • Social Media + Society 6(3)

Peer-reviewed
Whose Walkability?
Peer-reviewed
Whose Walkability?
Peer-reviewed

Challenges in Algorithmically Measuring Subjective Experience

Mark Diaz and Nicholas Diakopoulos

Nov 2019 • Proceedings of the ACM on Human-Computer Interaction – CSCW, 3(126):1-22

Peer-reviewed
“The Cavalry Ain’t Coming in to Save Us” (Copy)
Peer-reviewed
“The Cavalry Ain’t Coming in to Save Us” (Copy)
Peer-reviewed

Supporting Capacities and Relationships Through Civic Tech

Jessa Dickinson, Mark Díaz, Christopher A. Le Dantec and Sheena Erete

Nov 2019 • Proceedings of the ACM on Human-Computer Interaction 3(123):1-21

Peer-reviewed
Addressing Age-related Bias in Sentiment Analysis
Peer-reviewed
Addressing Age-related Bias in Sentiment Analysis
Peer-reviewed

Mark Diaz, Isaac Johnson, Amanda Lazar, Anne Marie Piper and Darren Gergle

Apr 2018 • Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems 412:1-14

Peer-reviewed
Going gray, failure to hire, and the ick factor: Analyzing how older bloggers talk about ageism
Research Report
Going gray, failure to hire, and the ick factor: Analyzing how older bloggers talk about ageism
Research Report

Amanda Lazar, Mark Díaz, Robin Brewer, Chelsea Kim, Anne Marie Piper

Feb 2017 • Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, 655-668

Research Report
Selly Djap
Previous

Kinjal Dave
Next

Stephanie Dinkins