research
∙
06/09/2023
Evaluating the Social Impact of Generative AI Systems in Systems and Society
Generative AI systems across modalities, ranging from text, image, audio...
share
research
∙
05/22/2023
This Prompt is Measuring <MASK>: Evaluating Bias Evaluation in Language Models
Bias research in NLP seeks to analyse models for social biases, thus hel...
research
∙
05/15/2023
It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performance
Progress in NLP is increasingly measured through benchmarks; hence, cont...
research
∙
05/02/2023
Taxonomizing and Measuring Representational Harms: A Look at Image Tagging
In this paper, we examine computational approaches for measuring the "fa...
research
∙
01/13/2023
Fairness and Sequential Decision Making: Limits, Lessons, and Opportunities
As automated decision making and decision assistance systems become comm...
research
∙
12/29/2022
Examining Political Rhetoric with Epistemic Stance Detection
Participants in political discourse employ rhetorical strategies – such ...
research
∙
05/13/2022
Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications
There are many ways to express similar things in text, which makes evalu...
research
∙
10/19/2021
Risks of AI Foundation Models in Education
If the authors of a recent Stanford report (Bommasani et al., 2021) on t...
research
∙
06/21/2021
A Survey of Race, Racism, and Anti-Racism in NLP
Despite inextricable ties between race and language, little work has con...
research
∙
05/18/2021
Confronting Structural Inequities in AI for Education
Educational technologies, and the systems of schooling in which they are...
research
∙
04/07/2021
How to Write a Bias Statement: Recommendations for Submissions to the Workshop on Gender Bias in NLP
At the Workshop on Gender Bias in NLP (GeBNLP), we'd like to encourage a...
research
∙
05/28/2020
Language (Technology) is Power: A Critical Survey of "Bias" in NLP
We survey 146 papers analyzing "bias" in NLP systems, finding that their...
research
∙
04/17/2018
Monte Carlo Syntax Marginals for Exploring and Using Dependency Parses
Dependency parsing research, which has made significant gains in recent ...
research
∙
06/30/2017
Racial Disparity in Natural Language Processing: A Case Study of Social Media African-American English
We highlight an important frontier in algorithmic fairness: disparity in...
research
∙
08/31/2016
Demographic Dialectal Variation in Social Media: A Case Study of African-American English
Though dialectal language is increasingly abundant on social media, few ...
research
∙
06/20/2016