research
∙
08/01/2023
Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Bias
Recent studies show that instruction tuning and learning from human feed...
share
research
∙
05/24/2023
Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolution
Spurious correlations were found to be an important factor explaining mo...
research
∙
05/23/2023
Schema-Driven Information Extraction from Heterogeneous Tables
In this paper, we explore the question of whether language models (LLMs)...
research
∙
05/09/2023
The Perfect Victim: Computational Analysis of Judicial Attitudes towards Victims of Sexual Violence
We develop computational models to analyze court statements in order to ...
research
∙
03/13/2023
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images
Weird, unusual, and uncanny images pique the curiosity of observers beca...
research
∙
02/16/2023
Evaluating and Improving the Coreference Capabilities of Machine Translation Models
Machine translation (MT) requires a wide range of linguistic capabilitie...
research
∙
02/09/2023
A Large-Scale Multilingual Study of Visual Constraints on Linguistic Selection of Descriptions
We present a large, multilingual study into how vision constrains lingui...
research
∙
12/08/2022
VASR: Visual Analogies of Situation Recognition
A core process in human cognition is analogical mapping: the ability to ...
research
∙
10/24/2022
"Covid vaccine is against Covid but Oxford vaccine is made at Oxford!" Semantic Interpretation of Proper Noun Compounds
Proper noun compounds, e.g., "Covid vaccine", convey information in a su...
research
∙
10/13/2022
You Can Have Your Data and Balance It Too: Towards Balanced and Efficient Multilingual Models
Multilingual models have been widely used for cross-lingual transfer to ...
research
∙
07/25/2022
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models
While vision-and-language models perform well on tasks such as visual qu...
research
∙
05/12/2022
A Computational Acquisition Model for Multimodal Word Categorization
Recent advances in self-supervised modeling of text and images open new ...
research
∙
05/09/2022
A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank
We show that the choice of pretraining languages affects downstream cros...
research
∙
04/27/2022
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations
Recent work has shown that deep learning models in NLP are highly sensit...
research
∙
10/24/2021
Automated Extraction of Sentencing Decisions from Court Cases in the Hebrew Language
We present the task of Automated Punishment Extraction (APE) in sentenci...
research
∙
09/09/2021
Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach
We present models which complete missing text given transliterations of ...
research
∙
09/08/2021
Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation
Recent works have found evidence of gender bias in models of machine tra...
research
∙
09/05/2021
Data Efficient Masked Language Modeling for Vision and Language
Masked language modeling (MLM) is one of the key sub-tasks in vision-lan...
research
∙
06/08/2021
Realistic Evaluation Principles for Cross-document Coreference Resolution
We point out that common evaluation practices for cross-document corefer...
research
∙
06/02/2021
Cross-document Coreference Resolution over Predicted Mentions
Coreference resolution has been mostly investigated within a single docu...
research
∙
03/17/2021
Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA
Recent works have shown that supervised models often exploit data artifa...
research
∙
01/25/2021
Process-Level Representation of Scientific Protocols with Interactive Annotation
We develop Process Execution Graphs (PEG), a document-level representati...
research
∙
01/17/2021
GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation
Leaderboards have eased model development for many NLP datasets by stand...
research
∙
10/12/2020
Gender Coreference and Bias Evaluation at WMT 2020
Gender bias in machine translation can manifest when choosing gender inf...
research
∙
10/07/2020
MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics
Posing reading comprehension as a generation problem provides a great de...
research
∙
09/23/2020
Streamlining Cross-Document Coreference Resolution: Evaluation and Modeling
Recent evaluation protocols for Cross-document (CD) coreference resoluti...
research
∙
04/28/2020
Active Learning for Coreference Resolution using Discrete Annotation
We improve upon pairwise annotation for active learning in coreference r...
research
∙
03/10/2020
Ecological Semantics: Programming Environments for Situated Language Understanding
Large-scale natural language understanding (NLU) systems have made impre...
research
∙
11/08/2019
Crowdsourcing a High-Quality Gold Standard for QA-SRL
Question-answer driven Semantic Role Labeling (QA-SRL) has been proposed...
research
∙
10/26/2019
Yall should read this! Identifying Plurality in Second-Person Personal Pronouns in English Texts
Distinguishing between singular and plural "you" in English is a challen...
research
∙
10/05/2019
On the Limits of Learning to Actively Learn Semantic Representations
One of the goals of natural language understanding is to develop models ...
research
∙
06/19/2019
Gender trends in computer science authorship
A comprehensive and up-to-date analysis of Computer Science literature (...
research
∙
06/03/2019
Evaluating Gender Bias in Machine Translation
We present the first challenge set and evaluation protocol for the analy...
research
∙
03/01/2019
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
Reading comprehension has recently seen rapid progress, with systems mat...
research
∙
11/16/2017
Crowdsourcing Question-Answer Meaning Representations
We introduce Question-Answer Meaning Representations (QAMRs), which repr...
research
∙
03/04/2016