research
∙
02/09/2023
Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflow
Recent research has shown that language models exploit `artifacts' in be...
share
research
∙
04/12/2022
NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks
Given the ubiquitous nature of numbers in text, reasoning with numbers t...
research
∙
08/10/2020
DQI: A Guide to Benchmark Evaluation
A `state of the art' model A surpasses humans in a benchmark B, but fail...
research
∙
05/18/2020
Towards Question Format Independent Numerical Reasoning: A Set of Prerequisite Tasks
Numerical reasoning is often important to accurately understand the worl...
research
∙
05/02/2020