research
∙
08/12/2023
VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Use
We introduce VisIT-Bench (Visual InsTruction Benchmark), a benchmark for...
share
research
∙
08/02/2023
OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models
We introduce OpenFlamingo, a family of autoregressive vision-language mo...
research
∙
07/06/2023
Read, Look or Listen? What's Needed for Solving a Multimodal Dataset
The prevalence of large-scale multimodal datasets presents unique challe...
research
∙
05/17/2023
What You See is What You Read? Improving Text-Image Alignment Evaluation
Automatically determining whether a text and a corresponding image are s...
research
∙
04/27/2023
q2d: Turning Questions into Dialogs to Teach Models How to Search
One of the exciting capabilities of recent language models for dialog is...
research
∙
04/27/2023
DataComp: In search of the next generation of multimodal datasets
Large multimodal datasets have been instrumental in recent breakthroughs...
research
∙
03/27/2023
IRFL: Image Recognition of Figurative Language
Figures of speech such as metaphors, similes, and idioms allow language ...
research
∙
03/13/2023
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images
Weird, unusual, and uncanny images pique the curiosity of observers beca...
research
∙
12/08/2022
VASR: Visual Analogies of Situation Recognition
A core process in human cognition is analogical mapping: the ability to ...
research
∙
07/25/2022
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models
While vision-and-language models perform well on tasks such as visual qu...
research
∙
09/05/2021
Data Efficient Masked Language Modeling for Vision and Language
Masked language modeling (MLM) is one of the key sub-tasks in vision-lan...
research
∙
03/17/2021