research
∙
05/29/2023
Gaussian Process Probes (GPP) for Uncertainty-Aware Probing
Understanding which concepts models can and cannot represent has been fu...
share
research
∙
03/23/2023
CoBIT: A Contrastive Bi-directional Image-Text Generation Model
The field of vision and language has witnessed a proliferation of pre-tr...
research
∙
10/11/2022
Underspecification in Scene Description-to-Depiction Tasks
Questions regarding implicitness, ambiguity and underspecification are c...
research
∙
06/22/2022
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
We present the Pathways Autoregressive Text-to-Image (Parti) model, whic...
research
∙
04/06/2022
Simple and Effective Synthesis of Indoor 3D Scenes
We study the problem of synthesizing immersive 3D indoor scenes from one...
research
∙
11/25/2021
Less is More: Generating Grounded Navigation Instructions from Landmarks
We study the automatic generation of navigation instructions from 360-de...
research
∙
10/09/2021
Vector-quantized Image Modeling with Improved VQGAN
Pretraining language models with next-token prediction on massive text c...
research
∙
09/10/2021
MURAL: Multimodal, Multitask Retrieval Across Languages
Both image-caption pairs and translation pairs provide the means to lear...
research
∙
05/18/2021
Pathdreamer: A World Model for Indoor Navigation
People navigating in unfamiliar buildings take advantage of myriad visua...
research
∙
04/05/2021
Talk, Don't Write: A Study of Direct Speech-Based Image Retrieval
Speech-based image retrieval has been studied as a proxy for joint repre...
research
∙
03/23/2021
PanGEA: The Panoramic Graph Environment Annotation Toolkit
PanGEA, the Panoramic Graph Environment Annotation toolkit, is a lightwe...
research
∙
01/26/2021
On the Evaluation of Vision-and-Language Navigation Instructions
Vision-and-Language Navigation wayfinding agents can be enhanced by expl...
research
∙
01/12/2021
Cross-Modal Contrastive Learning for Text-to-Image Generation
The output of text-to-image synthesis systems should be coherent, clear,...
research
∙
11/07/2020
Text-to-Image Generation Grounded by Fine-Grained User Attention
Localized Narratives is a dataset with detailed natural language descrip...
research
∙
10/15/2020
Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Grounding
We introduce Room-Across-Room (RxR), a new Vision-and-Language Navigatio...
research
∙
08/21/2020
Spatial Language Representation with Multi-Level Geocoding
We present a multi-level geocoding model (MLG) that learns to associate ...
research
∙
05/18/2020
Text Classification with Few Examples using Controlled Generalization
Training data for text classification is often limited in practice, espe...
research
∙
04/30/2020
Crisscrossed Captions: Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO
Image captioning datasets have proven useful for multimodal representati...
research
∙
01/10/2020
Retouchdown: Adding Touchdown to StreetLearn as a Shareable Resource for Language Grounding Tasks in Street View
The Touchdown dataset (Chen et al., 2019) provides instructions by human...
research
∙
12/12/2019
Extending Machine Language Models toward Human-Level Language Understanding
Language is central to human intelligence. We review recent breakthrough...
research
∙
09/23/2019
Learning Dense Representations for Entity Retrieval
We show that it is feasible to perform entity linking by training a dual...
research
∙
09/19/2019
Large-scale representation learning from visually grounded untranscribed speech
Systems that can associate images with their spoken audio captions are a...
research
∙
08/30/2019
PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identification
Most existing work on adversarial data generation focuses on English. Fo...
research
∙
08/09/2019
Transferable Representation Learning in Vision-and-Language Navigation
Vision-and-Language Navigation (VLN) tasks such as Room-to-Room (R2R) re...
research
∙
07/11/2019
Effective and General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warping
In instruction conditioned navigation, agents interpret natural language...
research
∙
05/31/2019
Multi-modal Discriminative Model for Vision-and-Language Navigation
Vision-and-Language Navigation (VLN) is a natural language grounding tas...
research
∙
05/29/2019
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation
Advances in learning and representations have reinvigorated work that co...
research
∙
04/01/2019
PAWS: Paraphrase Adversaries from Word Scrambling
Existing paraphrase identification datasets lack sentence pairs that hav...
research
∙
10/31/2018
A task in a suit and a tie: paraphrase generation with semantic augmentation
Paraphrasing is rooted in semantics. We show the effectiveness of transf...
research
∙
10/11/2018
Mind the GAP: A Balanced Corpus of Gendered Ambiguous Pronouns
Coreference resolution is an important task for natural language underst...
research
∙
10/09/2018
A Fast, Compact, Accurate Model for Language Identification of Codemixed Text
We address fine-grained multilingual language identification: providing ...
research
∙
08/28/2018
Learning To Split and Rephrase From Wikipedia Edit History
Split and rephrase is the task of breaking down a sentence into shorter ...
research
∙
11/26/2016
Fill it up: Exploiting partial dependency annotations in a minimum spanning tree parser
Unsupervised models of dependency parsing typically require large amount...
research
∙
11/10/2012