research
∙
07/20/2023
OBJECT 3DIT: Language-guided 3D-aware Image Editing
Existing image editing tools, while powerful, typically disregard the un...
share
research
∙
07/11/2023
Objaverse-XL: A Universe of 10M+ 3D Objects
Natural language processing and 2D vision models have attained remarkabl...
research
∙
06/27/2023
MIMIC: Masked Image Modeling with Image Correspondences
Many pixelwise dense prediction tasks-depth estimation and semantic segm...
research
∙
06/26/2023
SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality
In the last year alone, a surge of new benchmarks to measure composition...
research
∙
06/16/2023
Neural Priming for Sample-Efficient Adaptation
We propose Neural Priming, a technique for adapting large pretrained mod...
research
∙
03/28/2023
Exposing and Addressing Cross-Task Inconsistency in Unified Vision-Language Models
As general purpose vision models get increasingly effective at a wide se...
research
∙
01/10/2023
Neural Radiance Field Codebooks
Compositional representations of the world are a promising step towards ...
research
∙
12/15/2022
Objaverse: A Universe of Annotated 3D Objects
Massive data corpora like WebText, Wikipedia, Conceptual Captions, WebIm...
research
∙
12/08/2022
Phone2Proc: Bringing Robust Robots Into Our Chaotic World
Training embodied agents in simulation has become mainstream for the emb...
research
∙
12/01/2022
A General Purpose Supervisory Signal for Embodied Agents
Training effective embodied AI agents often involves manual reward engin...
research
∙
11/28/2022
Satlas: A Large-Scale, Multi-Task Dataset for Remote Sensing Image Understanding
Remote sensing images are useful for a wide variety of environmental and...
research
∙
11/18/2022
Visual Programming: Compositional visual reasoning without training
We present VISPROG, a neuro-symbolic approach to solving complex and com...
research
∙
11/17/2022
I Can't Believe There's No Images! Learning Visual Tasks Using only Language Data
Many high-level skills that are required for computer vision tasks, such...
research
∙
06/17/2022
Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Tasks
We propose Unified-IO, a model that performs a large variety of AI tasks...
research
∙
06/17/2022
What do navigation agents learn about their environment?
Today's state of the art visual navigation agents typically consist of l...
research
∙
06/14/2022
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation
Massive datasets and high-capacity models have driven many recent advanc...
research
∙
04/28/2022
GRIT: General Robust Image Task Benchmark
Computer vision models excel at making predictions when the test distrib...
research
∙
03/15/2022
Object Manipulation via Visual Target Localization
Object manipulation is a critical skill required for Embodied AI agents ...
research
∙
02/14/2022
ASC me to Do Anything: Multi-task Training for Embodied AI
Embodied AI has seen steady progress across a diverse set of independent...
research
∙
02/04/2022
Webly Supervised Concept Expansion for General Purpose Vision Models
General purpose vision (GPV) systems are models that are designed to sol...
research
∙
12/01/2021
Iconary: A Pictionary-Based Game for Testing Multimodal Communication with Drawings and Text
Communicating with humans is challenging for AIs because it requires a s...
research
∙
11/18/2021
Simple but Effective: CLIP Embeddings for Embodied AI
Contrastive language image pretraining (CLIP) encoders have been shown t...
research
∙
06/08/2021
RobustNav: Towards Benchmarking Robustness in Embodied Navigation
As an attempt towards assessing the robustness of embodied navigation ag...
research
∙
06/02/2021
Container: Context Aggregation Network
Convolutional neural networks (CNNs) are ubiquitous in computer vision, ...
research
∙
06/01/2021
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World
We propose PIGLeT: a model that learns physical commonsense knowledge th...
research
∙
04/22/2021
ManipulaTHOR: A Framework for Visual Object Manipulation
The domain of Embodied AI has recently witnessed substantial progress, p...
research
∙
04/14/2021
GridToPix: Training Embodied Agents with Minimal Supervision
While deep reinforcement learning (RL) promises freedom from hand-labele...
research
∙
04/02/2021
Visual Semantic Role Labeling for Video Understanding
We propose a new framework for understanding and representing related sa...
research
∙
04/01/2021
Towards General Purpose Vision Systems
A special purpose learning system assumes knowledge of admissible tasks ...
research
∙
03/30/2021
Visual Room Rearrangement
There has been a significant recent progress in the field of Embodied AI...
research
∙
09/23/2020
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers
Mirroring the success of masked language models, vision-and-language cou...
research
∙
08/28/2020
AllenAct: A Framework for Embodied AI Research
The domain of Embodied AI, in which agents learn to complete tasks throu...
research
∙
07/23/2020
Bridging the Imitation Gap by Adaptive Insubordination
Why do agents often obtain better reinforcement learning policies when i...
research
∙
07/09/2020
A Cordial Sync: Going Beyond Marginal Policies for Multi-Agent Embodied Tasks
Autonomous agents must learn to collaborate. It is not scalable to devel...
research
∙
07/06/2020
In the Wild: From ML Models to Pragmatic ML Systems
Enabling robust intelligence in the wild entails learning systems that o...
research
∙
06/26/2020
Supermasks in Superposition
We present the Supermasks in Superposition (SupSup) model, capable of se...
research
∙
06/23/2020
ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects
We revisit the problem of Object-Goal Navigation (ObjectNav). In its sim...
research
∙
06/21/2020
Feel The Music: Automatically Generating A Dance For An Input Song
We present a general computational approach that enables a machine to ge...
research
∙
06/16/2020
Learning About Objects by Learning to Interact with Them
Much of the remarkable progress in computer vision has been focused arou...
research
∙
04/14/2020
RoboTHOR: An Open Simulation-to-Real Embodied AI Platform
Visual recognition ecosystems (e.g. ImageNet, Pascal, COCO) have undenia...
research
∙
03/26/2020
Grounded Situation Recognition
We introduce Grounded Situation Recognition (GSR), a task that requires ...
research
∙
12/17/2019
Artificial Agents Learn Flexible Visual Representations by Playing a Hiding Game
The ubiquity of embodied gameplay, observed in a wide variety of animal ...
research
∙
11/29/2019
What's Hidden in a Randomly Weighted Neural Network?
Training a neural network is synonymous with learning the values of the ...
research
∙
04/11/2019
Two Body Problem: Collaborative Visual Task Completion
Collaboration is a necessary skill to perform tasks that are beyond one ...
research
∙
12/13/2018
ELASTIC: Improving CNNs with Instance Specific Scaling Policies
Scale variation has been a challenge from traditional to modern approach...
research
∙
04/10/2018
Imagine This! Scripts to Compositions to Videos
Imagining a scene described in natural language with realistic layout an...
research
∙
12/09/2017
IQA: Visual Question Answering in Interactive Environments
We introduce Interactive Question Answering (IQA), the task of answering...
research
∙
12/05/2017
Structured Set Matching Networks for One-Shot Part Labeling
Diagrams often depict complex phenomena and serve as a good test bed for...
research
∙
12/01/2017
Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering
A number of studies have found that today's Visual Question Answering (V...
research
∙
04/26/2017