research
∙
06/21/2023
OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents
Large multimodal models trained on natural documents, which interleave i...
share
research
∙
06/14/2023
Toward Grounded Social Reasoning
Consider a robot tasked with tidying a desk with a meticulously construc...
research
∙
02/24/2023
Language-Driven Representation Learning for Robotics
Recent work in visual representation learning for robotics demonstrates ...
research
∙
01/06/2023
"No, to the Right" – Online Language Corrections for Robotic Manipulation via Shared Autonomy
Systems for language-guided human-robot interaction must satisfy two key...
research
∙
10/14/2022
Eliciting Compatible Demonstrations for Multi-Human Imitation Learning
Imitation learning from human-provided demonstrations is a strong approa...
research
∙
11/05/2021
LILA: Language-Informed Latent Actions
We introduce Language-Informed Latent Actions (LILA), a framework for le...
research
∙
07/06/2021
Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering
Active learning promises to alleviate the massive data needs of supervis...
research
∙
06/14/2021
Targeted Data Acquisition for Evolving Negotiation Agents
Successful negotiators must learn how to balance optimizing for self-int...
research
∙
05/02/2021
Learning Visually Guided Latent Actions for Assistive Teleoperation
It is challenging for humans – particularly those living with physical d...
research
∙
03/10/2021
ELLA: Exploration through Learned Language Abstraction
Building agents capable of understanding language instructions is critic...
research
∙
10/11/2020
Learning Adaptive Language Interfaces through Decomposition
Our goal is to create an interactive natural language interface that eff...
research
∙
11/20/2019
Generating Interactive Worlds with Text
Procedurally generating cohesive and interesting game environments is ch...
research
∙
09/12/2019
Finding Generalizable Evidence by Learning to Convince Q A Models
We propose a system that finds the strongest supporting evidence for a g...
research
∙
03/07/2019
Learning to Speak and Act in a Fantasy Text Adventure Game
We introduce a large scale crowdsourced text adventure game as a researc...
research
∙
11/21/2018
Improving Grey-Box Fuzzing by Modeling Program Behavior
Grey-box fuzzers such as American Fuzzy Lop (AFL) are popular tools for ...
research
∙
08/24/2018
Adaptive Grey-Box Fuzz-Testing with Thompson Sampling
Fuzz testing, or "fuzzing," refers to a widely deployed class of techniq...
research
∙
07/26/2017
A Tale of Two DRAGGNs: A Hybrid Approach for Interpreting Action-Oriented and Goal-Oriented Instructions
Robots operating alongside humans in diverse, stochastic environments mu...
research
∙
06/02/2017
Latent Attention Networks
Deep neural networks are able to solve tasks across a variety of domains...
research
∙
04/21/2017