research
∙
09/18/2023
MindAgent: Emergent Gaming Interaction
Large Language Models (LLMs) have the capacity of performing complex sch...
share
research
∙
08/21/2023
X-VoE: Measuring eXplanatory Violation of Expectation in Physical Events
Intuitive physics is pivotal for human understanding of the physical wor...
research
∙
07/31/2023
Part-level Scene Reconstruction Affords Robot Interaction
Existing methods for reconstructing interactive scenes primarily focus o...
research
∙
07/07/2023
Brain in a Vat: On Missing Pieces Towards Artificial General Intelligence in Large Language Models
In this perspective paper, we first comprehensively review existing eval...
research
∙
06/27/2023
MindDial: Belief Dynamics Tracking with Theory-of-Mind Modeling for Situated Neural Dialogue Generation
Humans talk in free-form while negotiating the expressed meanings or com...
research
∙
06/27/2023
Learning non-Markovian Decision-Making from State-only Sequences
Conventional imitation learning assumes access to the actions of demonst...
research
∙
06/15/2023
DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning
Pragmatic reasoning plays a pivotal role in deciphering implicit meaning...
research
∙
05/24/2023
Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners
The emergent few-shot reasoning capabilities of Large Language Models (L...
research
∙
04/09/2023
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes
Understanding the continuous states of objects is essential for task lea...
research
∙
01/15/2023
Diffusion-based Generation, Optimization, and Planning in 3D Scenes
We introduce SceneDiffuser, a conditional generative model for 3D scene ...
research
∙
01/14/2023
A Reconfigurable Data Glove for Reconstructing Physical and Virtual Grasps
In this work, we present a reconfigurable data glove design to capture d...
research
∙
10/29/2022
Learning Probabilistic Models from Generator Latent Spaces with Hat EBM
This work proposes a method for using any generator network as the found...
research
∙
10/24/2022
RulE: Neural-Symbolic Knowledge Graph Reasoning with Rule Embedding
Knowledge graph (KG) reasoning is an important problem for knowledge gra...
research
∙
10/14/2022
SQA3D: Situated Question Answering in 3D Scenes
We propose a new task to benchmark scene understanding of embodied agent...
research
∙
10/08/2022
EgoTaskQA: Understanding Human Tasks in Egocentric Videos
Understanding human tasks through video observations is an essential cap...
research
∙
09/20/2022
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering
When answering a question, humans utilize the information available acro...
research
∙
07/10/2022
Sequential Manipulation Planning on Scene Graph
We devise a 3D scene graph representation, contact graph+ (cg+), for eff...
research
∙
06/23/2022
VRKitchen2.0-IndoorKit: A Tutorial for Augmented Indoor Scene Building in Omniverse
With the recent progress of simulations by 3D modeling software and game...
research
∙
06/18/2022
EST: Evaluating Scientific Thinking in Artificial Agents
Theoretical ideas and empirical research have shown us a seemingly surpr...
research
∙
05/24/2022
EBM Life Cycle: MCMC Strategies for Synthesis, Defense, and Density Modeling
This work presents strategies to learn an Energy-Based Model (EBM) accor...
research
∙
04/24/2022
RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning
Reasoning about visual relationships is central to how humans interpret ...
research
∙
03/09/2022
Triangular Character Animation Sampling with Motion, Emotion, and Relation
Dramatic progress has been made in animating individual characters. Howe...
research
∙
01/26/2022
Attention cannot be an Explanation
Attention based explanations (viz. saliency maps), by providing interpre...
research
∙
01/17/2022
Discourse Analysis for Evaluating Coherence in Video Paragraph Captions
Video paragraph captioning is the task of automatically generating a coh...
research
∙
01/10/2022
Effective Representation to Capture Collaboration Behaviors between Explainer and User
An explainable AI (XAI) model aims to provide transparency (in the form ...
research
∙
12/12/2021
ValueNet: A New Dataset for Human Value Driven Dialogue System
Building a socially intelligent agent involves many challenges, one of w...
research
∙
11/28/2021
Emergent Graphical Conventions in a Visual Communication Game
Humans communicate with graphical sketches apart from symbolic languages...
research
∙
10/25/2021
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning
Current visual question answering (VQA) tasks mainly consider answering ...
research
∙
09/30/2021
Emergence of Theory of Mind Collaboration in Multiagent Systems
Currently, in the study of multiagent systems, the intentions of agents ...
research
∙
09/08/2021
YouRefIt: Embodied Reference Understanding with Language and Gesture
We study the understanding of embodied reference: One agent uses both la...
research
∙
09/03/2021
CX-ToM: Counterfactual Explanations with Theory-of-Mind for Enhancing Human Trust in Image Recognition Models
We propose CX-ToM, short for counterfactual explanations with theory-of ...
research
∙
09/01/2021
Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds
To date, various 3D scene understanding tasks still lack practical and g...
research
∙
08/03/2021
Consolidating Kinematic Models to Promote Coordinated Mobile Manipulations
We construct a Virtual Kinematic Chain (VKC) that readily consolidates t...
research
∙
05/10/2021
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning
Geometry problem solving has attracted much attention in the NLP communi...
research
∙
05/04/2021
VersaGNN: a Versatile accelerator for Graph neural networks
Graph Neural Network (GNN) is a promising approach for analyzing graph-s...
research
∙
04/19/2021
Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures by Differentiable Force Closure Estimation
Existing grasp synthesis methods are either analytical or data-driven. T...
research
∙
04/07/2021
Learning Triadic Belief Dynamics in Nonverbal Communication from Videos
Humans possess a unique social cognition capability; nonverbal communica...
research
∙
04/04/2021
Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis
How to effectively represent camera pose is an essential problem in 3D c...
research
∙
03/30/2021
Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignments
In this paper, we rethink the problem of scene reconstruction from an em...
research
∙
03/26/2021
ACRE: Abstract Causal REasoning Beyond Covariation
Causal induction, i.e., identifying unobservable mechanisms that lead to...
research
∙
03/26/2021
Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Execution
Spatial-temporal reasoning is a challenging task in Artificial Intellige...
research
∙
03/24/2021
VLGrammar: Grounded Grammar Induction of Vision and Language
Cognitive grammar suggests that the acquisition of language grammar is g...
research
∙
03/12/2021
Towards Socially Intelligent Agents with Mental State Transition and Human Utility
Building a socially intelligent agent involves many challenges, one of w...
research
∙
03/06/2021
Show Me What You Can Do: Capability Calibration on Reachable Workspace for Human-Robot Collaboration
Aligning humans' assessment of what a robot can do with its true capabil...
research
∙
12/27/2020
SMART: A Situation Model for Algebra Story Problems via Attributed Grammar
Solving algebra story problems remains a challenging task in artificial ...
research
∙
12/19/2020
Learning by Fixing: Solving Math Word Problems with Weak Supervision
Previous neural solvers of math word problems (MWPs) are learned with fu...
research
∙
11/18/2020
Weighted Entropy Modification for Soft Actor-Critic
We generalize the existing principle of the maximum Shannon entropy in r...
research
∙
11/18/2020
Vertical-Horizontal Structured Attention for Generating Music with Chords
In this paper, we propose a lightweight music-generating model based on ...
research
∙
11/12/2020
Generalized Inverse Planning: Learning Lifted non-Markovian Utility for Generalizable Task Representation
In searching for a generalizable representation of temporally extended t...
research
∙
09/17/2020