research
∙
06/10/2023
Explaining a machine learning decision to physicians via counterfactuals
Machine learning models perform well on several healthcare tasks and can...
share
research
∙
05/06/2023
Listen to Look into the Future: Audio-Visual Egocentric Gaze Anticipation
Egocentric gaze anticipation serves as a key building block for the emer...
research
∙
04/13/2023
ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistency
We present ShapeClipper, a novel method that reconstructs 3D object shap...
research
∙
03/28/2023
Egocentric Auditory Attention Localization in Conversations
In a noisy conversation environment such as a dinner party, people often...
research
∙
12/16/2022
Werewolf Among Us: A Multimodal Dataset for Modeling Persuasion Behaviors in Social Deduction Games
Persuasion modeling is a key building block for conversational agents. E...
research
∙
12/14/2022
PulseImpute: A Novel Benchmark Task for Pulsative Physiological Signal Imputation
The promise of Mobile Health (mHealth) is the ability to use wearable se...
research
∙
11/28/2022
Learning Dense Object Descriptors from Multiple Views for Low-shot Category Generalization
A hallmark of the deep learning era for computer vision is the successfu...
research
∙
10/10/2022
Transformer-based Localization from Embodied Dialog with Large-scale Pre-training
We address the challenging task of Localization via Embodied Dialog (LED...
research
∙
08/08/2022
In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation
In this paper, we present the first transformer-based model to address t...
research
∙
04/21/2022
Planes vs. Chairs: Category-guided 3D shape learning without any 3D cues
We present a novel 3D shape reconstruction method which learns to predic...
research
∙
03/21/2022
Generative Adversarial Network for Future Hand Segmentation from Egocentric Video
We introduce the novel problem of anticipating a time series of future h...
research
∙
11/01/2021
Kernel Deformed Exponential Families for Sparse Continuous Attention
Attention mechanisms take an expectation of a data representation with r...
research
∙
11/01/2021
Transformers for prompt-level EMA non-response prediction
Ecological Momentary Assessments (EMAs) are an important psychological d...
research
∙
10/26/2021
Efficient Learning and Decoding of the Continuous-Time Hidden Markov Model for Disease Progression Modeling
The Continuous-Time Hidden Markov Model (CT-HMM) is an attractive approa...
research
∙
05/20/2021
Egocentric Activity Recognition and Localization on a 3D Map
Given a video captured from a first person perspective and recorded in a...
research
∙
01/28/2021
Discriminative Appearance Modeling with Multi-track Pooling for Real-time Multi-object Tracking
In multi-object tracking, the tracker maintains in its memory the appear...
research
∙
01/18/2021
Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Bias
It is widely accepted that reasoning about object shape is important for...
research
∙
01/18/2021
Does Continual Learning = Catastrophic Forgetting?
Continual learning is known for suffering from catastrophic forgetting, ...
research
∙
11/26/2020
4D Human Body Capture from Egocentric Video via 3D Scene Grounding
To understand human daily social interaction from egocentric perspective...
research
∙
11/16/2020
Where Are You? Localization from Embodied Dialog
We present Where Are You? (WAY), a dataset of 6k dialogs in which two h...
research
∙
06/14/2020
3D Reconstruction of Novel Object Shapes from Single Images
The key challenge in single image 3D shape reconstruction is to ensure t...
research
∙
05/31/2020
In the Eye of the Beholder: Gaze and Actions in First Person Video
We address the task of jointly determining what a person is doing and wh...
research
∙
04/17/2020
Approximate Inverse Reinforcement Learning from Vision-based Imitation Learning
In this work, we present a method for obtaining an implicit objective fu...
research
∙
04/09/2020
Orthogonal Over-Parameterized Training
The inductive bias of a neural network is largely determined by the arch...
research
∙
03/05/2020
Detecting Attended Visual Targets in Video
We address the problem of detecting attention targets in video. Specific...
research
∙
03/02/2020
A Functional EM Algorithm for Panel Count Data with Missing Counts
Panel count data is recurrent events data where counts of events are obs...
research
∙
10/28/2019
Neural Similarity Learning
Inner product-based convolution has been the founding stone of convoluti...
research
∙
06/12/2019
Compressive Hyperspherical Energy Minimization
Recent work on minimum hyperspherical energy (MHE) has demonstrated its ...
research
∙
05/13/2019
Locally Weighted Regression Pseudo-Rehearsal for Online Learning of Vehicle Dynamics
We consider the problem of online adaptation of a neural network designe...
research
∙
04/22/2019
Tripping through time: Efficient Localization of Activities in Videos
Localizing moments in untrimmed videos via language queries is a new and...
research
∙
04/10/2019
Learning to Generate Synthetic Data via Compositing
We present a task-aware approach to synthetic data generation. Our frame...
research
∙
04/09/2019
Unsupervised 3D Pose Estimation with Geometric Self-Supervision
We present an unsupervised learning approach to recover 3D human pose fr...
research
∙
04/05/2019
Paying More Attention to Motion: Attention Distillation for Learning Video Representations
We address the challenging problem of learning motion representations us...
research
∙
02/02/2019
Detecting Gaze Towards Eyes in Natural Social Interactions and its Use in Child Assessment
Eye contact is a crucial element of non-verbal communication that signif...
research
∙
01/02/2019
Action2Vec: A Crossmodal Embedding Approach to Action Learning
We describe a novel cross-modal embedding space for actions, named Actio...
research
∙
12/17/2018
Taking a Deeper Look at the Inverse Compositional Algorithm
In this paper, we provide a modern synthesis of the classic inverse comp...
research
∙
12/05/2018
Vision-Based High Speed Driving with a Deep Dynamic Observer
In this paper we present a framework for combining deep learning-based r...
research
∙
09/22/2018
Learning to Localize and Align Fine-Grained Actions to Sparse Instructions
Automatic generation of textual video descriptions that are time-aligned...
research
∙
06/02/2018
AutoRally An open platform for aggressive autonomous driving
This article presents AutoRally, a 1:5 scale robotics testbed for autono...
research
∙
04/22/2018
Decoupled Networks
Inner product-based convolution has been a central component of convolut...
research
∙
04/12/2018
Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimation
Estimation of 3D motion in a dynamic scene from a temporal pair of image...
research
∙
10/21/2017
Towards Black-box Iterative Machine Teaching
In this paper, we make an important step towards the black-box machine t...
research
∙
10/02/2017
Fine-Grained Head Pose Estimation Without Keypoints
Estimating the head pose of a person is a crucial problem that has a lar...
research
∙
08/15/2017
Dockerface: an easy to install and use Faster R-CNN face detector in a Docker container
Face detection is a very important task and a necessary pre-processing s...
research
∙
08/02/2017
Noninvasive Corneal Image-Based Gaze Measurement System
Gaze tracking is an important technology as the system can give informat...
research
∙
05/30/2017
Iterative Machine Teaching
In this paper, we consider the problem of machine teaching, the inverse ...
research
∙
06/28/2016
Automatic Variational ABC
Approximate Bayesian Computation (ABC) is a framework for performing lik...
research
∙
11/13/2015
Unsupervised Learning of Edges
Data-driven approaches for edge detection have proven effective and achi...
research
∙
06/11/2014