research
∙
01/23/2023
Zorro: the masked multimodal transformer
Attention-based models are appealing for multimodal processing because i...
share
research
∙
11/07/2022
TAP-Vid: A Benchmark for Tracking Any Point in a Video
Generic motion understanding from video involves not only tracking objec...
research
∙
02/22/2022
Hierarchical Perceiver
General perception systems such as Perceivers can process arbitrary moda...
research
∙
11/23/2021
Towards Learning Universal Audio Representations
The ability to learn universal audio representations that can solve dive...
research
∙
04/26/2021
Multimodal Self-Supervised Learning of General Audio Representations
We present a multimodal framework to learn general audio representations...
research
∙
03/30/2021
Broaden Your Views for Self-Supervised Video Learning
Most successful self-supervised learning methods are trained to align th...
research
∙
02/09/2021
A Deep Learning Approach for Characterizing Major Galaxy Mergers
Fine-grained estimation of galaxy merger stages from observations is a k...
research
∙
11/18/2020
Game Plan: What AI can do for Football, and What Football can do for AI
The rapid progress in artificial intelligence (AI) and machine learning ...
research
∙
06/29/2020
Self-Supervised MultiModal Versatile Networks
Videos are a rich source of multi-modal supervision. In this work, we le...
research
∙
03/30/2020
Context Based Emotion Recognition using EMOTIC Dataset
In our everyday lives and social interactions we often try to perceive t...
research
∙
10/22/2019
Gaze360: Physically Unconstrained Gaze Estimation in the Wild
Understanding where people are looking is an informative social cue. In ...
research
∙
09/10/2018
Learning to Zoom: a Saliency-Based Sampling Layer for Neural Networks
We introduce a saliency-based distortion layer for convolutional neural ...
research
∙
07/27/2018
Synthetically Trained Icon Proposals for Parsing and Summarizing Infographics
Widely used in news, business, and educational media, infographics are h...
research
∙
04/04/2018
Jointly Discovering Visual Objects and Spoken Words from Raw Sensory Input
In this paper, we explore neural network models that learn to associate ...
research
∙
09/26/2017
Understanding Infographics through Textual and Visual Tag Prediction
We introduce the problem of visual hashtag discovery for infographics: e...
research
∙
12/09/2016