research
∙
06/16/2023
Meta-Personalizing Vision-Language Models to Find Named Instances in Video
Large-scale vision-language models (VLM) have shown impressive results f...
share
research
∙
06/15/2023
Language-Guided Music Recommendation for Video via Prompt Analogies
We propose a method to recommend music for an input video while allowing...
research
∙
04/17/2023
Conditional Generation of Audio from Video via Foley Analogies
The sound effects that designers add to videos are designed to convey a ...
research
∙
03/28/2023
Language-Guided Audio-Visual Source Separation via Trimodal Consistency
We propose a self-supervised approach for learning to perform audio sour...
research
∙
10/24/2022
Monocular Dynamic View Synthesis: A Reality Check
We study the recent progress on dynamic view synthesis (DVS) from monocu...
research
∙
06/14/2022
It's Time for Artistic Correspondence in Music and Video
We present an approach for recommending a music track for a given video,...
research
∙
05/30/2022
Neural Volumetric Object Selection
We introduce an approach for selecting objects in neural volumetric 3D r...
research
∙
04/11/2022
Focal Length and Object Pose Estimation via Render and Compare
We introduce FocalPose, a neural render-and-compare method for jointly e...
research
∙
11/12/2021
Contrastive Feature Loss for Image Prediction
Training supervised image synthesis models requires a critic to compare ...
research
∙
10/20/2021
Look at What I'm Doing: Self-Supervised Spatial Grounding of Narrations in Instructional Videos
We introduce the task of spatially localizing narrated interactions in v...
research
∙
10/07/2021
Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal Regions
We introduce the task of weakly supervised learning for detecting human ...
research
∙
05/13/2021
Editing Conditional Radiance Fields
A neural radiance field (NeRF) is a scene model supporting high-quality ...
research
∙
07/22/2020
Contact and Human Dynamics from Monocular Video
Existing deep models predict 2D and 3D kinematic poses from video that a...
research
∙
06/11/2020
Telling Left from Right: Learning Spatial Correspondence of Sight and Sound
Self-supervised audio-visual learning aims to capture useful representat...
research
∙
06/11/2020
Telling Left from Right: Learning Spatial Correspondence between Sight and Sound
Self-supervised audio-visual learning aims to capture useful representat...
research
∙
09/10/2019
FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images
Estimating 3D hand pose from single RGB images is a highly ambiguous pro...
research
∙
08/17/2019
Neural Re-Simulation for Generating Bounces in Single Images
We introduce a method to generate videos of dynamic virtual objects plau...
research
∙
07/30/2019
Temporal Localization of Moments in Video Collections with Natural Language
In this paper, we introduce the task of retrieving relevant video moment...
research
∙
04/15/2019
Bounce and Learn: Modeling Scene Dynamics with Real-World Bounces
We introduce an approach to model surface properties governing bounces i...
research
∙
02/28/2019
B-Script: Transcript-based B-roll Video Editing with Recommendations
In video production, inserting B-roll is a widely used technique to enri...
research
∙
09/05/2018
Localizing Moments in Video with Temporal Language
Localizing moments in a longer video via natural language queries is a n...
research
∙
04/13/2018
BodyNet: Volumetric Inference of 3D Human Body Shapes
Human shape estimation is an important task for video editing, animation...
research
∙
08/08/2017
Learning Visual Importance for Graphic Designs and Data Visualizations
Knowing where people look and click on visual designs can provide clues ...
research
∙
08/04/2017
Localizing Moments in Video with Natural Language
We consider retrieving a specific temporal segment, or moment, from a vi...
research
∙
04/10/2017
ActionVLAD: Learning spatio-temporal aggregation for action classification
In this work, we introduce a new video representation for action classif...
research
∙
02/21/2017
PixelNet: Representation of the pixels, by the pixels, and for the pixels
We explore design principles for general pixel-level prediction problems...
research
∙
09/21/2016
PixelNet: Towards a General Pixel-level Architecture
We explore architectures for general pixel-level prediction problems, fr...
research
∙
04/05/2016
Marr Revisited: 2D-3D Alignment via Surface Normal Prediction
We introduce an approach that leverages surface normal predictions, alon...
research
∙
12/08/2015
Deep Exemplar 2D-3D Detection by Adapting from Real to Rendered Views
This paper presents an end-to-end convolutional neural network (CNN) for...
research
∙
06/03/2015