research
∙
09/07/2023
REALM: Robust Entropy Adaptive Loss Minimization for Improved Single-Sample Test-Time Adaptation
Fully-test-time adaptation (F-TTA) can mitigate performance loss due to ...
share
research
∙
08/18/2023
Spatial LibriSpeech: An Augmented Dataset for Spatial Audio Learning
We present Spatial LibriSpeech, a spatial audio dataset with over 650 ho...
research
∙
11/12/2022
Rewards Encoding Environment Dynamics Improves Preference-based Reinforcement Learning
Preference-based reinforcement learning (RL) algorithms help avoid the p...
research
∙
11/10/2022
Contrastive Self-Supervised Learning for Skeleton Representations
Human skeleton point clouds are commonly used to automatically classify ...
research
∙
10/26/2022
Naturalistic Head Motion Generation from Speech
Synthesizing natural head motion to accompany speech for an embodied con...
research
∙
03/18/2022
Towards a Perceptual Model for Estimating the Quality of Visual Speech
Generating realistic lip motions to simulate speech production is key fo...
research
∙
02/12/2021
Multimodal Punctuation Prediction with Contextual Dropout
Automatic speech recognition (ASR) is widely used in consumer electronic...
research
∙
12/09/2020
MorphGAN: One-Shot Face Synthesis GAN for Detecting Recognition Bias
To detect bias in face recognition networks, it can be useful to probe a...
research
∙
05/27/2020
Modality Dropout for Improved Performance-driven Talking Faces
We describe our novel deep learning approach for driving animated faces ...
research
∙
04/25/2020
Self-supervised Learning of Visual Speech Features with Audiovisual Speech Enhancement
We present an introspection of an audiovisual speech enhancement model. ...
research
∙
05/15/2019
Speaker-Independent Speech-Driven Visual Speech Synthesis using Domain-Adapted Acoustic Models
Speech-driven visual speech synthesis involves mapping features extracte...
research
∙
04/02/2019
Mirroring to Build Trust in Digital Assistants
We describe experiments towards building a conversational digital assist...
research
∙
12/10/2018
Learning Sharing Behaviors with Arbitrary Numbers of Agents
We propose a method for modeling and learning turn-taking behaviors for ...
research
∙
10/03/2017
Which phoneme-to-viseme maps best improve visual-only computer lip-reading?
A critical assumption of all current visual speech recognition systems i...
research
∙
10/03/2017
Some observations on computer lip-reading: moving from the dream to the reality
In the quest for greater computer lip-reading performance there are a nu...
research
∙
10/03/2017