research
∙
05/22/2023
Scaling Speech Technology to 1,000+ Languages
Expanding the language coverage of speech technology has the potential t...
share
research
∙
03/14/2023
OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNav
We present a single neural network architecture composed of task-agnosti...
research
∙
02/10/2023
AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations
Self-supervision has shown great potential for audio-visual speech recog...
research
∙
12/14/2022
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language
Current self-supervised learning algorithms are often modality-specific ...
research
∙
11/15/2022
Introducing Semantics into Speech Encoders
Recent studies find existing self-supervised speech encoders contain pri...
research
∙
07/13/2022
Masked Autoencoders that Listen
This paper studies a simple extension of image-based Masked Autoencoders...
research
∙
06/27/2022
Wav2Vec-Aug: Improved self-supervised training with limited data
Self-supervised learning (SSL) of speech representations has received mu...
research
∙
04/27/2022
Offline Visual Representation Learning for Embodied Navigation
How should we learn visual representations for embodied agents that must...
research
∙
04/25/2022
On-demand compute reduction with stochastic wav2vec 2.0
Squeeze and Efficient Wav2vec (SEW) is a recently proposed architecture ...
research
∙
04/11/2022
Unified Speech-Text Pre-training for Speech Translation and Recognition
We describe a method to jointly pre-train speech and text in an encoder-...
research
∙
04/06/2022
Simple and Effective Unsupervised Speech Synthesis
We introduce the first unsupervised speech synthesis system based on a s...
research
∙
04/05/2022
Towards End-to-end Unsupervised Speech Recognition
Unsupervised speech recognition has shown great potential to make Automa...
research
∙
03/01/2022
Measuring the Impact of Individual Domain Factors in Self-Supervised Pre-Training
Human speech data comprises a rich set of domain factors such as accent,...
research
∙
02/07/2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language
While the general idea of self-supervised learning is identical across m...
research
∙
11/17/2021
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
This paper presents XLS-R, a large-scale model for cross-lingual speech ...
research
∙
09/23/2021
Simple and Effective Zero-shot Cross-lingual Phoneme Recognition
Recent progress in self-training, self-supervised pretraining and unsupe...
research
∙
07/08/2021
Improved Language Identification Through Cross-Lingual Self-Supervised Learning
Language identification greatly impacts the success of downstream tasks ...
research
∙
05/24/2021
Unsupervised Speech Recognition
Despite rapid progress in the recent past, current speech recognition sy...
research
∙
04/14/2021
Large-Scale Self- and Semi-Supervised Learning for Speech Translation
In this paper, we improve speech translation (ST) through effectively le...
research
∙
04/02/2021
Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training
Self-supervised learning of speech representations has been a very activ...
research
∙
02/01/2021
Generative Spoken Language Modeling from Raw Audio
Generative spoken language modeling involves learning jointly the acoust...
research
∙
12/30/2020
Reservoir Transformer
We demonstrate that transformers obtain impressive performance even when...
research
∙
11/23/2020
The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling
We introduce a new unsupervised task, spoken language modeling: the lear...
research
∙
10/24/2020
A Comparison of Discrete Latent Variable Models for Speech Representation Learning
Neural latent variable models enable the discovery of interesting struct...
research
∙
10/22/2020
Self-training and Pre-training are Complementary for Speech Recognition
Self-training and unsupervised pre-training have emerged as effective ap...
research
∙
06/24/2020
Unsupervised Cross-lingual Representation Learning for Speech Recognition
This paper presents XLSR which learns cross-lingual speech representatio...
research
∙
06/20/2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
We show for the first time that learning powerful representations from s...
research
∙
11/10/2019
Effectiveness of self-supervised pre-training for speech recognition
We present pre-training approaches for self-supervised representation le...
research
∙
10/12/2019
vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
We propose vq-wav2vec to learn discrete representations of audio segment...
research
∙
07/15/2019
Facebook FAIR's WMT19 News Translation Task Submission
This paper describes Facebook FAIR's submission to the WMT19 shared news...
research
∙
04/11/2019
wav2vec: Unsupervised Pre-training for Speech Recognition
We explore unsupervised pre-training for speech recognition by learning ...
research
∙
04/01/2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
fairseq is an open-source sequence modeling toolkit that allows research...
research
∙
03/22/2019
Pre-trained Language Model Representations for Language Generation
Pre-trained language model representations have been successful in a wid...
research
∙
03/19/2019
Cloze-driven Pretraining of Self-attention Networks
We present a new approach for pretraining a bi-directional transformer m...
research
∙
01/29/2019
Pay Less Attention with Lightweight and Dynamic Convolutions
Self-attention is a useful mechanism to build generative models for lang...
research
∙
09/28/2018