research
∙
09/18/2023
Electrolaryngeal Speech Intelligibility Enhancement Through Robust Linguistic Encoders
We propose a novel framework for electrolaryngeal speech intelligibility...
share
research
∙
09/14/2023
AAS-VC: On the Generalization Ability of Automatic Alignment Search based Non-autoregressive Sequence-to-sequence Voice Conversion
Non-autoregressive (non-AR) sequence-to-seqeunce (seq2seq) models for vo...
research
∙
09/05/2023
Evaluating Methods for Ground-Truth-Free Foreign Accent Conversion
Foreign accent conversion (FAC) is a special application of voice conver...
research
∙
06/26/2023
The Singing Voice Conversion Challenge 2023
We present the latest iteration of the voice conversion challenge (VCC) ...
research
∙
01/25/2023
A Holistic Cascade System, benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation
Expressive speech-to-speech translation (S2ST) aims to transfer prosodic...
research
∙
11/02/2022
Intermediate Fine-Tuning Using Imperfect Synthetic Speech for Improving Electrolaryngeal Speech Recognition
Research on automatic speech recognition (ASR) systems for electrolaryng...
research
∙
07/10/2022
A Comparative Study of Self-supervised Speech Representation Based Voice Conversion
We present a large-scale comparative study of self-supervised speech rep...
research
∙
07/08/2022
End-to-End Binaural Speech Synthesis
In this work, we present an end-to-end binaural speech synthesis system ...
research
∙
03/29/2022
Investigating Self-supervised Pretraining Frameworks for Pathological Speech Recognition
We investigate the performance of self-supervised pretraining frameworks...
research
∙
03/21/2022
The VoiceMOS Challenge 2022
We present the first edition of the VoiceMOS Challenge, a scientific eve...
research
∙
03/14/2022
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities
Transfer learning has proven to be crucial in advancing the state of spe...
research
∙
11/13/2021
Direct Noisy Speech Modeling for Noisy-to-Noisy Voice Conversion
Beyond the conventional voice conversion (VC) where the speaker informat...
research
∙
10/18/2021
LDNet: Unified Listener Dependent Modeling in MOS Prediction for Synthetic Speech
An effective approach to automatically predict the subjective rating for...
research
∙
10/15/2021
Towards Identity Preserving Normal to Dysarthric Voice Conversion
We present a voice conversion framework that converts normal speech into...
research
∙
10/12/2021
S3PRL-VC: Open-source Voice Conversion Framework with Self-supervised Speech Representations
This paper introduces S3PRL-VC, an open-source voice conversion (VC) fra...
research
∙
09/22/2021
Noisy-to-Noisy Voice Conversion Framework with Denoising Model
In a conventional voice conversion (VC) framework, a VC model is often t...
research
∙
09/08/2021
Time Alignment using Lip Images for Frame-based Electrolaryngeal Voice Conversion
Voice conversion (VC) is an effective approach to electrolaryngeal (EL) ...
research
∙
07/20/2021
On Prosody Modeling for ASR+TTS based Voice Conversion
In voice conversion (VC), an approach showing promising results in the l...
research
∙
06/02/2021
A Preliminary Study of a Two-Stage Paradigm for Preserving Speaker Identity in Dysarthric Voice Conversion
We propose a new paradigm for maintaining speaker identity in dysarthric...
research
∙
04/14/2021
Non-autoregressive sequence-to-sequence voice conversion
This paper proposes a novel voice conversion (VC) method based on non-au...
research
∙
04/07/2021
The AS-NU System for the M2VoC Challenge
This paper describes the AS-NU systems for two tracks in MultiSpeaker Mu...
research
∙
03/04/2021
crank: An Open-Source Software for Nonparallel Voice Conversion Based on Vector-Quantized Variational Autoencoder
In this paper, we present an open-source software for developing a nonpa...
research
∙
02/07/2021
EMA2S: An End-to-End Multimodal Articulatory-to-Speech System
Synthesized speech from articulatory movements can have real-world use f...
research
∙
01/30/2021
Speech Recognition by Simply Fine-tuning BERT
We propose a simple method for automatic speech recognition (ASR) by fin...
research
∙
12/23/2020
The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans
This paper describes the recent development of ESPnet (https://github.co...
research
∙
10/23/2020
Any-to-One Sequence-to-Sequence Voice Conversion using Self-Supervised Discrete Speech Representations
We present a novel approach to any-to-one (A2O) voice conversion (VC) in...
research
∙
10/09/2020
The NU Voice Conversion System for the Voice Conversion Challenge 2020: On the Effectiveness of Sequence-to-sequence Models and Autoregressive Neural Vocoders
In this paper, we present the voice conversion (VC) systems developed at...
research
∙
10/06/2020
The Sequence-to-Sequence Baseline for the Voice Conversion Challenge 2020: Cascading ASR and TTS
This paper presents the sequence-to-sequence (seq2seq) baseline system f...
research
∙
09/08/2020
Predictions of Subjective Ratings and Spoofing Assessments of Voice Conversion Challenge 2020 Submissions
The Voice Conversion Challenge 2020 is the third edition under its flags...
research
∙
08/28/2020
Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversion
The voice conversion challenge is a bi-annual scientific event held to c...
research
∙
08/07/2020
Pretraining Techniques for Sequence-to-Sequence Voice Conversion
Sequence-to-sequence (seq2seq) voice conversion (VC) models are attracti...
research
∙
05/18/2020
Many-to-Many Voice Transformer Network
This paper proposes a voice conversion (VC) method based on a sequence-t...
research
∙
01/22/2020
Unsupervised Representation Disentanglement using Cross Domain Features and Adversarial Learning in Variational Autoencoder based Voice Conversion
An effective approach for voice conversion (VC) is to disentangle lingui...
research
∙
12/14/2019
Voice Transformer Network: Sequence-to-Sequence Voice Conversion Using Transformer with Text-to-Speech Pretraining
We introduce a novel sequence-to-sequence (seq2seq) voice conversion (VC...
research
∙
11/05/2019
The ASVspoof 2019 database
Automatic speaker verification (ASV) is one of the most natural and conv...
research
∙
05/02/2019
Investigation of F0 conditioning and Fully Convolutional Networks in Variational Autoencoder based Voice Conversion
In this work, we investigate the effectiveness of two techniques for imp...
research
∙
04/17/2019
MOSNet: Deep Learning based Objective Assessment for Voice Conversion
Existing objective evaluation metrics for voice conversion (VC) are not ...
research
∙
11/27/2018
Refined WaveNet Vocoder for Variational Autoencoder Based Voice Conversion
This paper presents a refinement framework of WaveNet vocoders for varia...
research
∙
08/29/2018