research
∙
09/08/2023
Leveraging Pretrained Image-text Models for Improving Audio-Visual Learning
Visually grounded speech systems learn from paired images and their spok...
share
research
∙
03/07/2023
Stabilized training of joint energy-based models and their practical applications
The recently proposed Joint Energy-based Model (JEM) interprets discrimi...
research
∙
08/10/2022
Non-Contrastive Self-supervised Learning for Utterance-Level Information Extraction from Speech
In recent studies, self-supervised pre-trained models tend to outperform...
research
∙
08/10/2022
Non-Contrastive Self-Supervised Learning of Utterance-Level Speech Representations
Considering the abundance of unlabeled speech data and the high labeling...
research
∙
04/08/2022
Defense against Adversarial Attacks on Hybrid Speech Recognition using Joint Adversarial Fine-tuning with Denoiser
Adversarial attacks are a threat to automatic speech recognition (ASR) s...
research
∙
04/08/2022
AdvEst: Adversarial Perturbation Estimation to Classify and Detect Adversarial Attacks against Speaker Identification
Adversarial attacks pose a severe security threat to the state-of-the-ar...
research
∙
03/30/2022
Joint domain adaptation and speech bandwidth extension using time-domain GANs for speaker verification
Speech systems developed for a particular choice of acoustic domain and ...
research
∙
01/26/2022
Discovering Phonetic Inventories with Crosslingual Automatic Speech Recognition
The high cost of data acquisition makes Automatic Speech Recognition (AS...
research
∙
01/07/2022
Code-Switching Text Augmentation for Multilingual Speech Processing
The pervasiveness of intra-utterance Code-switching (CS) in spoken conte...
research
∙
10/05/2021
Unsupervised Speech Segmentation and Variable Rate Representation Learning using Segmental Contrastive Predictive Coding
Typically, unsupervised segmentation of speech into the phone and word-l...
research
∙
09/28/2021
The JHU submission to VoxSRC-21: Track 3
This technical report describes Johns Hopkins University speaker recogni...
research
∙
09/13/2021
Beyond Isolated Utterances: Conversational Emotion Recognition
Speech emotion recognition is the task of recognizing the speaker's emot...
research
∙
09/13/2021
Joint prediction of truecasing and punctuation for conversational speech in low-resource scenarios
Capitalization and punctuation are important cues for comprehending writ...
research
∙
07/05/2021
What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognition
Dialog acts can be interpreted as the atomic units of a conversation, mo...
research
∙
06/17/2021
WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesis
This paper introduces WaveGrad 2, a non-autoregressive generative model ...
research
∙
06/03/2021
Segmental Contrastive Predictive Coding for Unsupervised Word Segmentation
Automatic detection of phoneme or word-like units is one of the core obj...
research
∙
03/31/2021
Adversarial Attacks and Defenses for Speech Recognition Systems
The ubiquitous presence of machine learning systems in our lives necessi...
research
∙
01/22/2021
Adversarial Attacks and Defenses for Speaker Identification Systems
Research in automatic speaker recognition (SR) has been undertaken for s...
research
∙
11/02/2020
Focus on the present: a regularization method for the ASR source-target attention layer
This paper introduces a novel method to diagnose the source-target atten...
research
∙
10/27/2020
CopyPaste: An Augmentation Method for Speech Emotion Recognition
Data augmentation is a widely used strategy for training robust machine ...
research
∙
10/22/2020
How Phonotactics Affect Multilingual and Zero-shot ASR Performance
The idea of combining multiple languages' recordings to train a single a...
research
∙
10/22/2020
Perceptual Loss based Speech Denoising with an ensemble of Audio Pattern Recognition and Self-Supervised Models
Deep learning based speech denoising still suffers from the challenge of...
research
∙
10/21/2020
Learning Speaker Embedding from Text-to-Speech
Zero-shot multi-speaker Text-to-Speech (TTS) generates target speaker vo...
research
∙
07/26/2020
Self-Expressing Autoencoders for Unsupervised Spoken Term Discovery
Unsupervised spoken term discovery consists of two tasks: finding the ac...
research
∙
05/17/2020
Single Channel Far Field Feature Enhancement For Speaker Verification In The Wild
We investigated an enhancement and a domain adaptation approach to make ...
research
∙
05/16/2020
That Sounds Familiar: an Analysis of Phonetic Representations Transfer Across Languages
Only a handful of the world's languages are abundant with the resources ...
research
∙
04/13/2020
Punctuation Prediction in Spontaneous Conversations: Can We Mitigate ASR Errors with Retrofitted Word Embeddings?
Automatic Speech Recognition (ASR) systems introduce word errors, which ...
research
∙
02/12/2020
x-vectors meet emotions: A study on dependencies between emotion and speaker recognition
In this work, we explore the dependencies between speaker recognition an...
research
∙
02/01/2020
Analysis of Deep Feature Loss based Enhancement for Speaker Verification
Data augmentation is conventionally used to inject robustness in Speaker...
research
∙
12/02/2019
Speaker detection in the wild: Lessons learned from JSALT 2019
This paper presents the problems and solutions addressed at the JSALT wo...
research
∙
11/10/2019
Non-Autoregressive Transformer Automatic Speech Recognition
Recently very deep transformers start showing outperformed performance t...
research
∙
10/25/2019
Unsupervised Feature Enhancement for speaker verification
The task of making speaker verification systems robust to adverse scenar...
research
∙
10/25/2019
Low-Resource Domain Adaptation for Speaker Recognition Using Cycle-GANs
Current speaker recognition technology provides great performance with t...
research
∙
10/25/2019
Feature Enhancement with Deep Feature Losses for Speaker Verification
Speaker Verification still suffers from the challenge of generalization ...
research
∙
10/23/2019
Hierarchical Transformers for Long Document Classification
BERT, which stands for Bidirectional Encoder Representations from Transf...
research
∙
06/09/2019
rVAD: An Unsupervised Segment-Based Robust Voice Activity Detection Method
This paper presents an unsupervised segment-based method for robust voic...
research
∙
04/26/2019
Speaker Sincerity Detection based on Covariance Feature Vectors and Ensemble Methods
Automatic measuring of speaker sincerity degree is a novel research prob...
research
∙
04/07/2019
MCE 2018: The 1st Multi-target Speaker Detection and Identification Challenge Evaluation
The Multi-target Challenge aims to assess how well current speech techno...
research
∙
04/01/2019
ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworks
We present JHU's system submission to the ASVspoof 2019 Challenge: Anti-...
research
∙
12/10/2018
Low Resource Multi-modal Data Augmentation for End-to-end ASR
We explore training attention-based encoder-decoder ASR for low-resource...
research
∙
11/06/2018
Language model integration based on memory control for sequence to sequence speech recognition
In this paper, we explore several new schemes to train a seq2seq model t...
research
∙
10/31/2018
Attentive Filtering Networks for Audio Replay Attack Detection
An attacker may use a variety of techniques to fool an automatic speaker...
research
∙
07/17/2018
MCE 2018: The 1st Multi-target Speaker Detection and Identification Challenge Evaluation (MCE) Plan, Dataset and Baseline System
The Multitarget Challenge aims to assess how well current speech technol...
research
∙
07/17/2018
Low-Resource Contextual Topic Identification on Speech
In topic identification (topic ID) on real-world unstructured audio, an ...
research
∙
07/02/2018
Punctuation Prediction Model for Conversational Speech
An ASR system usually does not predict any punctuation or capitalization...
research
∙
02/23/2018
The JHU Speech LOREHLT 2017 System: Cross-Language Transfer for Situation-Frame Detection
We describe the system our team used during NIST's LoReHLT (Low Resource...
research
∙
02/05/2017
An Empirical Evaluation of Zero Resource Acoustic Unit Discovery
Acoustic unit discovery (AUD) is a process of automatically identifying ...
research
∙
09/23/2015
Automatic Dialect Detection in Arabic Broadcast Speech
We investigate different approaches for dialect identification in Arabic...
research
∙
04/03/2015