research
∙
09/20/2023
Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff
Blockwise self-attentional encoder models have recently emerged as one p...
share
research
∙
08/19/2023
Bayes Risk Transducer: Transducer with Controllable Alignment Prediction
Automatic speech recognition (ASR) based on transducers is widely used. ...
research
∙
07/20/2023
Integrating Pretrained ASR and LM to Perform Sequence Generation for Spoken Language Understanding
There has been an increased interest in the integration of pretrained sp...
research
∙
05/29/2023
Exploration of Efficient End-to-End ASR using Discretized Input from Self-Supervised Learning
Self-supervised learning (SSL) of speech has shown impressive results in...
research
∙
05/18/2023
Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization
We investigate the emergent abilities of the recently proposed web-scale...
research
∙
05/18/2023
A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Tasks
Conformer, a convolution-augmented Transformer variant, has become the d...
research
∙
05/02/2023
A Study on the Integration of Pipeline and E2E SLU systems for Spoken Semantic Parsing toward STOP Quality Challenge
Recently there have been efforts to introduce new benchmark tasks for sp...
research
∙
05/02/2023
The Pipeline System of ASR and NLU with MLM-based Data Augmentation toward STOP Low-resource Challenge
This paper describes our system for the low-resource domain adaptation t...
research
∙
05/01/2023
Joint Modelling of Spoken Language Understanding Tasks with Integrated Dialog History
Most human interactions occur in the form of spoken conversations where ...
research
∙
04/10/2023
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit
ESPnet-ST-v2 is a revamp of the open-source ESPnet-ST toolkit necessitat...
research
∙
02/24/2023
Improving Massively Multilingual ASR With Auxiliary CTC Objectives
Multilingual Automatic Speech Recognition (ASR) models have extended the...
research
∙
12/21/2022
4D ASR: Joint modeling of CTC, Attention, Transducer, and Mask-Predict decoders
The network architecture of end-to-end (E2E) automatic speech recognitio...
research
∙
11/11/2022
Align, Write, Re-order: Explainable End-to-End Speech Translation via Operation Sequence Generation
The black-box nature of end-to-end speech translation (E2E ST) systems m...
research
∙
11/02/2022
Towards Zero-Shot Code-Switched Speech Recognition
In this work, we seek to build effective code-switched (CS) automatic sp...
research
∙
11/01/2022
Avoid Overthinking in Self-Supervised Models for Speech Recognition
Self-supervised learning (SSL) models reshaped our approach to speech, l...
research
∙
10/29/2022
BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model
This paper presents BERT-CTC, a novel formulation of end-to-end speech r...
research
∙
10/27/2022
Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models
End-to-end spoken language understanding (SLU) systems are gaining popul...
research
∙
10/14/2022
Bayes risk CTC: Controllable CTC alignment in Sequence-to-Sequence tasks
Sequence-to-Sequence (seq2seq) tasks transcribe the input sequence to a ...
research
∙
10/11/2022
CTC Alignments Improve Autoregressive Translation
Connectionist Temporal Classification (CTC) is a widely used approach fo...
research
∙
07/19/2022
ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding
This paper presents recent progress on integrating speech separation and...
research
∙
07/14/2022
Two-Pass Low Latency End-to-End Spoken Language Understanding
End-to-end (E2E) models are becoming increasingly popular for spoken lan...
research
∙
04/05/2022
Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation
Self-Supervised Learning (SSL) models have been successfully applied in ...
research
∙
11/29/2021
Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorization
Conversational bilingual speech encompasses three types of utterances: t...
research
∙
11/29/2021
ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet
As Automatic Speech Processing (ASR) systems are getting better, there i...
research
∙
09/27/2021
Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates
The multi-decoder (MD) end-to-end speech translation model has demonstra...
research
∙
07/24/2021
Differentiable Allophone Graphs for Language-Universal Speech Recognition
Building language-universal speech recognition systems entails producing...
research
∙
07/01/2021
ESPnet-ST IWSLT 2021 Offline Speech Translation System
This paper describes the ESPnet-ST group's IWSLT 2021 submission in the ...
research
∙
05/02/2021