Improving And Analyzing Neural Speaker Embeddings for ASR
share
Neural speaker embeddings encode the speaker's speech characteristics through a DNN model and are prevalent for speaker verification tasks. However, few studies have investigated the usage of neural speaker embeddings for an ASR system. In this work, we present our efforts w.r.t integrating neural speaker embeddings into a conformer based hybrid HMM ASR system. For ASR, our improved embedding extraction pipeline in combination with the Weighted-Simple-Add integration method results in x-vector and c-vector reaching on par performance with i-vectors. We further compare and analyze different speaker embeddings. We present our acoustic model improvements obtained by switching from newbob learning rate schedule to one cycle learning schedule resulting in a 3 relative WER reduction on Switchboard, additionally reducing the overall training time by 17 additional 3 hybrid ASR system with speaker embeddings achieves 9.0 Hub5'01 with training on SWB 300h.
READ FULL TEXT