Time-Domain Speech Extraction with Spatial Information and Multi Speaker Conditioning Mechanism

02/07/2021
by   Jisi Zhang, et al.
0

In this paper, we present a novel multi-channel speech extraction system to simultaneously extract multiple clean individual sources from a mixture in noisy and reverberant environments. The proposed method is built on an improved multi-channel time-domain speech separation network which employs speaker embeddings to identify and extract multiple targets without label permutation ambiguity. To efficiently inform the speaker information to the extraction model, we propose a new speaker conditioning mechanism by designing an additional speaker branch for receiving external speaker embeddings. Experiments on 2-channel WHAMR! data show that the proposed system improves by 9 baseline, and it increases the speech recognition accuracy by more than 16 relative over the same baseline.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset