research
∙
12/01/2021
Leveraging Sequence Embedding and Convolutional Neural Network for Protein Function Prediction
The capability of accurate prediction of protein functions and propertie...
share
research
∙
05/07/2021
SpeechNet: A Universal Modularized Model for Speech Processing Tasks
There is a wide variety of speech processing tasks ranging from extracti...
research
∙
05/03/2021
SUPERB: Speech processing Universal PERformance Benchmark
Self-supervised learning (SSL) has proven vital for advancing research i...
research
∙
06/09/2020
Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer
In this paper, we seek to reduce the computation complexity of transform...
research
∙
05/18/2020
Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation
For self-supervised speech processing, it is crucial to use pretrained m...
research
∙
01/25/2020
Further Boosting BERT-based Models by Duplicating Existing Layers: Some Intriguing Phenomena inside BERT
Although Bidirectional Encoder Representations from Transformers (BERT) ...
research
∙
10/25/2019