research
∙
04/26/2022
SkillNet-NLG: General-Purpose Natural Language Generation with a Sparsely Activated Approach
We present SkillNet-NLG, a sparsely activated approach that handles many...
share
research
∙
02/24/2022
Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words
The standard BERT adopts subword-based tokenization, which may break a w...
research
∙
02/22/2021
Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model
Modern Automatic Speech Recognition (ASR) systems can achieve high perfo...
research
∙
02/12/2021
Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders
Recently, universal neural machine translation (NMT) with shared encoder...
research
∙
04/09/2020