research
∙
05/24/2023
Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts
The explosive growth of language models and their applications have led ...
share
research
∙
10/21/2022
Augmentation with Projection: Towards an Effective and Efficient Data Augmentation Paradigm for Distillation
Knowledge distillation is one of the primary methods of transferring kno...
research
∙
10/20/2022
Large Language Models Can Self-Improve
Large Language Models (LLMs) have achieved excellent performances in var...
research
∙
10/16/2021
EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks
Encoder-decoder transformer architectures have become popular recently w...
research
∙
04/06/2020
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
Natural Language Processing (NLP) has recently achieved great success by...
research
∙
01/26/2020