research
∙
01/28/2022
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
Pretrained general-purpose language models can achieve state-of-the-art ...
share
research
∙
11/20/2020
Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Images
We present a hierarchical VAE that, for the first time, outperforms the ...
research
∙
05/28/2020
Language Models are Few-Shot Learners
Recent work has demonstrated substantial gains on many NLP tasks and ben...
research
∙
01/23/2020
Scaling Laws for Neural Language Models
We study empirical scaling laws for language model performance on the cr...
research
∙
04/23/2019
