research
∙
10/28/2020
Scaling Laws for Autoregressive Generative Modeling
We identify empirical scaling laws for the cross-entropy loss in four do...
share
research
∙
05/28/2020
Language Models are Few-Shot Learners
Recent work has demonstrated substantial gains on many NLP tasks and ben...
research
∙
05/08/2020
Measuring the Algorithmic Efficiency of Neural Networks
Three factors drive the advance of AI: algorithmic innovation, data, and...
research
∙
01/23/2020
Scaling Laws for Neural Language Models
We study empirical scaling laws for language model performance on the cr...
research
∙
09/18/2019
Fine-Tuning Language Models from Human Preferences
Reward learning enables the application of reinforcement learning (RL) t...
research
∙
09/22/2018
Unrestricted Adversarial Examples
We introduce a two-player contest for evaluating the safety and robustne...
research
∙
02/23/2018
Is Generator Conditioning Causally Related to GAN Performance?
Recent work (Pennington et al, 2017) suggests that controlling the entir...
research
∙
12/27/2017
Adversarial Patch
We present a method to create universal, robust, targeted adversarial im...
research
∙
06/12/2017