research
∙
08/29/2023
Policy composition in reinforcement learning via multi-objective policy optimization
We enable reinforcement learning agents to learn successful behavior pol...
share
research
∙
03/29/2022
Training Compute-Optimal Large Language Models
We investigate the optimal model size and number of tokens for training ...
research
∙
02/02/2022
Unified Scaling Laws for Routed Language Models
The performance of a language model has been shown to be effectively mod...
research
∙
12/08/2021
Improving language models by retrieving from trillions of tokens
We enhance auto-regressive language models by conditioning on document c...
research
∙
06/12/2020
AlgebraNets
Neural networks have historically been built layerwise from the set of f...
research
∙
09/24/2019
Recurrent Independent Mechanisms
Learning modular structures which reflect the dynamics of the environmen...
research
∙
09/03/2019
Data-Driven Approach to Encoding and Decoding 3-D Crystal Structures
Generative models have achieved impressive results in many domains inclu...
research
∙
07/31/2019
InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization
This paper studies learning the representations of whole graphs in both ...
research
∙
06/18/2019