research
∙
07/21/2022
Language Model Cascades
Prompted models have demonstrated impressive few-shot learning abilities...
share
research
∙
07/11/2022
Exploring Length Generalization in Large Language Models
The ability to extrapolate from short problem instances to longer ones i...
research
∙
06/29/2022
Solving Quantitative Reasoning Problems with Language Models
Language models have achieved remarkable performance on a wide range of ...
research
∙
04/05/2022
PaLM: Scaling Language Modeling with Pathways
Large language models have been shown to achieve remarkable performance ...
research
∙
03/31/2022
Scaling Up Models and Data with and
Recent neural network-based language models have benefited greatly from ...
research
∙
11/30/2021
Show Your Work: Scratchpads for Intermediate Computation with Language Models
Large pre-trained language models perform remarkably well on tasks that ...
research
∙
03/23/2021
How to decay your learning rate
Complex learning rate schedules have become an integral part of deep lea...
research
∙
06/15/2020
On the training dynamics of deep networks with L_2 regularization
We study the role of L_2 regularization in deep learning, and uncover si...
research
∙
03/04/2020