research
∙
07/18/2023
Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in Chinchilla
Circuit analysis is a promising technique for understanding the internal...
share
research
∙
02/02/2023
Accelerating Large Language Model Decoding with Speculative Sampling
We present speculative sampling, an algorithm for accelerating transform...
research
∙
11/25/2022
Solving math word problems with process- and outcome-based feedback
Recent work has shown that asking language models to generate reasoning ...
research
∙
11/03/2022
Fine-Tuning Language Models via Epistemic Neural Networks
Large language models are now part of a powerful new paradigm in machine...
research
∙
09/28/2022
Improving alignment of dialogue agents via targeted human judgements
We present Sparrow, an information-seeking dialogue agent trained to be ...
research
∙
06/16/2022
Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Models
Large language models produce human-like text that drive a growing numbe...
research
∙
03/21/2022
Teaching language models to support answers with verified quotes
Recent large language models often answer factual questions correctly. B...
research
∙
03/14/2022
Uncertainty Estimation for Language Reward Models
Language models can learn a range of capabilities from unsupervised trai...
research
∙
02/07/2022
Red Teaming Language Models with Language Models
Language Models (LMs) often cannot be deployed because of their potentia...
research
∙
12/08/2021
Improving language models by retrieving from trillions of tokens
We enhance auto-regressive language models by conditioning on document c...
research
∙
12/08/2021
Ethical and social risks of harm from Language Models
This paper aims to help structure the risk landscape associated with lar...
research
∙
03/26/2021
Alignment of Language Agents
For artificial intelligence to be beneficial to humans the behaviour of ...
research
∙
09/18/2019
Fine-Tuning Language Models from Human Preferences
Reward learning enables the application of reinforcement learning (RL) t...
research
∙
11/15/2018
Reward learning from human preferences and demonstrations in Atari
To solve complex real-world problems with reinforcement learning, we can...
research
∙
05/02/2018
AI safety via debate
To make AI systems broadly useful for challenging real-world tasks, we n...
research
∙
01/24/2017
Deep Network Guided Proof Search
Deep learning techniques lie at the heart of several significant AI adva...
research
∙
06/14/2016
DeepMath - Deep Sequence Models for Premise Selection
We study the effectiveness of neural sequence models for premise selecti...
research
∙
03/14/2016