research
∙
06/12/2023
TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AI
While several recent works have identified societal-scale and extinction...
share
research
∙
08/15/2022
Cooperative and uncooperative institution designs: Surprises and problems in open-source game theory
It is increasingly possible for real-world agents, such as software-base...
research
∙
07/15/2022
WordSig: QR streams enabling platform-independent self-identification that's impossible to deepfake
Deepfakes can degrade the fabric of society by limiting our ability to t...
research
∙
07/07/2022
For Learning in Symmetric Teams, Local Optima are Global Nash Equilibria
Although it has been known since the 1970s that a globally optimal strat...
research
∙
11/12/2021
Human irrationality: both bad and good for reward inference
Assuming humans are (approximately) rational enables robots to infer rew...
research
∙
10/13/2021
Detecting Modularity in Deep Neural Networks
A neural network is modular to the extent that parts of its computationa...
research
∙
03/04/2021
Clusterability in Neural Networks
The learned weights of a neural network have often been considered devoi...
research
∙
01/25/2021
Accumulating Risk Capital Through Investing in Cooperation
Recent work on promoting cooperation in multi-agent learning has resulte...
research
∙
12/29/2020
Multi-Principal Assistance Games: Definition and Collegial Mechanisms
We introduce the concept of a multi-principal assistance game (MPAG), an...
research
∙
12/03/2020
Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Design
A wide range of reinforcement learning (RL) problems - including robustn...
research
∙
11/01/2020
The MAGICAL Benchmark for Robust Imitation
Imitation Learning (IL) algorithms are typically evaluated in the same e...
research
∙
08/05/2020
Aligning AI With Shared Human Values
We show how to assess a language model's knowledge of basic concepts of ...
research
∙
05/30/2020
AI Research Considerations for Human Existential Safety (ARCHES)
Framed in positive terms, this report examines how technical AI research...
research
∙
03/10/2020
Neural Networks are Surprisingly Modular
The learned weights of a neural network are often considered devoid of s...
research
∙
10/31/2017
Servant of Many Masters: Shifting priorities in Pareto-optimal sequential decision-making
It is often argued that an agent making decisions on behalf of two or mo...
research
∙
01/05/2017
Toward negotiable reinforcement learning: shifting priorities in Pareto optimal sequential decision-making
Existing multi-objective reinforcement learning (MORL) algorithms do not...
research
∙
09/12/2016