research
∙
07/27/2023
Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback
Reinforcement learning from human feedback (RLHF) is a technique for tra...
share
research
∙
06/15/2023
Explore, Establish, Exploit: Red Teaming Language Models from Scratch
Deploying Large language models (LLMs) can pose hazards from harmful out...
research
∙
08/22/2022
Get It in Writing: Formal Contracts Mitigate Social Dilemmas in Multi-Agent RL
Multi-agent reinforcement learning (MARL) is a powerful tool for trainin...
research
∙
07/27/2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks
The last decade of machine learning has seen drastic increases in scale ...
research
∙
02/26/2019
Conservative Agency via Attainable Utility Preservation
Reward functions are often misspecified. An agent optimizing an incorrec...
research
∙
11/01/2018
On the Geometry of Adversarial Examples
Adversarial examples are a pervasive phenomenon of machine learning mode...
research
∙
07/20/2017
