Stabilizing Off-Policy Reinforcement Learning with Conservative Policy Gradients

10/02/2019
by   Chen Tessler, et al.
0

In recent years, advances in deep learning have enabled the application of reinforcement learning algorithms in complex domains. However, they lack the theoretical guarantees which are present in the tabular setting and suffer from many stability and reproducibility problems <cit.>. In this work, we suggest a simple approach for improving stability and providing probabilistic performance guarantees in off-policy actor-critic deep reinforcement learning regimes. Experiments on continuous action spaces, in the MuJoCo control suite, show that our proposed method reduces the variance of the process and improves the overall performance.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset