Actor Loss of Soft Actor Critic Explained

12/31/2021
by   Thibault Lahire, et al.
0

This technical report is devoted to explaining how the actor loss of soft actor critic is obtained, as well as the associated gradient estimate. It gives the necessary mathematical background to derive all the presented equations, from the theoretical actor loss to the one implemented in practice. This necessitates a comparison of the reparameterization trick used in soft actor critic with the nabla log trick, which leads to open questions regarding the most efficient method to use.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset