Non-Stochastic Control with Bandit Feedback

08/12/2020
by   Paula Gradu, et al.
0

We study the problem of controlling a linear dynamical system with adversarial perturbations where the only feedback available to the controller is the scalar loss, and the loss function itself is unknown. For this problem, with either a known or unknown system, we give an efficient sublinear regret algorithm. The main algorithmic difficulty is the dependence of the loss on past controls. To overcome this issue, we propose an efficient algorithm for the general setting of bandit convex optimization for loss functions with memory, which may be of independent interest.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset