research
∙
07/27/2023
The Marginal Value of Momentum for Small Learning Rate SGD
Momentum is known to accelerate the convergence of gradient descent in s...
share
research
∙
10/26/2021
Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias
The generalization mystery of overparametrized deep nets has motivated e...
research
∙
07/14/2021
Going Beyond Linear RL: Sample Efficient Neural Function Approximation
Deep Reinforcement Learning (RL) powered by neural net approximation of ...
research
∙
07/09/2021
Optimal Gradient-based Algorithms for Non-concave Bandit Optimization
Bandit problems with linear or concave reward have been extensively stud...
research
∙
09/26/2019