research
∙
09/05/2023
First and zeroth-order implementations of the regularized Newton method with lazy approximated Hessians
In this work, we develop first-order (Hessian-free) and zero-order (deri...
share
research
∙
08/28/2023
Minimizing Quasi-Self-Concordant Functions by Gradient Regularization of Newton Method
We study the composite convex optimization problems with a Quasi-Self-Co...
research
∙
05/30/2023
Shuffle SGD is Always Better than SGD: Improved Analysis of SGD with Arbitrary Data Orders
Stochastic Gradient Descent (SGD) algorithms are widely used in optimizi...
research
∙
02/24/2023
Linearization Algorithms for Fully Composite Optimization
In this paper, we study first-order algorithms for solving fully composi...
research
∙
02/23/2023
Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods
We study the widely known Cubic-Newton method in the stochastic setting ...
research
∙
01/30/2023
Polynomial Preconditioning for Gradient Methods
We study first-order methods with preconditioning for solving structured...
research
∙
12/01/2022
Second-order optimization with lazy Hessians
We analyze Newton's method with lazy Hessian updates for solving general...
research
∙
08/11/2022
Super-Universal Regularized Newton Method
We analyze the performance of a variant of Newton method with quadratic ...
research
∙
02/21/2020