research
∙
07/10/2023
Generalization Error of First-Order Methods for Statistical Learning with Generic Oracles
In this paper, we provide a novel framework for the analysis of generali...
share
research
∙
02/28/2023
Stochastic Gradient Descent under Markovian Sampling Schemes
We study a variation of vanilla stochastic gradient descent where the op...
research
∙
02/17/2023
(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability
In this paper, we investigate the impact of stochasticity and large step...
research
∙
06/15/2022
Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays
The existing analysis of asynchronous stochastic gradient descent (SGD) ...
research
∙
06/10/2022
Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and Averaging
Decentralized optimization is increasingly popular in machine learning f...
research
∙
06/10/2021
A Continuized View on Nesterov Acceleration for Stochastic Gradient Descent and Randomized Gossip
We introduce the continuized Nesterov acceleration, a close variant of N...
research
∙
06/07/2021
Decentralized Optimization with Heterogeneous Delays: a Continuous-Time Approach
In decentralized optimization, nodes of a communication network privatel...
research
∙
02/04/2021
Concentration of Non-Isotropic Random Tensors with Applications to Learning and Empirical Risk Minimization
Dimension is an inherent bottleneck to some modern learning tasks, where...
research
∙
11/04/2020