research
∙
08/20/2022
Adam Can Converge Without Any Modification on Update Rules
Ever since Reddi et al. 2018 pointed out the divergence issue of Adam, m...
share
research
∙
05/28/2022
Efficient-Adam: Communication-Efficient Distributed Adam with Complexity Analysis
Distributed adaptive stochastic gradient methods have been widely used f...
research
∙
01/14/2021
Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration
Adam is one of the most influential adaptive stochastic algorithms for t...
research
∙
04/29/2020
Quantized Adam with Error Feedback
In this paper, we present a distributed variant of adaptive stochastic g...
research
∙
05/10/2018