research
∙
12/07/2020
A Deeper Look at the Hessian Eigenspectrum of Deep Neural Networks and its Applications to Regularization
Loss landscape analysis is extremely useful for a deeper understanding o...
share
research
∙
02/01/2019
DANTE: Deep AlterNations for Training nEural networks
We present DANTE, a novel method for training neural networks using the ...
research
∙
07/21/2018
On the Analysis of Trajectories of Gradient Descent in the Optimization of Deep Neural Networks
Theoretical analysis of the error landscape of deep neural networks has ...
research
∙
12/20/2017
ADINE: An Adaptive Momentum Method for Stochastic Gradient Descent
Two major momentum-based techniques that have achieved tremendous succes...
research
∙
06/07/2017
