A fundamental challenge in Deep Learning is to find optimal step sizes f...
Optimization in Deep Learning is mainly guided by vague intuitions and s...
A fundamental challenge in deep learning is that the optimal step sizes ...
We present a novel optimizer for deep neural networks that combines the ...