research
∙
07/31/2023
Lookbehind Optimizer: k steps back, 1 step forward
The Lookahead optimizer improves the training stability of deep neural n...
share
research
∙
12/03/2022
CrossSplit: Mitigating Label Noise Memorization through Data Splitting
We approach the problem of improving robustness of deep learning algorit...
research
∙
07/06/2020
A Mathematical Theory of Attention
Attention is a powerful component of modern neural networks across a wid...
research
∙
10/19/2018
A Modern Take on the Bias-Variance Tradeoff in Neural Networks
We revisit the bias-variance tradeoff for neural networks in light of mo...
research
∙
01/12/2018
