research
∙
06/15/2020
Spherical Motion Dynamics of Deep Neural Networks with Batch Normalization and Weight Decay
We comprehensively reveal the learning dynamics of deep neural networks ...
share
research
∙
04/28/2020
Angle-based Search Space Shrinking for Neural Architecture Search
In this work, we present a simple and general search space shrinking met...
research
∙
01/19/2020
Towards Stabilizing Batch Statistics in Backward Propagation of Batch Normalization
Batch Normalization (BN) is one of the most widely used techniques in De...
research
∙
11/18/2019
Towards Making Deep Transfer Learning Never Hurt
Transfer learning have been frequently used to improve deep neural netwo...
research
∙
06/01/2018