research
∙
11/24/2021
One to Transfer All: A Universal Transfer Framework for Vision Foundation Model with Few Data
The foundation model is not the last chapter of the model production pip...
share
research
∙
03/31/2021
Fixing the Teacher-Student Knowledge Discrepancy in Distillation
Training a small student network with the guidance of a larger teacher n...
research
∙
02/21/2020
Residual Knowledge Distillation
Knowledge distillation (KD) is one of the most potent ways for model com...
research
∙
05/07/2019
P2SGrad: Refined Gradients for Optimizing Deep Face Models
Cosine-based softmax losses significantly improve the performance of dee...
research
∙
12/05/2018
Feature Matters: A Stage-by-Stage Approach for Knowledge Transfer
Convolutional Neural Networks (CNNs) become deeper and deeper in recent ...
research
∙
06/17/2018