research
∙
03/20/2023
A closer look at the training dynamics of knowledge distillation
In this paper we revisit the efficacy of knowledge distillation as a fun...
share
research
∙
03/14/2023
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation
This paper tackles the problem of semi-supervised video object segmentat...
research
∙
12/01/2021
Information Theoretic Representation Distillation
Despite the empirical success of knowledge distillation, there still lac...
research
∙
10/25/2021
Network compression and faster inference using spatial basis filters
We present an efficient alternative to the convolutional layer through u...
research
∙
08/16/2020
Cascaded channel pruning using hierarchical self-distillation
In this paper, we propose an approach for filter-level pruning with hier...
research
∙
01/09/2020