research
∙
08/11/2022
MILAN: Masked Image Pretraining on Language Assisted Representation
Self-attention based transformer models have been dominating many comput...
share
research
∙
07/07/2022
Meta-Learning the Difference: Preparing Large Language Models for Efficient Adaptation
Large pretrained language models (PLMs) are often domain- or task-adapte...
research
∙
12/31/2021
Multi-Dimensional Model Compression of Vision Transformer
Vision transformers (ViT) have recently attracted considerable attention...
research
∙
09/07/2021
Few-shot Learning via Dependency Maximization and Instance Discriminant Analysis
We study the few-shot learning (FSL) problem, where a model learns to re...
research
∙
05/28/2020
A Feature-map Discriminant Perspective for Pruning Deep Neural Networks
Network pruning has become the de facto tool to accelerate deep neural n...
research
∙
09/23/2019