research
∙
06/26/2023
Kosmos-2: Grounding Multimodal Large Language Models to the World
We introduce Kosmos-2, a Multimodal Large Language Model (MLLM), enablin...
share
research
∙
02/28/2023
Generic-to-Specific Distillation of Masked Autoencoders
Large vision Transformers (ViTs) driven by self-supervised pre-training ...
research
∙
10/19/2022
A Unified View of Masked Image Modeling
Masked image modeling has demonstrated great potential to eliminate the ...
research
∙
10/12/2022
Foundation Transformers
A big convergence of model architectures across language, vision, speech...
research
∙
08/22/2022
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
A big convergence of language, vision, and multimodal pretraining is eme...
research
∙
08/12/2022
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers
Masked image modeling (MIM) has demonstrated impressive results in self-...
research
∙
05/19/2022
Integral Migrating Pre-trained Transformer Encoder-decoders for Visual Object Detection
Modern object detectors have taken the advantages of pre-trained vision ...
research
∙
10/06/2021
Long-tailed Distribution Adaptation
Recognizing images with long-tailed distributions remains a challenging ...
research
∙
05/09/2021
Conformer: Local Features Coupling Global Representations for Visual Recognition
Within Convolutional Neural Network (CNN), the convolution operations ar...
research
∙
03/27/2021