research
∙
08/22/2023
ViCo: Engaging Video Comment Generation with Human Preference Rewards
Engaging video comments play an important role in video social media, as...
share
research
∙
08/21/2023
Improving Diversity in Zero-Shot GAN Adaptation with Semantic Variations
Training deep generative models usually requires a large amount of data....
research
∙
07/15/2023
SINC: Self-Supervised In-Context Learning for Vision-Language Tasks
Large Pre-trained Transformers exhibit an intriguing capacity for in-con...
research
∙
06/09/2023
Pave the Way to Grasp Anything: Transferring Foundation Models for Universal Pick-Place Robots
Improving the generalization capabilities of general-purpose robotic age...
research
∙
05/30/2023
AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation
We propose a novel framework for learning high-level cognitive capabilit...
research
∙
11/22/2022
Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledge
Modern deep learning-based 3D pose estimation approaches require plenty ...
research
∙
09/14/2022
CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment
The pre-trained image-text models, like CLIP, have demonstrated the stro...
research
∙
08/10/2022
Exploring Anchor-based Detection for Ego4D Natural Language Query
In this paper we provide the technique report of Ego4D natural language ...
research
∙
08/08/2022
GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-training
Most of the currently existing vision and language pre-training (VLP) me...
research
∙
07/21/2022
TinyViT: Fast Pretraining Distillation for Small Vision Transformers
Vision transformer (ViT) recently has drawn great attention in computer ...
research
∙
04/14/2022
MiniViT: Compressing Vision Transformers with Weight Multiplexing
Vision Transformer (ViT) models have recently drawn much attention in co...
research
∙
11/29/2021
Searching the Search Space of Vision Transformer
Vision Transformer has shown great visual representation power in substa...
research
∙
11/19/2021
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
We study joint video and language (VL) pre-training to enable cross-moda...
research
∙
11/05/2021
Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers
We present a new perspective of achieving image synthesis by viewing thi...
research
∙
10/19/2021
A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
A creative image-and-text generative AI system mimics humans' extraordin...
research
∙
09/06/2021
Learning Fine-Grained Motion Embedding for Landscape Animation
In this paper we focus on landscape animation, which aims to generate ti...
research
∙
08/18/2021
Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment
An important scenario for image quality assessment (IQA) is to evaluate ...
research
∙
08/10/2021
Reference-based Defect Detection Network
The defect detection task can be regarded as a realistic scenario of obj...
research
∙
08/10/2021
Domain-Aware Universal Style Transfer
Style transfer aims to reproduce content images with the styles from ref...
research
∙
07/29/2021
Rethinking and Improving Relative Position Encoding for Vision Transformer
Relative position encoding (RPE) is important for transformer to capture...
research
∙
07/01/2021
AutoFormer: Searching Transformers for Visual Recognition
Recently, pure transformer-based models have shown great potentials for ...
research
∙
06/25/2021
Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-training
Vision-Language Pre-training (VLP) aims to learn multi-modal representat...
research
∙
04/29/2021
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search
Object tracking has achieved significant progress over the past few year...
research
∙
04/07/2021
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
We study joint learning of Convolutional Neural Network (CNN) and Transf...
research
∙
04/05/2021
3D Human Body Reshaping with Anthropometric Modeling
Reshaping accurate and realistic 3D human bodies from anthropometric par...
research
∙
04/03/2021
Aggregated Contextual Transformations for High-Resolution Image Inpainting
State-of-the-art image inpainting approaches can suffer from generating ...
research
∙
04/01/2021
One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinking
Despite remarkable progress achieved, most neural architecture search (N...
research
∙
03/31/2021
Learning Spatio-Temporal Transformer for Visual Tracking
In this paper, we present a new tracking architecture with an encoder-de...
research
∙
12/04/2020
Multi-Scale 2D Temporal Adjacent Networks for Moment Localization with Natural Language
We address the problem of retrieving a specific moment from an untrimmed...
research
∙
10/29/2020
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search
One-shot weight sharing methods have recently drawn great attention in n...
research
∙
08/22/2020
Revisiting Anchor Mechanisms for Temporal Action Localization
Most of the current action localization methods follow an anchor-based p...
research
∙
07/20/2020
Learning Joint Spatial-Temporal Transformations for Video Inpainting
High-quality video inpainting that completes missing regions in video fr...
research
∙
06/07/2020
Learning Texture Transformer Network for Image Super-Resolution
We study on image super-resolution (SR), which aims to recover realistic...
research
∙
06/04/2020
M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
This paper presents a Multitask Multilingual Multimodal Pre-trained mode...
research
∙
04/02/2020
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
We propose Pixel-BERT to align image pixels with text by deep multi-moda...
research
∙
12/08/2019
Learning Sparse 2D Temporal Adjacent Networks for Temporal Action Localization
In this report, we introduce the Winner method for HACS Temporal Action ...
research
∙
12/08/2019
Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language
We address the problem of retrieving a specific moment from an untrimmed...
research
∙
11/24/2019
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
A storyboard is a sequence of images to illustrate a story containing mu...
research
∙
11/09/2019
Learning Deep Bilinear Transformation for Fine-grained Image Representation
Bilinear feature transformation has shown the state-of-the-art performan...
research
∙
10/29/2019
Learning Rich Image Region Representation for Visual Question Answering
We propose to boost VQA by leveraging more powerful feature extractors b...
research
∙
10/03/2019
360-Indoor: Towards Learning Real-World Objects in 360° Indoor Equirectangular Images
While there are several widely used object detection datasets, current c...
research
∙
09/11/2019
WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection
We study on weakly-supervised object detection (WSOD) which plays a vita...
research
∙
07/29/2019
Learn to Scale: Generating Multipolar Normalized Density Map for Crowd Counting
Dense crowd counting aims to predict thousands of human instances from a...
research
∙
07/29/2019
Learn to Scale: Generating Multipolar Normalized Density Maps for Crowd Counting
Dense crowd counting aims to predict thousands of human instances from a...
research
∙
07/11/2019
Activitynet 2019 Task 3: Exploring Contexts for Dense Captioning Events in Videos
Contextual reasoning is essential to understand events in long untrimmed...
research
∙
06/03/2019
From Words to Sentences: A Progressive Learning Approach for Zero-resource Machine Translation with Visual Pivots
The neural machine translation model has suffered from the lack of large...
research
∙
04/16/2019
Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting
High-quality image inpainting requires filling missing regions in a dama...
research
∙
03/14/2019
Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognition
Learning subtle yet discriminative features (e.g., beak and eyes for a b...
research
∙
08/09/2018
Image Inspired Poetry Generation in XiaoIce
Vision is a common source of inspiration for poetry. The objects and the...
research
∙
04/23/2018