research
∙
04/28/2023
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model
How to efficiently transform large language models (LLMs) into instructi...
share
research
∙
03/27/2023
Revisiting Multimodal Representation in Contrastive Learning: From Patch and Token Embeddings to Finite Discrete Tokens
Contrastive learning-based vision-language pre-training approaches, such...
research
∙
01/30/2023
Mono-STAR: Mono-camera Scene-level Tracking and Reconstruction
We present Mono-STAR, the first real-time 3D reconstruction system that ...
research
∙
08/06/2022
Frozen CLIP Models are Efficient Video Learners
Video recognition has been dominated by the end-to-end learning paradigm...
research
∙
07/20/2022
Hierarchically Self-Supervised Transformer for Human Skeleton Representation Learning
Despite the success of fully-supervised human skeleton sequence modeling...
research
∙
12/11/2021
COMPOSER: Compositional Learning of Group Activity in Videos
Group Activity Recognition (GAR) detects the activity performed by a gro...
research
∙
11/29/2021
A Simple Long-Tailed Recognition Baseline via Vision-Language Model
The visual world naturally exhibits a long-tailed distribution of open c...
research
∙
10/13/2021
Audio-Visual Scene-Aware Dialog and Reasoning using Audio-Visual Transformers with Joint Student-Teacher Learning
In previous work, we have proposed the Audio-Visual Scene-Aware Dialog (...
research
∙
09/24/2021
Dense Contrastive Visual-Linguistic Pretraining
Inspired by the success of BERT, several multimodal representation learn...
research
∙
06/04/2021
Scalable Transformers for Neural Machine Translation
Transformer has been widely adopted in Neural Machine Translation (NMT) ...
research
∙
09/23/2020
Multi-Pass Transformer for Machine Translation
In contrast with previous approaches where information flows only toward...
research
∙
07/26/2020
Contrastive Visual-Linguistic Pretraining
Several multi-modality representation learning approaches such as LXMERT...
research
∙
07/08/2020
Spatio-Temporal Scene Graphs for Video Dialog
The Audio-Visual Scene-aware Dialog (AVSD) task requires an agent to ind...
research
∙
06/03/2020
Fairness-Aware Explainable Recommendation over Knowledge Graphs
There has been growing attention on fairness considerations recently, es...
research
∙
01/29/2020
ABSent: Cross-Lingual Sentence Representation Mapping with Bidirectional GANs
A number of cross-lingual transfer learning approaches based on neural n...
research
∙
07/16/2019
2nd Place Solution to the GQA Challenge 2019
We present a simple method that achieves unexpectedly superior performan...
research
∙
08/20/2018
CU-Net: Coupled U-Nets
We design a new connectivity pattern for the U-Net architecture. Given s...
research
∙
08/07/2018