research
∙
03/27/2023
Revisiting Multimodal Representation in Contrastive Learning: From Patch and Token Embeddings to Finite Discrete Tokens
Contrastive learning-based vision-language pre-training approaches, such...
share
research
∙
03/14/2023
CAT: Causal Audio Transformer for Audio Classification
The attention-based Transformers have been increasingly applied to audio...
research
∙
02/11/2023
A Reparameterized Discrete Diffusion Model for Text Generation
This work studies discrete diffusion probabilistic models with applicati...
research
∙
07/20/2022
Hierarchically Self-Supervised Transformer for Human Skeleton Representation Learning
Despite the success of fully-supervised human skeleton sequence modeling...
research
∙
05/20/2021
More Than Just Attention: Learning Cross-Modal Attentions with Contrastive Constraints
Attention mechanisms have been widely applied to cross-modal tasks such ...
research
∙
07/22/2019
Automatic Radiology Report Generation based on Multi-view Image Fusion and Medical Concept Enrichment
Generating radiology reports is time-consuming and requires extensive ex...
research
∙
07/20/2019
Construct Dynamic Graphs for Hand Gesture Recognition via Spatial-Temporal Attention
We propose a Dynamic Graph-Based Spatial-Temporal Attention (DG-STA) met...
research
∙
07/20/2018