research
∙
06/01/2023
Cocktail: Mixing Multi-Modality Controls for Text-Conditional Image Generation
Text-conditional diffusion models are able to generate high-fidelity ima...
share
research
∙
05/10/2023
MMoT: Mixture-of-Modality-Tokens Transformer for Composed Multimodal Conditional Image Synthesis
Existing multimodal conditional image synthesis (MCIS) methods generate ...
research
∙
11/21/2022
Cross-Modal Contrastive Learning for Robust Reasoning in VQA
Multi-modal reasoning in visual question answering (VQA) has witnessed r...
research
∙
06/21/2022
SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders
Recently, significant progress has been made in masked image modeling to...
research
∙
06/14/2022
TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformer
In this work, we explore neat yet effective Transformer-based frameworks...
research
∙
06/02/2022
Modeling Image Composition for Complex Scene Generation
We present a method that achieves state-of-the-art results on challengin...
research
∙
01/06/2022
Compact Bidirectional Transformer for Image Captioning
Most current image captioning models typically generate captions from le...
research
∙
07/17/2020
Learning to Discretely Compose Reasoning Module Networks for Video Captioning
Generating natural language descriptions for videos, i.e., video caption...
research
∙
04/01/2020
More Grounded Image Captioning by Distilling Image-Text Matching Model
Visual attention not only improves the performance of image captioners, ...
research
∙
06/09/2019
Referring Expression Grounding by Marginalizing Scene Graph Likelihood
We focus on the task of grounding referring expressions in images, e.g.,...
research
∙
06/06/2019
Context-Aware Visual Policy Network for Fine-Grained Image Captioning
With the maturity of visual detection techniques, we are more ambitious ...
research
∙
06/05/2019
Learning to Compose and Reason with Language Tree Structures for Visual Grounding
Grounding natural language in images, such as localizing "the black dog ...
research
∙
12/08/2018
Explainability by Parsing: Neural Module Tree Networks for Natural Language Visual Grounding
Grounding natural language in images essentially requires composite visu...
research
∙
08/16/2018