research
∙
05/22/2023
AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation
In recent years, image generation has shown a great leap in performance,...
share
research
∙
03/30/2023
Discriminative Class Tokens for Text-to-Image Diffusion Models
Recent advances in text-to-image diffusion models have enabled the gener...
research
∙
10/21/2022
Describing Sets of Images with Textual-PCA
We seek to semantically describe a set of images, capturing both the att...
research
∙
07/22/2022
Zero-Shot Video Captioning with Evolving Pseudo-Tokens
We introduce a zero-shot video captioning method that employs two frozen...
research
∙
06/02/2022
Optimizing Relevance Maps of Vision Transformers Improves Robustness
It has been observed that visual classification models often rely mostly...
research
∙
12/09/2021
Latent Space Explanation by Intervention
The success of deep neural nets heavily relies on their ability to encod...
research
∙
11/29/2021
Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
Recent text-to-image matching models apply contrastive learning to large...
research
∙
10/27/2021
Perceptual Score: What Data Modalities Does Your Model Perceive?
Machine learning advances in the last decade have relied significantly o...
research
∙
10/21/2021
Video and Text Matching with Conditioned Embeddings
We present a method for matching a text sentence from a given corpus to ...
research
∙
08/04/2021
Towards Coherent Visual Storytelling with Ordered Image Attention
We address the problem of visual storytelling, i.e., generating a story ...
research
∙
04/15/2021
Ensemble of MRR and NDCG models for Visual Dialog
Assessing an AI agent that can converse in human language and understand...
research
∙
10/21/2020
Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies
Many recent datasets contain a variety of different data modalities, for...
research
∙
04/11/2019
Factor Graph Attention
Dialog is an effective way to exchange information, but subtle details a...
research
∙
04/11/2019
A Simple Baseline for Audio-Visual Scene-Aware Dialog
The recently proposed audio-visual scene-aware dialog task paves the way...
research
∙
11/12/2017