research
∙
04/30/2022
Gaze-enhanced Crossmodal Embeddings for Emotion Recognition
Emotional expressions are inherently multimodal – integrating facial beh...
share
research
∙
09/27/2021
Multimodal Integration of Human-Like Attention in Visual Question Answering
Human-like attention as a supervisory signal to guide neural attention h...
research
∙
09/27/2021
VQA-MHUG: A Gaze Dataset to Study Multimodal Neural Attention in Visual Question Answering
We present VQA-MHUG - a novel 49-participant dataset of multimodal human...
research
∙
08/17/2021
Neural Photofit: Gaze-based Mental Image Reconstruction
We propose a novel method that leverages human fixations to visually dec...
research
∙
10/15/2020
Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention
A lack of corpora has so far limited advances in integrating human gaze ...
research
∙
10/13/2020
Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension
While neural networks with attention mechanisms have achieved superior p...
research
∙
08/27/2018