research
∙
06/07/2023
Multimodal Fusion Interactions: A Study of Human and Automatic Quantification
Multimodal fusion of multiple heterogeneous and interconnected signals i...
share
research
∙
02/23/2023
Quantifying Modeling Feature Interactions: An Information Decomposition Framework
The recent explosion of interest in multimodal applications has resulted...
research
∙
09/07/2022
Foundations and Recent Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions
Multimodal machine learning is a vibrant multi-disciplinary research fie...
research
∙
08/17/2022
Multimodal Lecture Presentations Dataset: Understanding Multimodality in Educational Slides
Lecture slide presentations, a sequence of pages that contain text and f...
research
∙
06/05/2021
Conditional Contrastive Learning: Removing Undesirable Information in Self-Supervised Representations
Self-supervised learning is a form of unsupervised learning that leverag...
research
∙
10/22/2020
MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences
Human communication is multimodal in nature; it is through multiple moda...
research
∙
06/10/2020
Demystifying Self-Supervised Learning: An Information-Theoretical Framework
Self-supervised representation learning adopts self-defined signals as s...
research
∙
11/21/2019
WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separation
Monoaural audio source separation is a challenging research area in mach...
research
∙
06/29/2019
Deep Gamblers: Learning to Abstain with Portfolio Theory
We deal with the selective classification problem (supervised-learning p...
research
∙
06/16/2018
Learning Factorized Multimodal Representations
Learning representations of multimodal data is a fundamentally complex r...
research
∙
06/07/2018
