research
∙
09/15/2023
MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Response
Large Language Models (LLMs) have shown immense potential in multimodal ...
share
research
∙
07/11/2023
Mixed-Precision Quantization with Cross-Layer Dependencies
Quantization is commonly used to compress and accelerate deep neural net...
research
∙
06/08/2023
Factorized Contrastive Learning: Going Beyond Multi-view Redundancy
In a wide range of multimodal tasks, contrastive learning has become a p...
research
∙
02/23/2023
Quantifying Modeling Feature Interactions: An Information Decomposition Framework
The recent explosion of interest in multimodal applications has resulted...
research
∙
06/30/2022
MultiViz: An Analysis Benchmark for Visualizing and Understanding Multimodal Models
The promise of multimodal models for real-world applications has inspire...
research
∙
03/03/2022
DIME: Fine-grained Interpretations of Multimodal Models via Disentangled Local Explanations
The ability for a human to understand an Artificial Intelligence (AI) mo...
research
∙
12/21/2021
Provable Hierarchical Lifelong Learning with a Sketch-based Modular Architecture
We propose a modular architecture for the lifelong learning of hierarchi...
research
∙
11/17/2021
Cryo-shift: Reducing domain shift in cryo-electron subtomograms with unsupervised domain adaptation and randomization
Cryo-Electron Tomography (cryo-ET) is a 3D imaging technology that enabl...
research
∙
11/11/2021
Variability-Aware Training and Self-Tuning of Highly Quantized DNNs for Analog PIM
DNNs deployed on analog processing in memory (PIM) architectures are sub...
research
∙
07/12/2021
Polynomial Time Reinforcement Learning in Correlated FMDPs with Linear Value Functions
Many reinforcement learning (RL) environments in practice feature enormo...
research
∙
06/10/2020