Tensorized Optical Multimodal Fusion Network

02/17/2023

∙

by   Yequan Zhao, et al.

∙

0

∙

share

We propose the first tensorized optical multimodal fusion network architecture with a self-attention mechanism and low-rank tensor fusion. Simulation results show 51.3 × less hardware requirement and 3.7× 10^13 MAC/J energy efficiency.