（补发）多模态文献阅读周记（一）——2020/06/08-2020/06/12

Week Literature Reading Report

2020/06/08-2020/06/12 week 1

Paper 1

Tensor Fusion Network for Multimodal Sentiment Analysis

Issues that need resolving

Multimodal fusion and representation

Key insight

This paper use three-fold Cartesian product to fusion three modalities, which is called Tensor Fusion Network. This 3D tensor contains unimodal, bimodal and trimodal dynamics. Then put this tensor to a fully connected deep neural network to do prediction. Tensor not only can keep intra-modality information, but also learns inter-modality information.

The net structure

Dataset and experiment result: CMU-MOSI(Multimodal Opinion Sentiment Intensity)
Compared with other baselines, TFN outperforms. When using only one modality, the language outperforms than other modalities.

Paper