Multi-Modal Knowledge Graph Construction and Application: A Survey

Absract:

存在问题：1.现实世界知识爆炸；2现存KG是with pure symbol,不好让机器去理解。

->解决问题方案：Multi-Modal KG，这可以更好地实现人类水平的机器翻译。

->得出结果：MMKG

概览：

1.defintion of MMKGs;

2.the preliminaries on multi-modal tasks and techniques;

3.systematically review the challenges,progress,opportunities on the construction and application of MMKGs;

4.analyses of the strength and weakness of different solutions.

1.Introduction

one hand: the dog and the experience of dogs--象征与其物理世界意义联系起来；

on the other hand:

1 图像中更好抽取类似关系抽取，属性抽取，（eg:Partof(keyboard and the screen are parts of a laptop)）

2.可以形成more informative entity-level sentence instead of a vague concept-level with MMKG(eg:Donald Trump is making a speech(with MMKGs);A tall man with blond hai