2.overview
跨模态搜索的两种方式:
(1)真实值的表示学习
- learned common representations for various modalities of data are real-valued.
2.According to the information utilized to learn the common representation, the cross-modal retrieval methods can be further divided into four groups: 1) unsupervised methods, 2) pairwise based methods, 3) rank based methods, and 4) supervised methods.
(2)二进制的表现学习—跨模态哈希
1.To speed up cross-modal retrieval, the binary representation learning methods aim to transform different modalities of data into a common Hamming space.
2.Since the rep- resentation is encoded to binary codes, the retrieval accuracy generally decreases slightly due to the loss of information.