胶囊网络综述

本文介绍了胶囊网络的综述，包含了主要的胶囊网络相关论文

目录：

• Introduction （介绍）
• Routing （路由）
• Modality （模态）
• Problem domain （问题领域）
• Applications（应用）

1、introduce（介绍）

Early work [1,2]（早期工作） ：

Foundational work [3,4]（基础工作）

Video capsules [5]

[1]（视频胶囊）Hinton, Geoffrey E., Alex Krizhevsky, and Sida D. Wang. "Transforming auto-encoders." International Conference on Artificial Neural Networks. 2011.（转换自编码）

[2] Kulkarni, Tejas D., William F. Whitney, Pushmeet Kohli, and Josh Tenenbaum. "Deep convolutional inverse graphics network." In Advances in neural information processing systems,. 2015.（深度卷积反转图网络）

[3] Sabour, Sara, Nicholas Frosst, and Geoffrey E. Hinton. "Dynamic routing between capsules." Advances in neural information processing systems. 2017.（胶囊间的动态路由）

[4]Hinton, Geoffrey E., Sara Sabour, and Nicholas Frosst. "Matrix capsules with EM routing." International Conference on Learning Representations. 2018.（胶囊网络动态路由机制）

[5] Duarte, Kevin, Yogesh Rawat, and Mubarak Shah. "Videocapsulenet: A simplified network for action detection." Advances in Neural Information Processing Systems. 2018.（视频胶囊：简单网络对动作预测）

2、Routing （路由）

Dynamic vs EM [1,2]（动态和路由） 

Attention[3]（注意力）

Multi-modal [4]（多模块）

Generic [5]（通用）

Fast dynamic routing（快速动态路由）

[1] Sabour, Sara, Nicholas Frosst, and Geoffrey E. Hinton. "Dynamic routing between capsules." NeurIPS. 2017.（胶囊网络间的动态）

[2] Hinton, Geoffrey E., Sara Sabour, and Nicholas Frosst. "Matrix capsules with EM routing." ICLR. 2018.（胶囊网络动态路由机制）

[3] McIntosh, Bruce, Kevin Duarte, Yogesh S. Rawat, and Mubarak Shah. "Multi-modal Capsule Routing for Actor and Action Video Segmentation Conditioned on Natural Language Queries.” preprint (2018).（基于自然语言查询的Actor和动作视频分割的多模态胶囊路由）

[4] Lenssen, Jan Eric, Matthias Fey, and Pascal Libuschewski. "Group equivariant capsule networks." NeurIPS. 2018.（群组变胶囊网络）

[5] Li, Hongyang, Xiaoyang Guo, Bo DaiWanli Ouyang, and Xiaogang Wang. "Neural network encapsulation, ECCV, 2018.（神经网络封装）

[6] Zhang, Suofei, Quan Zhou, and Xiaofu Wu. "Fast dynamic routing based on weighted kernel density estimation." In International Symposium on Artificial Intelligence and Robotics, pp. 301-309. Springer, Cham, 2018.（基于加权核密度估计的快速动态路由）

[7] Wang, Dilin, and Qiang Liu. "An optimization view on dynamic routing between capsules." International Conference on Learning Representations Workshop (2018).（胶囊间动态路由的优化视图）

[8] Chen, Zhenhua, and David Crandall. "Generalized capsule networks with trainable routing procedure." arXiv preprint arXiv:1808.08692 (2018)（具有可训练路由过程的广义胶囊网络）.

[9] Shahroudnejad, Atefeh, Parnian Afshar, Konstantinos N. Plataniotis, and Arash Mohammadi. "Improved explainability of capsule networks: Relevance path by agreement." In 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP), pp. 549-553. IEEE, 2018.（提高胶囊网络的可解释性：协议的相关路径）

3、Modality

Visual: images, videos Text [9]

Graph [10]

3D point cloud [11]

Multi-modal [12]

[9] Zhao, Wei, Jianbo Ye, Min Yang, Zeyang Lei, Suofei Zhang, and Zhou Zhao."Investigating capsule networks with dynamic routing for text classification." EMNLP (2018).（用动态路由研究胶囊网络进行文本分类）

[10] Xinyi, Zhang, and Lihui Chen. "Capsule Graph Neural Network." ICLR (2018).（胶囊神经网络）

[11] Zhao, Yongheng, Tolga Birdal, Haowen Deng, and Federico Tombari. "3D Point-Capsule Networks." CVPR,  (2019).（3D点胶囊网络）

[12] McIntosh, Bruce, Kevin Duarte, Yogesh S. Rawat, and Mubarak Shah. "Multi-modal Capsule Routing for Actor and Action Video Segmentation Conditioned on Natural Language Queries.” preprint (2018).（基于自然语言查询的Actor和动作视频分割的多模态胶囊路由）

[13] Verma, Saurabh, and Zhi-Li Zhang. "Graph capsule convolutional neural networks." ICML Workshop  (2018).（图形卷积胶囊网络）

[14] Kim, Jaeyoung, Sion Jang, Sungchul Choi, and Eunjeong Park. "Text Classification using Capsules." arXiv preprint arXiv:1808.03976 (2018).（使用胶囊网络的文本分类）

[15] Algamdi, Abdullah M., Victor Sanchez, and Chang-Tsun Li. "Learning Temporal Information from Spatial Information Using CapsNets for Human Action Recognition." In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, 2019.（利用CapsNets进行人体动作识别，从空间信息中学习时间信息）

[16] Ertugrul, Itir Onal, László A. Jeni, and Jeffrey F. Cohn. "FACSCaps: Pose-Independent Facial Action Coding with Capsules." In IEEE (CVPRW), 2018.（FACSCaps：使用胶囊的姿势无关的面部动作编码）

4、Problem domain

Classification

Segmentation

Localization

[1]Sabour, Sara, Nicholas Frosst, and Geoffrey E. Hinton. "Dynamic routing between capsules." Advances in neural information processing systems. 2017.

[2]Hinton, Geoffrey E., Sara Sabour, and Nicholas Frosst. "Matrix capsules with EM routing." International Conference on Learning Representations. 2018.

[3]Du, Yongping, Xiaozheng Zhao, Meng He, and Wenyang Guo. "A Novel Capsule Based Hybrid Neural Network for Sentiment Classification." IEEE Access 7 (2019): 39321-39328.（一种新的基于胶囊的混合神经网络用于情感分类）

[4]LaLonde, Rodney, and Ulas Bagci. "Capsules for object segmentation." Medical Imaging with Deep Learning (2018).（用于对象分割的胶囊网络）

[5]Duarte, Kevin, Yogesh Rawat, and Mubarak Shah. "Videocapsulenet: A simplified network for action detection." Advances in Neural Information Processing Systems. 2018.

[6]McIntosh, Bruce, Kevin Duarte, Yogesh S. Rawat, and Mubarak Shah. "Multi-modal Capsule Routing for Actor and Action Video Segmentation Conditioned on Natural Language Queries." arXiv preprint (2018).

5、Applications

Relation extraction [1, 2]

Adversary detection [3]

Brain tumor classification [4]

Classification of Breast Cancer [5]

[1]Zhang, Xinsong, Pengshuai Li, Weijia Jia, and Hai Zhao. "Multi-labeled Relation Extraction with Attentive Capsule Network." AAAI （基于细胞胶囊网络的多标记关系提取。）

[2]Zhang, Ningyu, Shumin Deng, Zhanlin Sun, Xi Chen, Wei Zhang, and Huajun Chen. "Attention-Based Capsule Networks with Dynamic Routing for Relation Extraction.“ EMNLP 2018（基于注入的胶囊网络动态路由关系提取）

[3]Afshar, Parnian, Arash Mohammadi, and Konstantinos N. Plataniotis. "Brain tumor type classification via capsule networks." ICIP, 2018.（通过胶囊网络进行脑肿瘤类型分类）

[4]Jinliang Guo, Fang Fang, Wei Wang, Fuji Ren: EEG Emotion Recognition Based on Granger Causality and CapsNet Neural Network. CCIS, 2018.（基于Granger因果关系和胶囊神经网络的脑电信号识别）

[5]Lesmantas, Tomas, and Robertas Alzbutas. "Convolutional capsule network for classification of breast cancer histology images." ICIAR, 2018.（卷积胶囊网络用于乳腺癌组织学图像的分类）

[6]Mobiny, Aryan, Hengyang Lu, Hien V. Nguyen, Badrinath Roysam, and Navin Varadarajan. "Automated Classification of Apoptosis in Phase Contrast Microscopy Using Capsule Network." IEEE transactions on medical imaging (2019).

[7]A. PV, K. M. Buddhiraju and A. Porwal, "Capsulenet-Based Spatial–Spectral Classifier for Hyperspectral Images," in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2019

[8]Jinliang Guo, Fang Fang, Wei Wang, Fuji Ren: EEG Emotion Recognition Based on Granger Causality and CapsNet Neural Network. International Conference on Cloud Computing and Intelligence Systems, 2018

[9]X. Wang, K. Tan, Q. Du, Y. Chen and P. Du, "Caps-TripleGAN: GAN-Assisted CapsNet for Hyperspectral Image Classification," in IEEE Transactions on Geoscience and Remote Sensing. 2019

[10]Beşer, Fuat, Merve Ayyüce Kizrak, Bülent Bolat, and Tülay Yildirim. "Recognition of sign language using capsule networks." In 2018 26th Signal Processing and Communications Applications Conference (SIU), pp. 1-4. IEEE, 2018.

[11]Zhao, Tianming, Yuanning Liu, Guang Huo, and Xiaodong Zhu. "A Deep Learning Iris Recognition Method Based on Capsule Network Architecture." IEEE Access 7 (2019): 49691-49701.

[12]Marchisio, Alberto, Giorgio Nanfa, Faiq Khalid, Muhammad Abdullah Hanif, Maurizio Martina, and Muhammad Shafique. "CapsAttacks: Robust and Imperceptible Adversarial Attacks on Capsule Networks." International Conference on Machine Learning Workshop 8(2019)