One example is the Inception architecture that has been shown to achieve very good performance at relatively low computational cost. Recently, the introduction of residual connections in conjunction with a more traditional architecture has yielded state-of-the-art performance in the 2015 ILSVRC challenge; its performance was similar to the latest generation Inception-v3 network. This raises the question of whether there are any benefit in combining the Inception architecture with residual connection.
思想
将残差网络与Inception进行结合,证明残差结构对网络的训练速度起到了非常关键的作用。
- 因为Inception网络可以非常深,可以非常自然的将Inception模块更换为残差连接。这样,就可以把残差的优点加入到Inception模块,并且还可以保留Inception的计算效率的优点
- 除了考虑和残差结合,作者也考虑了,Inception模块本身是不是也可以做到更深,更宽。
残差结构:
模型结构
- Inception V4
- 只有Inception模块
- 如果模块中含有”V”,表示采用”VALID”的Padding,否则为”SAME”
- 深度达到了75层(卷积)
- 共用模块Reduction-A: k=192,l=