a Simple Development of CNN

a Simple Development of CNN

a simple development of CNN

network	feature
LeNet-5	foundation
AlexNet	1.change the activation fun.;2.add dropout mechanism
GooleNet	1.foundation:AlexNet;2.set up the inception Mechanism; 3.remove the full connected layer;4.begin to use 1x1 convolutional layer.
VGG	1.foundation:AlexNet;2. remove local response normalization;3.big kernels are replaced by smaller one.
ResNet	1.foundation:VGG;2.increase the number of layers;3.add shortcut connections to avoid degenerate

Actually my English is poor, I just want to use this way to improvement the level of my English.

I just forget the reference I have read, so I cannot give the reference here. Later if I can find any references I will add it to my blog.

And later I will also give the explation about some classical models.