dropout 和 maxout 技术,为了防止过拟合(overfitting):
《Improving neural networks by preventing co-adaptation of feature detectors》
Hinton, Geoffrey E., Srivastava, Nitish, Krizhevsky, Alex,Sutskever, Ilya, and Salakhutdinov, Ruslan. Improving neural networks by preventing co-adaptation of feature detectors. Technical report, arXiv:1207.0580, 2012.
《Maxout Networks》 :
Ian J Goodfellow, David Warde-Farley, Mehdi Mirza, Aaron Courville, and Yoshua Bengio.Maxout networks. arXiv preprint arXiv:1302.4389, 2013.
Maxout is a kind of neural network activation function.