2016.4.15 nature deep learning review［1］

今天，我本来想膜一下，所以找到了上古时期发表再nature上的反向传播的论文，但是没看下去。。。所以，翻出来了15年发表在nature上的deep learning，相当于一个review，来阅读一下，而且感觉引文会比较重要，所以这篇中枢值较高的文献拿来学一学。

相关资料：

英文原文：

http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.436.894&rep=rep1&type=pdf

中文翻译：

http://www.csdn.net/article/2015-06-01/2824811

http://www.csdn.net/article/2015-06-02/2824825 

可视化资料：

http://colah.github.io/

 

 

Abstract讲深度学习近些年在各领域取得了非常好的效果。

 

第一段其实是在讲一个大框架，ml的传统方法是，如果为了去做分类等等的人物，需要自己去提特征，然后进行后续的任务，但是这种方法需要很多专业的知识，不容易再工程上上手。于是有个representation learning这个领域，就是输入数据之后，学习到一些为了目标容易区分的特征，或者说讲原始数据换一个表达方式，使得方便后面的分类啊等等的处理。Deep learning这个工具就很牛逼，我虽然什么都不知道，但是我还是能够从不同的层次抽象出来不同的特征，从而进行学习。现在呢，已经广泛应用再各个领域中了。

下面是一些近期文献：

 

图像识别

1. Krizhevsky, A., Sutskever, I. & Hinton, G. ImageNet classification with deepconvolutional neural networks. In Proc. Advances in Neural InformationProcessing Systems 25 1090–1098 (2012).This report was a breakthrough that used convolutional nets to almost halvethe error rate for object recognition, and precipitated the rapid adoption ofdeep learning by the computer vision community.

2. Farabet, C., Couprie, C., Najman, L. & LeCun, Y. Learning hierarchical features forscene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1915–1929 (2013).

3. Tompson, J., Jain, A., LeCun, Y. & Bregler, C. Joint training of a convolutionalnetwork and a graphical model for human pose estimation. In Proc. Advances inNeural Information Processing Systems 27 1799–1807 (2014).

4. Szegedy, C. et al. Going deeper with convolutions. Preprint at http://arxiv.org/abs/1409.4842 (2014).

语音识别

5. Mikolov, T., Deoras, A., Povey, D., Burget, L. & Cernocky, J. Strategies for traininglarge scale neural network language models. In Proc. Automatic SpeechRecognition and Understanding 196–201 (2011).

6. Hinton, G. et al. Deep neural networks for acoustic modeling in speechrecognition. IEEE Signal Processing Magazine 29, 82–97 (2012).This joint paper from the major speech recognition laboratories, summarizingthe breakthrough achieved with deep learning on the task of phoneticclassification for automatic speech recognition, was the first major industrialapplication of deep learning.

7. Sainath, T., Mohamed, A.-R., Kingsbury, B. & Ramabhadran, B. Deepconvolutional neural networks for LVCSR. In Proc. Acoustics, Speech and SignalProcessing 8614–8618 (2013).

药物分子

8. Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E. & Svetnik, V. Deep neural nets as amethod for quantitative structure-activity relationships. J. Chem. Inf. Model. 55,263–274 (2015).