【第22期】观点:IT 行业加班,到底有没有价值?

Deep Belief Networks

转载 2015年07月09日 10:09:29

转载 : http://fantasticinblur.iteye.com/blog/1131640

Arel, I., Rose, D. C. and K arnowski, T. P. Deep machine learning - a new frontier in artificial intelligence research. Computational Intelligence Magazine, IEEE, vol. 5, pp. 13-18, 2010.
深度学习的介绍性文章,可做入门材料。

Bengio, Y. Learning deep architecture for AI. Foundations and Trends in Machine Learning, vol. 2, pp: 1-127, 2009.
深度学习的经典论文,集大成者。可以当作深度学习的学习材料。

Hinton, G. E. Learning multiple layers of representation. Trends in Cognitive Sciences, vol. 11, pp. 428-434, 2007.
不需要太多数学知识即可掌握DBNs的关键算法。这篇论文语言浅白,篇幅短小,适合初学者理解DBNs。

Hinton, G. E. To recognize shapes, first learn to generate images. Technical Report UTML TR 2006-003, University of Toronto, 2006.
多伦多大学的内部讲义。推荐阅读。

Hinton, G. E., Osindero, S. and Teh, Y. W. A fast learning algorithm for deep belief nets. Neural Computation, vol 18, pp. 1527-1554, 2006.
DBNs的开山之作,意义非凡,一定要好好看几遍。在这篇论文中,作者详细阐述了DBNs的方方面面,论证了其和一组层叠的RBMs的等价性,然后引出DBNs的学习算法。

Hinton, G. E. and Salakhutdinov, R. R. Reducing the dimensionality of data with neural networks. Science, vol. 313, no. 5786, pp. 504–507, 2006.
Science上的大作。这篇论文可是算作一个里程碑,它标志着深度学习总算有了高效的可行的算法。

Hinton, G. E. A practical guide to training restricted boltzmann machines. Technical Report UTML TR 2010-003, University of Toronto, 2010.
一份训练RBM的最佳实践。

Erhan, D., Manzagol, P. A., Bengio, Y., Bengio, S. and Vincent, P. The difficulty of training deep architectures and the effect of unsupervised pretraining. In The Twelfth International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 153–160, 2009.

Erhan, D., Courville, A., Bengio, Y. and Vincent, P. Why Does Unsupervised Pre-training Help Deep Learning? In the 13th International Conference on Artificial Intelligence and Statistics (AISTATS), Chia Laguna Resort, Sardinia, Italy, 2010.
阐述了非监督预训练的作用。这两篇可以结合起来一起看。

这篇博客给出的材料更加全面,作者来自复旦大学,现似乎是在Yahoo Labs北京研究院工作。
http://demonstrate.ycool.com/post.3006074.html

举报

相关文章推荐

深度信念网络Deep Belief Networks

Note This section assumes the reader has already read through Classifying MNIST digits using Logi...

Deep Learning源代码收集-持续更新

转自http://blog.csdn.net/zouxy09   <span

程序员升职加薪指南!还缺一个“证”!

CSDN出品,立即查看!

Harvard Computer Science

Computer Science Primarily for Undergraduates For information concerning concentration in Computer Science please consult the Director of Undergradu...

Deep Belief Networks资料汇总

Arel, I., Rose, D. C. and Karnowski, T. P. Deep machine learning - a new frontier in artificial inte...
  • weixi6
  • weixi6
  • 2012-03-28 15:36
  • 1839
收藏助手
不良信息举报
您举报文章:深度学习:神经网络中的前向传播和反向传播算法推导
举报原因:
原因补充:

(最多只允许输入30个字)