深度学习(Deep Learning) 学习资料

深度学习，是当前热门的机器学习领域。 最近开始想系统学习一下， 整理了一些网上学习资料， 也供有共同兴趣的朋友参考。如果有好的推荐，也欢迎给我留言。

学习网站

1. Deep Learning 101

    http://markus.com/deep-learning-101/?utm_campaign=Manong_Weekly_Issue_11&utm_medium=EDM&utm_source=Manong_Weekly

2. Deep Learning

    http://deeplearning.net/

    Tutorials:  http://deeplearning.net/tutorial/

学习课程

1. Andrew Ng机器学习

      http://openclassroom.stanford.edu/MainFolder/CoursePage.php?course=MachineLearning

      http://www.youku.com/show_page/id_z0b669a30ab1b11e296ac.html

      http://openclassroom.stanford.edu/MainFolder/CoursePage.php?course=DeepLearning

2. Andrew Ng 无监督特征学习和深度学习

     CS294A Deep Learning and Unsupervised Feature Learning http://www.stanford.edu/class/cs294a/

     原文  http://deeplearning.stanford.edu/wiki/index.php/UFLDL_Tutorial

     翻译  http://deeplearning.stanford.edu/wiki/index.php/UFLDL%E6%95%99%E7%A8%8B

3. 复旦大学吴立德老师《深度学习教程》

      http://www.youku.com/playlist_show/id_21508721.html

4. 机器学习 – 龙星计划

      http://www.youku.com/playlist_show/id_18265477.html

技术讲座/指南教程/综述

1. Deep Learning Tutorial – Yann LeCun

      http://vdisk.weibo.com/s/Hw5s0

2. Deep learning of representations, AAAI 2013 – Bengio

      http://www.iro.umontreal.ca/~bengioy/talks/aaai2013-tutorial.pdf

3. Deep Learning – Russ Salakhutdinov

      http://www.cs.toronto.edu/~rsalakhu/ISBI1_pdf_version.pdf

      http://www.cs.toronto.edu/~rsalakhu/ISBI2_pdf_version.pdf

4. Recent development in deep learning – G. Hitton

      http://www.tudou.com/programs/view/Yg9UC1hSTJs/

5. A Tutorial on Deep Learning – G. Hitton

     Slides   http://videolectures.net/site/normal_dl/tag=52790/jul09_hinton_deeplearn.pdf

     Video  http://videolectures.net/jul09_hinton_deeplearn/

6. Tutorials on Neural Network – G. Hitton

      http://www.cs.toronto.edu/~hinton/nntut.html

7. A Tutorial on Deep Learning – Kai YU

      http://vipl.ict.ac.cn/News/academic-report-tutorial-deep-learning-dr-kai-yu

      Slides link:  http://pan.baidu.com/share/link?shareid=136269&uk=2267174042

     Video link:   1. VIPL下载Link     KaiYu_report.mp4   (519.2 MB)

8. Learning Deep Architecture for AI – Yoshua Bengio

      http://www.iro.umontreal.ca/~bengioy/papers/ftml_book.pdf

9. Representation Learning: A Review and New Perspectives – Yoshua Bengio

      http://arxiv.org/pdf/1206.5538v2

应用领域

1. NLP

     Deap Learning in NLP

           http://nlp.stanford.edu/projects/DeepLearningInNaturalLanguageProcessing.shtml

      Deep Learning for Natural Language Processing, NIPS 2009 – Ronan Collobert

http://videolectures.net/nips09_collobert_weston_dlnl/

http://ronan.collobert.com/pub/matos/2009_tutorial_nips.pdf

           Implementation in C:  Senna

     Deep Learning for NLP (without Magic), ACL 2012 + NAACL 2013 –  Richard Socher , Yoshua Bengio and Chris Manning 

           http://www.socher.org/index.php/DeepLearningTutorial/DeepLearningTutorial

          PDF:  http://nlp.stanford.edu/~socherr/SocherBengioManning-DeepLearning-ACL2012-20120707-NoMargin.pdf

2. Audio

      Deep Neural Networks for Acoustic Modeling in Speech Recognition  –  Geoffrey Hinton, Li Deng, Dong Yu, etc

3. Image

4. Music

5. …

---

以下是我爱机器学习（52ml.net）所添加内容：

1. Machine Learning: A Probabilistic Perspective（MLAPP） 第28章

2. UFLDL-斯坦福大学Andrew Ng教授“Deep Learning”教程

3. 《An Introduction to Deep Learning: From Perceptrons to Deep Networks》:以Java为例进行讲解，从感知机到Deep Networks，原理示例都有。

4. 《Deep learning these days》：Deep Learning的现状，其中告诫不要受Hinton 2006年的文章影响太大，pre-training era已经结束。

5. 《Neural Networks, Manifolds, and Topology》

6. 《Word2vec资料汇总》