训练局限玻尔斯曼机(Training Restricted Boltzmann Machines)

    本栏目（Training Restricted Boltzmann Machines）包括内容的介绍、局限玻尔斯曼机与对比差异（CD）的回顾、使用CD时怎样纠正统计、迷你块大小（mini-batch)、检查学习的过程，检查过拟合，学习率、权值和偏置的初始值、能量、权值衰减、刺激稀疏隐藏激活、隐藏层单元数 、单元不同的类型等章节。所有内容均来自Geoffrey Hinton大师的这篇文章  A Practical Guide to Training Restricted Boltzmann Machines。（http://learning.cs.toronto.edu ）

讲义的目录：

1 Introduction 

2 An overview of Restricted Boltzmann Machines and Contrastive Divergence 

3 How to collect statistics when using Contrastive Divergence 

4 The size of a mini-batch 

5 Monitoring the progress of learning 

6 Monitoring the over tting 

7 The learning rate

8 The initial values of the weights and biases 

9 Momentum 

10 Weight-decay 

11 Encouraging sparse hidden activities 

12 The number of hidden units 

13 Diff erent types of unit 

14 Varieties of contrastive divergence 

15 Displaying what is happening during learning 

16 Using RBM's for discrimination 

17 Dealing with missing values