Notes of Hinton's lecture

Notes of Hinton’s lecture

标签（空格分隔）： Deep-learning

---

Lecture 1: Introduction

Three types of learning

   The goal for unsupervised learning is that to

• Cerate an internal representation of the input that is useful for subsequent supervised or reinforcement learning.
• Privide a compact, low-dimensional representation of the input.
  
  • High-dimensional inputs live on or near a low-dimensional manifold(or several such manifolds).
  • Principal Component Analysis(PCA, a popular linear dimension reduction algorithm) is a widely used linear method for finding a low-dimensional representation.
• Provide an economical high-dimensional representation of the input in terms of learned features.
  
  • Binary features are economical for represented by 0/1 so that it takes 1 bite to be saved in computer.
  • Real-valued faetures that are nearly all zero.
• Find a sensible clusters in the input.

---

Lecture 2a: An overview of the main types of neural network architecture

Feed-forward neural networks

  Feed-forward neural networks are the commonest type of neural network in practical applications. Such as its first layer is the input and the last l