FROM: http://neuralnetworksanddeeplearning.com/
Neural Networks and Deep Learning
Using neural nets to recognize handwritten digits
How the backpropagation algorithm works
- Warm up: a fast matrix-based approach to computing the output from a neural network
- The two assumptions we need about the cost function
- The Hadamard product, $s \odot t$
- The four fundamental equations behind backpropagation
- Proof of the four fundamental equations (optional)
- The backpropagation algorithm
- The code for backpropagation
- In what sense is backpropagation a fast algorithm?
- Backpropagation: the big picture
Improving the way neural networks learn
A visual proof that neural nets can compute any function
Why are deep neural networks hard to train?
- Convolutional neural networks
- Pretraining
- Recurrent neural networks, Boltzmann machines, and other models
- Is there a universal thinking algorithm?
- On the future of neural networks
Neural Networks and Deep Learning is a free online book. Thebook will teach you about:
- Neural networks, a beautiful biologically-inspired programmingparadigm which enables a computer to learn from observational data
- Deep learning, a powerful set of techniques for learning in neuralnetworks
The book is currently an incomplete beta draft. More chapters will beadded over the coming months. For now, you can:
- Read Chapter 1, which explains howneural networks can learn to recognize handwriting
- Read Chapter 2, which explainsbackpropagation, the most important algorithm used to learn in neuralnetworks.
- Read Chapter 3, which explainsmany techniques which can be used to improve the performance ofbackpropagation.
- Read Chapter 4, which explains whyneural networks can compute any function.
- Learn more about the approach taken inthis book