Boiler UP!

Get More Data1. Why We Need More Data?In many situations (low bias learning model), more data usually means better performance of the model.2. When We Need More Data?Usually, we should plot the learnin

Batch Gradient Descent We use linear regression as example to explain this optimization algorithm.1. Formula1.1. Cost Function We prefer residual sum of squared to evaluate linear regression.J(θ)

Stochastic Gradient Descent1. What is Stochastic Gradient DescentStochastic Gradient Descent(SGD) is similiar with Batch Gradient Desent, but it used only 1 example for each iteration. So that it makes

Mini-Batch Gradient Descent1. What is Mini-Batch Gradient Descent?Mini-Batch Gradient Descent is an algorithm between the Batch Gradient Descent and Stochastic Gradient Descent. Concretly, this use som