Linear Regression

1Linear Regression with one variable.

1.1Supervised Learning 

Regression problem: Housing price prediction.

Classification problem: Breast cancesr (malignant, benign).

It must have data to train the model.

1.2Unsupervised Learning

Cluster algorithm

1.3Model and Cost Function: Linear Regression with one variable.

model:

hθ(x)=θ0+θ1x

Cost Function:(Square error function)

J( θ0,θ1)=12m∑i=1m(y^i−yi)2=12m∑i=1m(hθ(xi)−yi)2

1.4Gradient Descent

θj:=θj−α∂∂θjJ(θ0,θ1)

α: learning rate

∂∂θjJ(θ0,θ1):direction

Simultaneous updateθ

1.5Gradient Descent Algorithm