机器学习笔记 ---- Logistic Regression

Logistic Regression

1. Problems of Linear Regression When Applied to Classification Problem

1) h(x) may out of range
2) some unusual feature values lead to failure of classification

2. Logistic Regression Model

$1)h_{\theta }(x)=g({\theta }^{T}x)=P(y=1|x;\theta )$

where $g(z)=\frac{1}{1+e^{-z}}$ is called Sigmoid Function / Logistic Function

3. Decision Boundary

y=1 → $h_{\theta }(x)>0.5$ → ${\theta }^{T}x>0$
y=0 → $h_{\theta }(x)<0.5$ → ${\theta }^{T}x<0$
decision boundary: $h_{\theta }(x)=0.5$ → ${\theta }^{T}x=0$ (may be nonlinear)

4. Cost Function

$$Co$$