Logistic regression
- This the perceptron with a sigmoid activation
- It actually computes the probability that the input belongs to class 1
- Decision boundaries may be obtained by comparing the probability to a threshold
- These boundaries will be lines (hyperplanes in higher dimensions)
- The sigmoid perceptron is a linear classifier
Estimating the model
- Given: Training data: ( X 1 , y 1 ) , ( X 2 , y 2 ) , … , ( X N , y N ) \left(X_{1}, y_{1}\right),\left(X_{2}, y_{2}\right), \ldots,\left(X_{N}, y_{N}\right) (X1,y1),(X2,y2),…,(XN,yN)
- X X X are vectors, y y y are binary (0/1) class values
- Total probability of data
P ( ( X 1 , y 1 ) , ( X 2 , y 2 ) , … , ( X N , y N ) ) = ∏ i P ( X i , y i ) = ∏ i P ( y i ∣ X i ) P ( X i ) = ∏ i 1 1 + e − y i ( w 0 + w T X i ) P ( X i ) \begin{array}{l} P\left(\left(X_{1}, y_{1}\right),\left(X_{2}, y_{2}\right), \ldots,\left(X_{N}, y_{N}\right)\right)= \prod_{i} P\left(X_{i}, y_{i}\right) \\\\ =\prod_{i} P\left(y_{i} \mid X_{i}\right) P\left(X_{i}\right)=\prod_{i} \frac{1}{1+e^{-y_{i}\left(w_{0}+w^{T} X_{i}\right)}} P\left(X_{i}\right) \end{array} P((X1,y
最低0.47元/天 解锁文章
4297
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
