【Stanford-ML-Discussion】非线性分类问题理解

利用Logistic Regression, SVM, Neural Network解决非线性分类问题

(1)Logistic Regression
Creating some polynomial features based on the original features to map the original examples into a high-dimensional feature space (like the polynomial kernel in SVM),such as quadratic, cubic features, to solve the non-linear classification problems.

(2)Neural Network
Theoretically, Neural Network with nonlinear activation function is as a non-linear classifier to be able to deal with the nonlinear classification problems.

The Neural Network is same as logistic regression when the number of hidden layer is 0 and the activation function in output layer is sigmoid function.

(3) Support Vector Machine
SVM introduces kernel function to dispose of the non-linear classification problems. Kernel function is able to map the original examples into a high-dimensional feature space so as to solve it by linear classifiers.

Though SVM with linear or polynomial functions is similar to logistic regression, The differences between logistic regression and SVM include:
-The hypothesis is different
-the optimization objective is different
Maybe, the optimization method could be same.

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值