SVM, Perceptron, LDA, Logistic Regression etc.

最新推荐文章于 2023-02-04 20:10:37 发布

windtalkersm

最新推荐文章于 2023-02-04 20:10:37 发布

阅读量1k

点赞数

分类专栏： PRML备忘算法备忘

本文链接：https://blog.csdn.net/windtalkersm/article/details/45949891

版权

本文对比了机器学习中的SVM、感知机、LDA和逻辑回归，探讨了它们之间的关系和区别。内容包括Fisher线性判别分析与逻辑回归的联系，SVM与感知机的优化方法和适用场景，以及SVM与逻辑回归的差异。此外，还提到了在高维空间中SVM的优势以及在不同问题类型上的适用性选择。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

机器学习常见算法分类汇总

Are Fisher’s linear discriminant and logistic regression classifier related?

The Efficiency of Logistic Regression Compared to Normal Discriminant Analysis
Bradley Efron
Journal of the American Statistical Association
Vol. 70, No. 352 (Dec., 1975), pp. 892-898

What is the difference between the perceptron learning algorithm and SVM?

Difference between a SVM and a perceptron

The Perceptron does not try to optimize the separation "distance". As long as it finds a hyperplane that separates the two sets, it is good. SVM on the other hand tries to maximize the "support vector", i.e., the distance between two closest opposite sample points.

The SVM typically tries to use a "kernel function" to project the sample points to high dimension space to make them linearly separable, while the perceptron assumes the sample points are linearly separable.