对于输入X,类别标签Y
生成式模型估计他们的联合概率分布P(X,Y)
判别式模型估计条件概率分布P(Y|X)
生成式模型可以根据贝叶斯公式得到判别式模型,但是反过来不行。
常见的判别式模型主要有:
Logistic Regression
SVM
Traditional Neural Networks
Nearest Neighbor
CRF
Linear Discriminant Analysis
Boosting
Linear Regression
常见的生成式模型主要有:
Gaussians
Naive Bayes
Mixtures of Multinomials
Mixtures of Gaussians
Mixtures of Experts
HMMs
Sigmoidal Belief Networks, Bayesian Networks
Markov Random Fields
Latent Dirichlet Allocation