Softmax Sigmoid

Softmax Sigmoid

https://www.ritchieng.com/

Intoduction to Deep Neural Networks
https://www.ritchieng.com/machine-learning/deep-learning/neural-nets/

Logistic Regression
https://www.cntk.ai/pythondocs/CNTK_103B_MNIST_LogisticRegression.html
logistic regression (LR) network is a simple building block that has been effectively
powering many ML applications in the past decade.

Binary Logistic Regression
Multinomial Linear Regression

Softmax 多分类

 

-

 

=========

LOSS

当多分类变为二分类时，交叉熵LOSS和Logistic Regression LOSS一样。
https://gombru.github.io/2018/05/23/cross_entropy_loss/

-
-

 

--

Ref

https://dataaspirant.com/difference-between-softmax-function-and-sigmoid-function/