1、CELoss 对 类别的梯度
Cross entropy loss function is widely used in classification problem in machine learning. In this tutorial, we will discuss the gradient of it.
Cross entropy loss function
We often use softmax function for classification problem, cross entropy loss function can be defined as:
2、CEloss对网络权重的梯度:
Derivation of the Gradient of the cross-entropy Loss