logit 在统计学上是一个数学函数,但是在神经网络中却有着不同的含义。
说白了,logits 就是一个向量,下一步通常被投给 softmax 的向量。
就是下图这个箭头所指的位置:
logits 参考这里
The vector of raw (non-normalized) predictions that a classification model generates, which is ordinarily then passed to a normalization function. If the model is solving a multi-class classification problem, logits typically become an input to the softmax function. The softmax function then generates a vector of (normalized) probabilities with one value for each possible class.
In addition, logits sometimes refer to the element-wise inverse of the sigmoid function. For more information, see tf.nn.sigmoid_cross_entropy_with_logits.