信息熵
互信息(Mulual information)
条件熵
交叉熵
H(p,q)=∑ p(x)∗log( 1/q(i) )
联合熵
H(X,Y)=−∑ p(x,y) ln p(x,y)
相对熵
D(p||q)=H(p,q)-H(p)
H(p,q)=∑ p(x)∗log( 1/q(i) )
H(X,Y)=−∑ p(x,y) ln p(x,y)
D(p||q)=H(p,q)-H(p)
转载于:https://my.oschina.net/chunquedong/blog/868174