task3
信息论基础
H ( X ) = − ∑ i = 1 n p i log p i \mathrm{H}(\mathrm{X})=-\sum_{\mathrm{i}=1}^{n} p_{i} \log p_{i} H(X)=−i=1∑npilogpi
H ( X , Y ) = − ∑ x ∑ y P ( x , y ) log 2 [ P ( x , y ) ] \mathrm{H}(X, Y)=-\sum_{x} \sum_{y} P(x, y) \log _{2}[P(x, y)]