Chap1
1.1
1.2
1948
1948 A.FeinsteinJ.Wolfowitz
1959
1961
1.3
1.4
1
2
3
4
5
1.5
1.6
1.7
1.8
Chap2
2.1“”“”“
36 1/636
1/36
P (A) 1/ 36
I (A) =−log P (A) log2 36 =≈5.17(
P (B ) 5/ 36
36
I (B ) =−log P (B ) log2 =≈2.85(
5
P (C ) 2 / 36
I (C ) =−log P (C ) log 18 =≈4.17(
2
2.2 1/6
(1) 3 5
(2) l
(3) (2312 )
(4) 1
1/636
1/36
13 5 A 36 5+3 3+5
P (A) 2 / 36
I (A) =−log P (A) log 18 =≈4.17(
2
l B36 1+1
P (B ) 1/ 36
I (B ) =−log P (B ) log2 36 =≈5.17(
Z=Y+X.
Z 2 3 4 5 6 7 8 9 10 11 12 ⎤
⎡ ⎤ ⎡
⎢ ⎥ ⎢ ⎥
P (z ) 1/ 36 2 / 36 3/ 36 4 / 36 5/ 36 6 / 36 5/ 36 4 / 36 3/ 36 2 / 36 1/ 36⎦
⎣ ⎦ ⎣
∑P (z ) 1
H (Z ) =− P (z )log P (z )
∑
Z
4 6 8 10 6
log2 36 =−[