What you should keep in mind is:
x={x1,x2,x3,...,xn}
q(xi)=the frequency of xi in x =1n∑i=1nthe number of occurrence ofxi in x
Then:
p(x)=q(x1)log p(x1)+q(x2)log p(x2)+...+q(xn)log p(xn)
H(x)=p(x1)log p(x1)+p(x2)log p(x2)+...+p(xn)log p(xn)
Then:
weakly typicality: If
x∈Wn[X] ϵ
, then
p(x)≈H(X)
.
strongly typicality : If
x∈Tn[X] ϵ
, then
q(xi)≈p(xi)
.
After understanding the meaning of weakly typicality and strongly typicality discussed above, now you can figure out the homework with referring to the examples in the text book:
The example is: