北京理工大学孙磊

原创 Github remote repository command reminder

remote repository a . SSH settings: ssh-keygen -t rsa -C "bitsunlei@126.com" b. create a new repository at GIthub.com c. git remote add origin git@github.com:drsunlei/tsalearn.git git remote add ...

原创 Github local command reminder

1. initialization: git init 2. modify and add a file git add file git commit -m "message" 3. compare difference git diff git status If you know that the remote version is what you want t...

原创 Entropy of a RV:Entropy of a binary random variable

% ********************************************************************* % ({'Entropy of a binary random variable','\bf(C) bitsunlei@126.com'}) % *******************************************************...

原创 二次Renyi熵的估计 Quadratic Renyi entropy estimated from samples. ​​​​

二次Renyi熵的估计 Quadratic Renyi entropy estimated from samples. ​​​​

原创 离散随机变量的熵 Entropy of a discrete random variable

原创 Entropy of a random variable consisting of two discrete events

For a discrete random variable X consisting of two events {0,1}. This program shows the entropy wrt variation of the probabilities. ​​​​

原创 Mutual Information Invariance to Reparameterization

For two random variables X and Y, it is known that  which is also known as the reparameterization invariance property. To my known, the proof was given in Kraskov 2004 as follows Let  and  denote the...