能量模型
Energy-based probabilistic models define a probability distribution through an energy function:
p(x)=e−E(x)Z
Z is called the partition function:
Z=∑xe−E(x)(to make ∑xP(x)=1)
The energy function of Boltzmann machine is given by:
E(x)=−xTUx−bTx
When include latent variable,the Boltzmann machine become more powerful,and the energy function becomes:
E(v,h)=−vTRv−vTWh−hTSh−bTv−cTh
Learning algorithms for Boltzmann machines are usually based on maximum likelihood.