在以下文章中,
UNDERSTANDING HOW DEEP BELIEF NETWORKS PERFORM ACOUSTIC MODELLING
Abdel-rahman Mohamed, Geoffrey Hinton, and Gerald Penn
Department of Computer Science, University of Toronto
作者对distributed representation有个简单的介绍:
A very important feature of neural networks
is their ”distributed representation” of the input, i.e., many neurons
are active simultaneously to represent each input vector.