矩阵相似代表着什么_代表性相似性分析

矩阵相似代表着什么

TL;DR: In today’s blog post we discuss Representational Similarity Analysis (RSA), how it might improve our understanding of the brain as well as recent efforts by Samy Bengio’s and Geoffrey Hinton’s group to systematically study representations in Deep Learning architectures. So let’s get started!

TL; DR：在今天的博客文章中，我们讨论了代表性相似性分析(RSA)，它如何改善我们对大脑的理解以及Samy Bengio和Geoffrey Hinton小组最近为系统研究深度学习架构中的代表性所做的努力。 因此，让我们开始吧！

The brain processes sensory information in a distributed and hierarchical fashion. The visual cortex (the most studied object in neuroscience) for example sequentially extracts low-to-high level features. Photoreceptors by the way of bipolar + ganglion cells project to the lateral geniculate nucleus (LGN). From there on a cascade of computational stages sets in. Throughout the different stages of the ventral (“what” vs dorsal — “how”/”where”) visual stream (V1 → V2 → V4 → IT) the activity patterns become more and more tuned towards the task of object recognition. While neuronal tuning in V1 is mostly associated with rough edges and lines, IT demonstrates more abstract conceptual representational power. This modulatory hierarchy has been a big inspiration to the field of computer vision and the development of Convolutional Neural Networks (CNNs).

大脑以分布和分层的方式处理感觉信息。 视觉皮层(神经科学中研究最多的对象)例如依次提取从低到高的特征。 感光细胞通过双极+神经节细胞的方式投射到外侧膝状核(LGN)。 从那里开始，出现一系列计算阶段。在腹侧的不同阶段(“什么” vs背侧–“如何” /“哪里”)视觉流(V1→V2→V4→IT)，活动模式变得越来越多，更着重于对象识别的任务。 尽管V1中的神经元调整主要与粗糙的边缘和线条有关，但IT展示了更抽象的概念表示能力。 这种调制层次结构对计算机视觉领域和卷积神经网络(CNN)的发展产生了很大的启发。

In the neurosciences, on the other hand, there has been a long lasting history of spatial filter bank models (Sobel, etc.) which have been used to study activation patterns in the visual cortex. Until recently, these have been the state-of-the-art models of visual perception. This was mainly due to the fact that the computational model had to be somehow compared to brain recordings. Therefore, the model space to investigate was severely restricted. Enter: RSA. RSA was first introduced by Kriegeskorte et al. (2008) to bring together the cognitive and computational neuroscience community. It provides a simple framework to compare different activation patterns (not necessarily in the visual cortex; see figure below). More specifically, fMRI voxel-based GLM estimates or multi-unit recordings can be compared between different conditions (e.g. the stimulus presentation of a cat and a truck). These activation measures are then represented as vectors and we can compute distance measures between such vectors under different conditions. This can be done for many different stimuli and each pair allows us to fill one entry of the so-called representational dissimilarity matrix.

另一方面，在神经科学中，空间过滤器库模型(Sobel等)已有很长的历史，可用于研究视觉皮层的激活模式。 直到最近，这些还是视觉感知的最新模型。 这主要是由于计算模型必须以某种方式与大脑记录进行比较。 因此，研究的模型空间受到严重限制。 输入：RSA 。 RSA首先由Kriegeskorte等人引入。