冯 诺依曼_从冯·诺依曼到记忆增强神经网络

冯 诺依曼

记忆增强神经网络 (Memory-Augmented Neural Networks)

Memory-Augmented Neural Networks (MANNs) were introduced in 2014 by two concurrent research efforts: Neural Turing Machines and Memory Networks. Since then, they expanded into a broader topic that spans beyond these original implementations — so I decided to dedicate it an entire series. For episode #1, I will stick to a high-level intuitive overview. This article is meant to distill the last 7 years of research into a 7-minute read, removing paper-specific terminology and implementation details that didn’t pass the test of time. Throughout the MANN series, I will dive deeper into the specifics of various proposed designs for neural memories, from their inception in 2014 to the latest updates in 2020.

：M埃默里增加了的神经网络(曼斯)是由两个并行的研究工作，在2014年推出了神经图灵机和记忆网络 。 从那时起，他们扩展到了涵盖这些原始实现之外的更广泛的主题-因此，我决定将其全过程投入使用。 对于第1集，我将坚持高层的直观概述。 本文旨在将最近7年的研究提炼成7分钟的阅读内容，删​​除未经过时间考验的纸张专用术语和实施细节。 在整个MANN系列中，从2014年问世到2020年最新更新，我都会更深入地探讨各种拟议的神经记忆设计的细节。

Memory-Augmented Neural Networks (MANNs) are differentiable versions of the von Neumann architecture. The neural memory is separate from the rest of the model parameters and, similarly to the RAM, stores long-term information.

记忆增强神经网络(MANN)是von Neumann体系结构的可区分版本。 神经存储器与其余模型参数是分开的，并且类似于RAM，它存储长期信息。

The traditional von Neumann architecture differentiates between a CPU (Central Processing Unit) and three levels of memory: registers — very fast, but with storage capability limited to a few values; main memory (e.g. RAM)— faster, with enough storage to accommodate for instructions and data to run a program, and external memory (e.g. hard drive) — slow, but with room for virtually all data used by a computer.

传统的冯·诺依曼 ( von Neumann)架构将CPU(中央处理单元)和三个内存级别区分开： 寄存器 -非常快，但是存储能力限制在几个值之内； 主内存 (例如RAM)速度较慢，具有足够的存储空间来容纳运行程序的指令和数据，而外部存储器 (例如硬盘驱动器)则较慢，但实际上可以容纳计算机使用的所有数据。

Memory-Augmented Neural Networks (MANNs) are differentiable version