Neural Turing Maching

Neural Turing Maching:

• Memory : $M^{N\times D}$

• Controller

• Write Head

$$w_t(i)==\frac{exp(\beta K(M_t(i),q))}{{\sum }_{k}exp(\beta K(M_t(i),q))}$$

$$K(u,v)=\frac{u\cdot v}{||u||\cdot ||v|||}$$

$$M_{t+1}(i)=M_t(i)\cdot [1-w_t(i)\cdot e_i]+w_t(i)\cdot a_i$$

• Read Head

$$w_t(i)==\frac{exp(\beta K(M_t(i),q))}{{\sum }_{k}exp(\beta K(M_t(i),q))}$$

$$K(u,v)=\frac{u\cdot v}{||u||\cdot ||v|||}$$

$$r_t=\sum _{i=1}^N{w}_t(i)\cdot M_t(i)$$