Understanding LSTM Networks

理解LSTM网络

If we are trying to predict the last word in “the clouds are in the sky,” we don’t need any further context – it’s pretty obvious the next word is going to be sky

字符的预测
RNN无法将很久之前的信息给联系起来。

The sigmoid layer outputs numbers between zero and one, describing how much of each component should be let through. A value of zero means “let nothing through,” while a value of one means “let everything through!”

An LSTM has three of these gates, to protect and control the cell state.

sigmoid层用来描述每个组成部分应当通过多少，0代表一个都不通过，1代表全部通过，一个LSTM里面有三个这样的“门”，用来保护和控制细胞状态