I t = σ ( X t W x i + H t − 1 W h i + b i ) I_t=\sigma(X_tW_{xi}+H_{t-1}W_{hi}+b_i) It=σ(XtWxi+Ht−1Whi+bi)
F t = σ ( X t W x f + H t − 1 W h f + b f ) F_t=\sigma(X_tW_{xf}+H_{t-1}W_{hf}+b_f) Ft=σ(XtWxf+Ht−1Whf+bf)
O
t
=
σ
(
X
t
W
x
o
+
H
t
−
1
W
h
o
+
b
o
)
O_t=\sigma(X_tW_{xo}+H_{t-1}W_{ho}+b_o)
Ot=σ(XtWxo+Ht−1Who+bo)
C
~
t
=
t
a
n
h
(
X
t
W
x
c
+
H
t
−
1
W
h
c
+
b
c
)
\widetilde{C}_t=tanh(X_tW_{xc}+H_{t-1}W_{hc}+b_c)
C
t=tanh(XtWxc+Ht−1Whc+bc)
C t = F t ⊙ C t − 1 + I t ⊙ C ~ t C_t=F_t\odot{C_{t-1}}+I_t\odot{\widetilde{C}_t} Ct=Ft⊙Ct−1+It⊙C t
H t = O t ⊙ t a n h ( C t ) H_t=O_t\odot{tanh(C_t)} Ht=Ot⊙tanh(Ct)