常见RNN及其架构

一.CSRN（The CSRN is a combination of a simultaneous recurrent
network (SRN) and a cellular network (CNN) ）

The CNN, on the other hand consists of identical elements
arranged in some geometric pattern [8]. Each element can
either be a single neuron or an entire network in itself. The
symmetry of this structure allows weight sharing between
different elements. This can significantly decrease the number
of weights, as well as the time needed to train the network.
The symmetry of CNNs can also be useful in solving problems
that contain a similar type of inherent geometry. The
composition of a CNN is shown in Fig. 2.

By making each CNN cell an SRN network, we can
combine the two and obtain a cellular simultaneous recurrent
network (CSRN). Fig. 3 exhibits the CSRN architecture as
applied to the maze problem. Here the geometry of the maze is
reflected in the CSRN where each maze cell is a represented by
a SRN (grey box). This way the input pattern of the maze can
be fed directly to the network. The SRNs are combined into a
CNN structure, and their outputs are brought together to
produce an overall network output.