Examples of Sequence Data
- Speech Recognition
- Music Generation
- Sentiment Classification
- DNA Sequence Analysis
- Machine Translation
- Video Activity Recognition
- Name Entity Recognition
|The th element in the input sequence for training example|
|The th element in the output sequence for training example|
|Input sequence length for training example|
|Output sequence length for training example|
Recurrent Neural Network Model
Why not standard network?
- Inputs, outputs can be different lengths in different examples.
- Doesn’t share features across different features of text.
Different Types of RNNs
|Many-to-many,||Name entity recognition|
Gated Recurrent Unit (GRU)
Memory cell value:
Long Short Term Memory (LSTM)