返回目录
【2021-5-8】
(五)序列模型
week 1. 循环序列模型
1.1 为什么选序列模型
语音识别、音乐生成、情感分类、DNA序列分析、及其翻译、视频行为识别、命名实体识别
1.3 循环神经网络模型
![在这里插入图片描述](https://img-blog.csdnimg.cn/20210510140318120.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
![在这里插入图片描述](https://img-blog.csdnimg.cn/20210510140257962.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
1.4 通过时间的反向传播
![在这里插入图片描述](https://img-blog.csdnimg.cn/20210510141735482.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
1.5 不同类型的RNN
![在这里插入图片描述](https://img-blog.csdnimg.cn/20210510143056737.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
1.8 带有神经网络的梯度消失
网络过深,梯度消失
1.9 GRU单元
- RNN
![RNN](https://img-blog.csdnimg.cn/20210510175620729.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
- GRU
![在这里插入图片描述](https://img-blog.csdnimg.cn/20210510175755796.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
1.10 长短期记忆(LSTM)
![在这里插入图片描述](https://img-blog.csdnimg.cn/2021051109483732.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
![在这里插入图片描述](https://img-blog.csdnimg.cn/20210511094846592.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
1.11 双向循环神经网络
![在这里插入图片描述](https://img-blog.csdnimg.cn/20210511100848410.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
1.12 深层循环神经网络
![在这里插入图片描述](https://img-blog.csdnimg.cn/20210511101818495.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzODI2NTky,size_16,color_FFFFFF,t_70)
week 2. 自然语言处理与词嵌入
week 3. 序列模型和注意力机制