Training is faster than PixelRNN (can parallelize convolutions since context region values known from training images) Generation must still proceed sequentially=> still slow **Generation Samples:**
**PixelRNN and PixelCNN**
4. Variational Autoencoders (VAE)
4.1 与PixelRNN/PixelCNN的比较:
**4.2 Some background first: Autoencoders:**
**Tips:** 如果将其用于特征提取,则在训练之后,将decoder部分丢弃!
Autoencoders can reconstruct data, and can learn features to initialize a supervised model! **4.3 Variational Autoencoders**
**5.1 Training GANs: Two-player game** **Generator network:** try to fool the discriminator by generating real-looking images **Discriminator network:** try to distinguish between real and fake images
网络优化:
优化存在的问题:
解决办法:
GAN training algorithm:
5.2 Generative Adversarial Nets
Generated samples:
**Generative Adversarial Nets: Convolutional Architectures** Generator is an upsampling network with fractionally-strided convolutions Discriminator is a convolutional network
1. Unsupervised LearningSupervised vs Unsupervised Learning:2. Generative Models概述:Generative Models的作用:Generative Models的分类:3. PixelRNN and PixelCNN基本原理:PixelRNN:PixelCNN:Training is faster than Pixel