Chapter 4. Generative Adversarial Networks

这章感觉没啥可写的，因为之前就对GAN略微有所了解，然后这章内容也就是最基础的一些关于GAN的内容🤣🤣🤣但是不写这一章，自己心里又难受，因此还是随便整理出这篇笔记吧，记录一下重点

书中对GAN给出的定义：Simply put, a GAN is a battle between two adversaries, the generator and the discriminator. The generator tries to convert random noise into observations that look as if they have been sampled from the original dataset and the discriminator tries to predict whether an observation comes from the original dataset or is one of the generator’s forgeries.

The key to GANs lies in how we alternate the training of the two networks, so that as the generator becomes more adept at fooling the discriminator, the discriminator must adapt in order to maintain its ability to correctly identify which observations are fake.

然后列举了几个GAN中会存在的问题：

• Oscillating Loss（震荡损失），意思就是loss不稳定
• Mode Collapse（模式坍缩）这个我自己感觉还挺有意思的。Mode collapse occurs when the generator finds a small number of samples that fool the discriminator and therefore isn’t able to produce any examples other than this limited set.
• Uninformative Loss。 This lack of correlation between the generator loss and image quality sometimes makes GAN training difficult to monitor. 就是损失函数其实并不能反映产生图片的质量，因为判别器的质量一直在优化。可能即使在现在的判别器上loss值较大，但是生成图片的质量比之前要好很多
• Hyperparameters. 对超参数特别敏感。GANs are highly sensitive to very slight changes in all of these parameters,

那怎么去解决这些问题呢，当然是对GAN的某些部分进行一些改进。后续对GAN进行改进，本书中分享了两种改进的模型：

• Wasserstein GAN (WGAN)
• Wasserstein GAN–Gradient Penalty (WGAN-GP)

具体咋整的，没大看懂，日后再来填坑吧🤦‍♂️👀