SRCNN通过三个卷积层来完成对图像的超分,也就是特征提取、特征映射和图像重建。
但是其输入需要预先插值为目标尺寸,在速度上有一定的缺陷,难以应用到实时的研究中,因此Dong等人(SRCNN的第一作者)又改进了SRCNN,于是有了FSRCNN,其中的F代表Fast。
原文摘要
As a successful deep model applied in image super-resolution (SR), the Super-Resolution Convolutional Neural Network (SRCNN) has demonstrated superior performance to the previous hand- crafted models either in speed and restoration quality. However, the high computational cost still hinders it from practical usage that demands real-time performance (24 fps). In this paper, we aim at accelerating the current SRCNN, and propose a compact hourglass-shape CNN struc- ture for faster and better SR. We re-design the SRCNN structure mainly in three aspects. First, we introduce a deconvolution layer at the end of the network, then the mapping is learned directly from the original low-resolution image (without interpolation) to the high-resolution one. Second, we reformulate the mapping layer by shrinking the input feature dimension before mapping and expanding back afterwards. Third, we adopt smaller filter sizes but more mapping layers. The proposed model achieves a speed up of more than 40 times with even superior restora- tion quality. Further, we present the parameter settings that can achieve real-time performance on a generic CPU while still maintaining good performance. A corresponding transfer strategy is also proposed for fast training and testing across different upscaling factors.
其新的网络架构为:
![FSRCNN](https://i-blog.csdnimg.cn/blog_migrate/4a3458746747c35bb67c6bb24fda371e.png)
对于原