【图像超分辨率】EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesis 阅读笔记

🌟Paper:EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesis


📖Abstract

传统上,超分辨率任务的算法性能是用像素级的评价标准来衡量的,如峰值信噪比(PSNR),这已被证明与人类对图像质量的感知相关性很低。因此,最小化这些指标的算法往往会产生过度平滑的图像,尽管产生高的PSNR值,但缺乏高频纹理,看起来不自然。

我们提出了一种新的自动纹理合成的方法,结合感知损失,重点是创造真实的纹理,而不是在训练期间优化对GT图像的像素精确度。通过在对抗性训练环境中使用前馈全卷积神经网络,我们在高放大率下实现了图像质量的显著提升。


📖Introduction

一个关键的问题是,对于大的下采样系数来说,高频信息的损失使得超分辨率图像中的纹理区域变得模糊,过于光滑,且不自然。

这种现象的原因在于目前最先进的方法所采用的目标函数的选择:大多数方法最小化HR真实图像和它从LR重建图像之间的像素平均平方误差(MSE),然而这已被证明与人类对图像质量的感知相关性很差。
Perceptual image quality assessment using a normalized Laplacian pyramid

虽然容易最小化,但MSE估计器返回许多可能的解决方案的平均值,这使得SISR的结果看起来不自然和不可靠(参见图2)。
在这里插入图片描述
在这项工作中,我们采取了不同

  • 1
    点赞
  • 4
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Image super-resolution (SR) is the process of increasing the resolution of a low-resolution (LR) image to a higher resolution (HR) version. This is an important task in computer vision and has many practical applications, such as improving the quality of images captured by low-resolution cameras or enhancing the resolution of medical images. However, most existing SR methods suffer from a loss of texture details and produce overly smooth HR images, which can result in unrealistic and unappealing results. To address this issue, a new SR method called Deep Spatial Feature Transform (DSFT) has been proposed. DSFT is a deep learning-based approach that uses a spatial feature transform layer to recover realistic texture in the HR image. The spatial feature transform layer takes the LR image and a set of HR feature maps as input and transforms the features to a higher dimensional space. This allows the model to better capture the high-frequency details in the image and produce more realistic HR images. The DSFT method also employs a multi-scale approach, where the LR image is processed at multiple scales to capture both local and global features. Additionally, the model uses residual connections to improve the training process and reduce the risk of overfitting. Experimental results show that DSFT outperforms state-of-the-art SR methods in terms of both quantitative metrics and visual quality. The method is also shown to be robust to different noise levels and image degradation scenarios. In summary, DSFT is a promising approach for realistic texture recovery in image super-resolution. Its ability to capture high-frequency details and produce visually appealing HR images makes it a valuable tool for various applications in computer vision.

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值