Scale-recurrent Network for Deep Image Deblurring 阅读理解

Scale-recurrent Network for Deep Image Deblurring 2018CVPR  腾讯优图出品

code  https://github.com/jiangsutx/SRN-Deblur   代码亲测效果确实不错,但是对于我自己拍的照片出现bad case,跟作者确认过,确实存在。可能是因为作者的模型主要针对运动模糊,一般失焦模糊容易受到矫枉过正的问题。总之模型还需要继续优化

 

给定一个运动或焦点模糊的输入图像,由相机抖动、物体运动或焦点不聚焦,模糊的目标是用必要的边缘结构和细节恢复一个锐利的潜在图像。此外,对模糊模型的简化假设经常会阻碍它们在实际图像处理中的表现,模糊比建模复杂得多,并且与内置的图像处理管道纠缠在一起,各种原每一因综合得到的结果。

不同尺度上有的人采用相同参数,有的采用不同参数,本文在这项工作中,文章建议在不同的尺度上共享网络权重,以显著减少培训难度并引入明显的稳定性优势。

 

文章强调多尺度的重要性,本文对该策略进行了研究,并提出了一种可缩放的网络(SRN-DeblurNet)。它有一个更简单的网络结构,更少的参数,而且更容易进行训练。

1 多尺度,将图像缩放成多种尺度,每一个尺度视为一个子问题,采用一个Encoderdecoder网络进行训练,作者添加了一些修改,例如残差学习等。

2 前一个网络生成的deblur图像作为下一个网络的初始deblur图像。

3 各个子网络之间有一个RNN网络进行信息保留和传递,作者采用LSTM

Encoder-decoder Network指那些对称的CNN结构,它首先将输入数据逐步转换成具有较小空间大小和更多通道(编码器)的功能图,然后将它们转换回输入(解码器)的形状。

Skip-connections 被广泛用于将不同层次的信息组合在一起。它们也能促进梯度传播和加速收敛

   作者针对他提出的几个模块分别做对比实验:

    1 Multi-scale Strategy 因此作者设计了一个Single-scale model进行对比。

2 Encoder-decoder ResBlock Network

  作者分别设计多个小模块进行对比 ResBlock

 

数据集:GOPRO dataset

https://github.com/jiangsutx/SRN-Deblur

 

 

 

  • 1
    点赞
  • 5
    收藏
    觉得还不错? 一键收藏
  • 2
    评论
【作 者】Per Christian Hansen 【出版社】Society for Industrial and Applied Mathematic 【出版日期】October 29, 2006 【ISBN】0898716187 9780898716184 【形态项】9.8 x 6.7 x 0.3 inches 【语 言】English 【价 格】$63.00 Deblurring Images: Matrices, Spectra, and Filtering (Fundamentals of Algorithms 3) (Fundamentals of Algorithms) By Per Christian Hansen Publisher: Society for Industrial and Applied Mathematic Number Of Pages: 130 Publication Date: 2006-10-29 ISBN-10 / ASIN: 0898716187 ISBN-13 / EAN: 9780898716184 Binding: Paperback “The book’s focus on imaging problems is very unique among the competing books on inverse and ill-posed problems. …It gives a nice introduction into the MATLAB world of images and deblurring problems.” — Martin Hanke, Professor, Institut für Mathematik, Johannes-Gutenberg-Universität. When we use a camera, we want the recorded image to be a faithful representation of the scene that we see, but every image is more or less blurry. In image deblurring, the goal is to recover the original, sharp image by using a mathematical model of the blurring process. The key issue is that some information on the lost details is indeed present in the blurred image, but this “hidden” information can be recovered only if we know the details of the blurring process. Deblurring Images: Matrices, Spectra, and Filtering describes the deblurring algorithms and techniques collectively known as spectral filtering methods, in which the singular value decomposition—or a similar decomposition with spectral properties—is used to introduce the necessary regularization or filtering in the reconstructed image. The concise MATLAB® implementations described in the book provide a template of techniques that can be used to restore blurred images from many applications. This book’s treatment of image deblurring is unique in two ways: it includes algorithmic and implementation details; and by keeping the formulations in terms of matrices, vectors, and matrix computations, it makes the material accessible to a wide range of readers. Students and researchers in engineering will gain an understanding of the linear algebra behind filtering methods, while readers in applied mathematics, numerical analysis, and computational science will be exposed to modern techniques to solve realistic large-scale problems in image processing. With a focus on practical and efficient algorithms, Deblurring Images: Matrices, Spectra, and Filtering includes many examples, sample image data, and MATLAB codes that allow readers to experiment with the algorithms. It also incorporates introductory material, such as how to manipulate images within the MATLAB environment, making it a stand-alone text. Pointers to the literature are given for techniques not covered in the book. Audience This book is intended for beginners in the field of image restoration and regularization. Readers should be familiar with basic concepts of linear algebra and matrix computations, including the singular value decomposition and orthogonal transformations. A background in signal processing and a familiarity with regularization methods or with ill-posed problems are not needed. For readers who already have this knowledge, this book gives a new and practical perspective on the use of regularization methods to solve real problems. Preface; How to Get the Software; List of Symbols; Chapter 1: The Image Deblurring Problem; Chapter 2: Manipulating Images in MATLAB; Chapter 3: The Blurring Function; Chapter 4: Structured Matrix Computations; Chapter 5: SVD and Spectral Analysis; Chapter 6: Regularization by Spectral Filtering; Chapter 7: Color Images, Smoothing Norms, and Other Topics; Appendix: MATLAB Functions; Bibliography; Index
回答: 在引用的论文中,"scale-deep"是指在图像去模糊任务中使用的一种多尺度和多层级的描述符。这个描述符是通过将每个阶段生成的特征连接起来形成的,并使用层次注意机制来调整特征的权重。通过计算特征的平均强度来衡量可分辨性,并使用全连接层获取可训练的注意力图。最终,通过使用残差图来保存主要的多尺度和多层级特征。这种方法类似于另一篇论文《Deep Stacked Hierarchical Multi-patch Network for Image Deblurring》,只是在结构上有所展开。\[2\]\[3\] #### 引用[.reference_title] - *1* *3* [论文阅读笔记之——《Scale-recurrent Network for Deep Image Deblurring》](https://blog.csdn.net/gwplovekimi/article/details/93170926)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v91^insertT0,239^v3^insert_chatgpt"}} ] [.reference_item] - *2* [Multi-Scale Deep Feature Fusion for Vehicle Re-Identification翻译(IEEE2020)](https://blog.csdn.net/weixin_42666085/article/details/105492304)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v91^insertT0,239^v3^insert_chatgpt"}} ] [.reference_item] [ .reference_list ]

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值