Deep Stacked Hierarchical Multi-patch Network for Image Deblurring代码解读

论文代码:https://github.com/HongguangZhang/DMPHN-cvpr19-master
论文地址:https://arxiv.org/pdf/1904.03468.pdf
论文解读:https://blog.csdn.net/weixin_42784951/article/details/106108196

文章使用 1-2-4-8 的结构模式。其中1-2-4-8 代表由粗到细网络所使用的图像块。

网络的每个层都由一对编码器/解码器组成。 通过将模糊图像输入B1分成多个不重叠的图像块块来生成每个级别的输入。 较低级别(对应于更精细的网格)的编码器和解码器的输出将被添加到较高级别(高于一个级别),以便顶层包含在较精细级别中推断出的所有信息。 请注意,每个级别的输入和输出图像块的数量是不同的,因为我们工作的主要思想是使较低级别的注意力集中在局部信息(更细的网格)上,从而为较粗的网格提供残差信息(通过级联卷积获得特征)。

在这里插入图片描述

下面我们从编码器开始对论文进行解读:

如文章所述,编码器由简单卷积和激活函数组成

		self.layer1 = nn.Conv2d(3, 32, kernel_size=3, padding=1)
        self.layer2 = nn.Sequential(
            nn.Conv2d(32, 32, kernel_size=3, padding=1),
            nn.ReLU(),
            nn.Conv2d(32, 32, kernel_size=3, padding=1)
            )
        self.layer3 = nn.Sequential(
            nn.Conv2d(32, 32, kernel_size=3, padding=1),
            nn.ReLU(),
            nn.Conv2d(32, 32, kernel_size=3, padding=1)
            )
        #Conv2
        self.layer5 = nn.Conv2d(32, 64, kernel_size=3, stride=2, padding=1)
        self.layer6 = nn.Sequential(
            nn.Conv2d(64, 64, kernel_size=3, padding=1),
            nn.ReLU(),
            nn.Conv2d(64, 64, kernel_size=3, padding=1)
            )
        self.layer7 = nn.Sequential(
            nn.Conv2d(64, 64, kernel_size=3, padding=1),
            nn.ReLU(),
            nn.Conv2d(64, 64, kernel_size=3, padding=1)
            )
        #Conv3
        self.layer9 = nn.Conv2d(64, 128, kernel_size=3, stride=2, padding=1)
        self.layer10 = nn.Sequential(
            nn.Conv2d
  • 2
    点赞
  • 6
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
【作 者】Per Christian Hansen 【出版社】Society for Industrial and Applied Mathematic 【出版日期】October 29, 2006 【ISBN】0898716187 9780898716184 【形态项】9.8 x 6.7 x 0.3 inches 【语 言】English 【价 格】$63.00 Deblurring Images: Matrices, Spectra, and Filtering (Fundamentals of Algorithms 3) (Fundamentals of Algorithms) By Per Christian Hansen Publisher: Society for Industrial and Applied Mathematic Number Of Pages: 130 Publication Date: 2006-10-29 ISBN-10 / ASIN: 0898716187 ISBN-13 / EAN: 9780898716184 Binding: Paperback “The book’s focus on imaging problems is very unique among the competing books on inverse and ill-posed problems. …It gives a nice introduction into the MATLAB world of images and deblurring problems.” — Martin Hanke, Professor, Institut für Mathematik, Johannes-Gutenberg-Universität. When we use a camera, we want the recorded image to be a faithful representation of the scene that we see, but every image is more or less blurry. In image deblurring, the goal is to recover the original, sharp image by using a mathematical model of the blurring process. The key issue is that some information on the lost details is indeed present in the blurred image, but this “hidden” information can be recovered only if we know the details of the blurring process. Deblurring Images: Matrices, Spectra, and Filtering describes the deblurring algorithms and techniques collectively known as spectral filtering methods, in which the singular value decomposition—or a similar decomposition with spectral properties—is used to introduce the necessary regularization or filtering in the reconstructed image. The concise MATLAB® implementations described in the book provide a template of techniques that can be used to restore blurred images from many applications. This book’s treatment of image deblurring is unique in two ways: it includes algorithmic and implementation details; and by keeping the formulations in terms of matrices, vectors, and matrix computations, it makes the material accessible to a wide range of readers. Students and researchers in engineering will gain an understanding of the linear algebra behind filtering methods, while readers in applied mathematics, numerical analysis, and computational science will be exposed to modern techniques to solve realistic large-scale problems in image processing. With a focus on practical and efficient algorithms, Deblurring Images: Matrices, Spectra, and Filtering includes many examples, sample image data, and MATLAB codes that allow readers to experiment with the algorithms. It also incorporates introductory material, such as how to manipulate images within the MATLAB environment, making it a stand-alone text. Pointers to the literature are given for techniques not covered in the book. Audience This book is intended for beginners in the field of image restoration and regularization. Readers should be familiar with basic concepts of linear algebra and matrix computations, including the singular value decomposition and orthogonal transformations. A background in signal processing and a familiarity with regularization methods or with ill-posed problems are not needed. For readers who already have this knowledge, this book gives a new and practical perspective on the use of regularization methods to solve real problems. Preface; How to Get the Software; List of Symbols; Chapter 1: The Image Deblurring Problem; Chapter 2: Manipulating Images in MATLAB; Chapter 3: The Blurring Function; Chapter 4: Structured Matrix Computations; Chapter 5: SVD and Spectral Analysis; Chapter 6: Regularization by Spectral Filtering; Chapter 7: Color Images, Smoothing Norms, and Other Topics; Appendix: MATLAB Functions; Bibliography; Index
回答: 在引用的论文中,"scale-deep"是指在图像去模糊任务中使用的一种多尺度和多层级的描述符。这个描述符是通过将每个阶段生成的特征连接起来形成的,并使用层次注意机制来调整特征的权重。通过计算特征的平均强度来衡量可分辨性,并使用全连接层获取可训练的注意力图。最终,通过使用残差图来保存主要的多尺度和多层级特征。这种方法类似于另一篇论文《Deep Stacked Hierarchical Multi-patch Network for Image Deblurring》,只是在结构上有所展开。\[2\]\[3\] #### 引用[.reference_title] - *1* *3* [论文阅读笔记之——《Scale-recurrent Network for Deep Image Deblurring》](https://blog.csdn.net/gwplovekimi/article/details/93170926)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v91^insertT0,239^v3^insert_chatgpt"}} ] [.reference_item] - *2* [Multi-Scale Deep Feature Fusion for Vehicle Re-Identification翻译(IEEE2020)](https://blog.csdn.net/weixin_42666085/article/details/105492304)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v91^insertT0,239^v3^insert_chatgpt"}} ] [.reference_item] [ .reference_list ]
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值