Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learning摘要翻译

文章题目：Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learning

链接：
link.

摘要：

Most deraining works focus on rain streaks removal but they cannot deal adequately with heavy rain images. In heavy rain, streaks are strongly visible, dense rain accumulation or rain veiling effect significantly washes out the image, further scenes are relatively more blurry, etc. In this paper, we propose a novel method to address these problems. We put forth a 2-stage network: a physics-based backbone followed by a depth-guided GAN refinement. The first stage estimates the rain streaks, the transmission, and the atmospheric light governed by the underlying physics. To tease out these components more reliably, a guided filtering framework is used to decompose the image into its low- and high-frequency components. This filtering is guided by a rain-free residue image - its content is used to set the passbands for the two channels in a spatially-variant manner so that the background details do not get mixed up with the rain-streaks. For the second stage, the refinement stage, we put forth a depth-guided GAN to recover the background details failed to be retrieved by the first stage, as well as correcting artefacts introduced by that stage. We have evaluated our method against state of the art methods. Extensive experiments show that our method outperforms them on real rain image data, recovering visually clean images with good details.

翻译：

许多去雨工作只关注了雨线的去除，并没有对大雨进行足够的处理。在大雨中，雨线是足够可视的，密集的雨线累积或者鱼的面纱效果严重退化了图片，远处的场景更加模糊。在本文中，我们提出了一个新的方法来解决这些问题。我们提出了2个阶段的网络：第一阶段评估雨线、转换以及基于物理的大气光亮。为了更可信地梳理出这些组分，使用一个引导滤波网络来将图片分解成高频和低频两部分。这种滤波是由一幅无雨残差图像引导的——它的内容被用来以一种空间变异的方式设置两个通道的通带，这样背景细节就不会与雨线混淆。第二阶段也就是细化阶段，我们使用深度引导的GAN网络来复原在第一阶段未被复原的背景细节，同时纠正错误。我们将已有的方法和我们所提出的方法进行了比较，实验表明我们的方法对于恢复真实雨图的背景细节，还原干净图像有较大优势。