多尺度深度压缩成像

多尺度深度压缩成像（Multi-Scale Deep Compressive Imaging）

最近一期IEEE Transactions on Computational Image 里看到的文章，两位作者来自韩国成均馆大学，看过韩剧的朋友们应该对这个学校的名字不会感到陌生。

Abstract:
Recently, deep learning-based compressive imaging (DCI) has surpassed conventional compressive imaging in reconstruction quality and running speed. While multi-scale sampling has shown superior performance over single-scale, research in DCI has been limited to single-scale sampling. Despite training with single-scale images, DCI tends to favor low-frequency components similar to conventional multi-scale sampling, especially at low subrates. From this perspective, it would be easier for the network to learn multi-scale features with a multi-scale sampling architecture. In this work, we propose a multi-scale deep compressive imaging (MS-DCI) framework which jointly learns to decompose, sample, and reconstruct images at multi-scale. A three-phase end-to-end training scheme is introduced with an initial and two enhanced reconstruction phases to demonstrate the efficiency of multi-scale sampling and further improve the reconstruction performance. We analyze the decomposition methods (including pyramid, wavelet, and scale-space), sampling matrices, and measurements and show the empirical benefit of MS-DCI, which consistently outperforms both conventional and deep learning-based approaches.

最近，基于深度学习的压缩成像（DCI）方法在重建质量和运行速度方面已经超越了传统的压缩成像方法。 虽然多尺度采样较单尺度上表现出卓越的性能，但研究人员针对DCI的研究仍仅限于单尺度采样，尚未扩展到多尺度采样中。 尽管现有DCI方法采用单尺度图像进行训练，但是这些DCI方法仍倾向单尺度图像中的低频分量，这与传统的多尺度采样相似，尤其是在低次源处。 从这一角度来说，网络更容易学习多尺度采样架构下的多尺度特征。 在这项工作中，我们提出了一种多尺度深度压缩成像（MS-DCI）框架，该框架共同学习以在多尺度下进行图像分解，采样和重建。用一个初始阶段和两个增强重建阶段构建一个三阶段端到端训练方案，证明了多尺度采样的效率，且进一步提高图像重建的性能。 我们分析了分解方法（包括金字塔，小波和尺度空间等）、采样矩阵和测量，并显示了MS-DCI的实际优势，MS-DCI的表现可持续并优于常规方法和深度学习的方法。

Published in: IEEE Transactions on Computational Imaging ( Volume: 7)
Page(s): 86 - 97
Date of Publication: 11 November 2020
ISSN Information:
Electronic ISSN: 2333-9403
CD: 2334-0118
Print ISSN: 2573-0436
INSPEC Accession Number: 20342012
DOI: 10.1109/TCI.2020.3034433