多源域适应与协同学习的语义分割

**

多源域适应与协同学习的语义分割

**
我们首先来看一下本文的摘要：多源无监督域自适应(MSDA)旨在将训练在多个标记源域上的模型适应于未标记的目标域。 本文提出了一种基于协同学习的语义分割多源域适应框架。 首先，引入了一种简单的图像平移方法，对像素值分布进行对齐，在一定程度上减小了源域和目标域之间的差距。 然后，为了充分利用跨源域的基本语义信息，我们提出了一种协作学习方法，用于域自适应，而不需要从目标域中看到任何数据。 此外，与无监督域自适应的设置类似，利用未标记的目标域数据进一步提高域自适应的性能。 这是通过额外地限制多个适配模型的输出，并由集合模型生成的伪标签在线。对语义分割中广泛使用的域自适应基准数据集进行了广泛的实验和消融研究。 我们提出的方法在验证集上达到59.0%。（ Multi-source unsupervised domain adaptation (MSDA)aims at adapting models trained on multiple labeled source domains to an unlabeled target domain. In this paper, we propose a novel multi-source domain adaptation framework based on collaborative learning for semantic segmentation.Firstly, a simple image translation method is introduced to align the pixel value distribution to reduce the gap between source domains and target domain to some extent.Then, to fully exploit the essential semantic information across source domains, we propose a collaborative learning method for domain adaptation without seeing any data from target domain. In addition, similar to the setting of unsupervised domain adaptation, unlabeled target domain data is leveraged to further improve the performance of domain adaptation. This is achieved by additionally constraining the outputs of multiple adaptation models with pseudo labels online generated by an ensembled model.Extensive experiments and ablation studies are conducted on the widely-used domain adaptation benchmark datasets in semantic segmentation. Our proposed method achieves 59.0% mIoU on the validation set of Cityscapes by training on the labeled Synscapes and GTA5 datasets and unlabeled training set of Cityscapes. It significantly outperforms all previous state-of-the-arts single-source and multi-source unsupervised domain adaptation methods.）

方法

该方法的总体框架由三个部分组成，包括基于LAB颜色空间的图像到图像的转换、源域之间的协作学习和目标域上的协作学习。 实心箭头表示正向数据流，不同颜色表示不同的源域或目标域数据流。 破折号箭头表示对网络输出的监视。

算法部分

最后个人觉得这篇文章还有很大的改进空间，和之前的cvpr一篇文章有交叉的地方，同时这个文章也很有借鉴性，值得学习。