【论文笔记】Simple Does It: Weakly Supervised Instance and Semantic Segmentation

abstract

Semantic labelling and instance segmentation are two tasks that require particularly costly annotations. Starting from weak supervision in the form of bounding box detection annotations, we propose a new approach that does not require modification of the segmentation training procedure. We show that when carefully designing the input labels from given bounding boxes, even a single round of training is enough to improve over previously reported weakly supervised results. Overall, our weak supervision approach reaches ∼95% of the quality of the fully supervised model, both for semantic labelling and instance segmentation.

From boxes to semantic labels(根据bounding box得到像素语义的先验信息)

• C1 Background bounding box以外的都被标注为背景
• C2 Object extent bounding box注释限制了每个实例的范围。假设物体形状的先验(例如，椭圆形物体比薄条或全矩形物体更有可能)，该框还提供了有关预期对象区域的信息。我们在训练使用这个尺寸信息。
• C3 Objectness 除了范围和面积外，手边还有更多的物体优先物。通常使用的两个前项是空间连续性和与背景的对比边界。一般来说，我们可以利用关于物体形状的先验信息，使用segment proposal[35]，这些技术被设计用来枚举和排列图像区域中可能出现的物体形状。

Box baselines

Box

将bounding box以内的都标注为前景，以外的都标注为背景。