Dai, Jifeng, Kaiming He, and Jian Sun. “Instance-aware semantic segmentation via multitask network cascades.” arXiv preprint arXiv:1512.04412 (2015). (Citations: 40).
1. RPN. The instances can be represented by bounding boxes that are class-agnostic.
2. Estimating masks. A pixel-level mask is predicted by logistic regression for each bounding box instance. They are still class-agnostic.
3. Categorizing objects. The category-wise label is predicted for each mask-level instance.
We expect that each sub-task is simpler than the original instance segmentation task, and is more easily addressed by CNNs.
1 Motivation
All previous works require externel segmentation proposals, which are slow at test time.
2 Architecture
See Fig. We divide the task into three sub-tasks.1. RPN. The instances can be represented by bounding boxes that are class-agnostic.
2. Estimating masks. A pixel-level mask is predicted by logistic regression for each bounding box instance. They are still class-agnostic.
3. Categorizing objects. The category-wise label is predicted for each mask-level instance.
We expect that each sub-task is simpler than the original instance segmentation task, and is more easily addressed by CNNs.