Video Instance Segmentation

一、介绍

1、什么是图像实例分割？

In the image domain, the task of instance segmentation, i.e. simultaneous detection and segmentation of object instances in images, was first proposed by Hariharan et al. [11] and since then has attracted tremendous amount of attention in computer vision due to its importance.

2、什么是视频实例分割？

Different from image instance segmentation, the new problem aims at simultaneous detection, segmentation and tracking of object instances in videos.

3、视频实例分割的应用场景？

The new task opens up possibilities for applications which requires video-level object masks such as video editing, autonomous driving and augmented reality.
 

4、视频实例分割相对于图像实例分割有哪些挑战？

①Video instance segmentation is more challenging than image instance segmentation in that it not only requires instance segmentation on individual frames, but also the tracking of instances across frames.

②On the other hand, video content contains richer information than a single image such as motion pattern of different objects and temporal consistency, and thus provides more cues for object recognition and segmentation.

5、视频实例分割与现有的哪些任务相关？它们之间的区别又是什么？

〇——一文看懂视频实例分割任务VIS和VOS MOTS等的区别 - 知乎

例如：①Video object segmentation aims at segmenting and tracking objects in videos, but does not require recognition of object categories.

②Video object detection aims at detecting and tracking objects, but does not deal with object segmentation.

6、现有的视频分割数据集有哪些？

①CityScapes. ②DAVIS 2017. ③Youtube-vos.

7、视频实例分割任务数据集有什么要求？

Given a video, our task requires bo