论文阅读 【CVPR-2022】 A Large-scale Comprehensive Dataset and Copy-overlap Aware Evaluation Protocol for

论文阅读 【CVPR-2022】 A Large-scale Comprehensive Dataset and Copy-overlap Aware Evaluation Protocol for Segment-level Video Copy Detection

studyai.com

搜索论文: A Large-scale Comprehensive Dataset and Copy-overlap Aware Evaluation Protocol for Segment-level Video Copy Detection

摘要(Abstract)

In this paper, we introduce VCSL (Video Copy Segment Localization), a new comprehensive segment-level annotated video copy dataset. Compared with existing copy detection datasets restricted by either video-level annotation or small-scale, VCSL not only has two orders of magnitude more segment-level labelled data, with 160k realistic video copy pairs containing more than 280k localized copied segment pairs, but also covers a variety of video categories and a wide range of video duration. All the copied segments inside each collected video pair are manually extracted and accompanied by precisely annotated starting and ending timestamps. Alongside the dataset, we also propose a novel evaluation protocol that better measures the prediction accuracy of copy overlapping segments between a video pair and shows improved adaptability in different scenarios. By benchmarking several baseline and state-of-the-art segment-level video copy detection methods with the proposed dataset and evaluation metric, we provide a comprehensive analysis that uncovers the strengths and weaknesses of current approaches, hoping to open up promising directions for future works. The VCSL dataset, metric and benchmark codes are all publicly available at https://github.com/alipay/VCSL.

在本文中，我们介绍了VCSL（Video Copy Segment Localization），一种新的综合段级带注释的视频复制数据集。与受视频级别注释或小规模限制的现有拷贝检测数据集相比，VCSL不仅具有两个数量级以上的段级标记数据，160k真实视频拷贝对包含280k以上的本地化拷贝段对，而且还涵盖了各种视频类别和宽范围的视频持续时间。每个采集的视频对中的所有复制片段都是手动提取的，并附有精确标注的开始和结束时间戳。除了数据集之外，我们还提出了一种新的评估协议，该协议可以更好地测量视频对之间复制重叠片段的预测精度，并在不同场景中显示出更好的适应性。通过使用所提出的数据集和评估指标对几种基线和最先进的片段级视频拷贝检测方法进行基准测试，我们提供了一个全面的分析，揭示了当前方法的优缺点，希望为未来的工作开辟有希望的方向。VCSL数据集、度量和基准代码都可以在https://github.com/alipay/VCSL.