[论文整理] 行为proposal生成、时序行为检测、弱监督时序行为检测

原地址：https://zhuanlan.zhihu.com/p/112811396

 

时序行为检测 & 弱监督时序行为检测 & 时序行为proposal生成 论文整理

Temporal Action Detection & Weakly Supervised Temporal Action Detection & Temporal Action Proposal Generation

---

一、Temporal Action Proposal Generation

2020年

1.天威大佬在VALSE线上talk temporal action proposal和detection相关的录像 (2020.03.18, 提取码：7y8g)

2. (RapNet) Accurate Temporal Action Proposal Generation with Relation-Aware Pyramid Network (AAAI 2020) (新论文还没开到放出来，放了个作者提交到ActivityNet 2019的报告) 新论文链接 作者的talk

3. (DBG) Fast Learning of Temporal Action Proposal via Dense Boundary Generator (AAAI 2020) TensorFlow源码

2019年

1. (SRG) SRG: Snippet Relatedness-based Temporal Action Proposal Generator (IEEE Trans 2019)

2. (DPP) Deep Point-wise Prediction for Action Temporal Proposal (ICONIP 2019) PyTorch源码

3. (半监督) Learning Temporal Action Proposals With Fewer Labels (ICCV 2019)

4. (BMN) BMN: Boundary-Matching Network for Temporal Action Proposal Generation (ICCV 2019) PyTorch代码(非官方) PaddlePaddle代码

5. (MGG) Multi-granularity Generator for Temporal Action Proposal (CVPR 2019)

6. Investigation on Combining 3D Convolution of Image Data and Optical Flow to Generate Temporal Action Proposals (2019 CVPR Workshop)

7. (CMSN) CMSN: Continuous Multi-stage Network and Variable Margin Cosine Loss for Temporal Action Proposal Generation (arxiv 2019)

8. A high performance computing method for accelerating temporal action proposal generation (arxiv 2019)

9. Multi-Granularity Fusion Network for Proposal and Activity Localization: Submission to ActivityNet Challenge 2019 Task 1 and Task 2 (ActvityNet challenge 2019)

2018年

1. (CTAP) CTAP: Complementary Temporal Action Proposal Generation (ECCV 2018) TensorFlow源码

2. (BSN) BSN: Boundary Sensitive Network for Temporal Action Proposal Generation (ECCV 2018) TensorFlow源码PyTorch源码

3. (SAP)SAP: Self-Adaptive Proposal Model for Temporal Action Detection based on Reinforcement Learning (AAAI 2018) Torch源码

2017年

1. (TURN TAP) TURN TAP: Temporal Unit Regression Network for Temporal Action Proposals (ICCV 2017) TensorFlow源码

2. (SST) SST: Single-Stream Temporal Action Proposals (CVPR 2017) theano代码TensorFlow代码

3. YoTube: Searching Action Proposal via Recurrent and Static Regression Networks (IEEE Trans 2017)

4. A Pursuit of Temporal Accuracy in General Activity Detection (arxiv 2017) PyTorch源码

2016年及之前

20. (DAPs) DAPs: Deep Action Proposals for Action Understanding (ECCV 2016) 代码

---

二、Temporal Action Detection

2020年

1. (TsaNet) Scale Matters: Temporal Scale Aggregation Network for Precise Action Localization in Untrimmed Videos (ICME 2020)

2. Constraining Temporal Relationship for Action Localization (arxiv 2020)

3. (PBRNet) Progressive Boundary Refinement Network for Temporal Action Detection (AAAI 2020)

4. (AGCN-P-3DCNNs) Graph Attention based Proposal 3D ConvNets for Action Detection (AAAI 2020)

5. (G-TAD) G-TAD: Sub-Graph Localization for Temporal Action Detection (CVPR 2020) PyTorch源码 视频

6. (CBR-Net) CBR-Net: Cascade Boundary Refinement Network for Action Detection:Submission to ActivityNet Challenge 2020 (Task 1) (ActivityNet Challenge 2020)

2019年

1. (TGM) Temporal Gaussian Mixture Layer for Videos (ICML 2019) PyTorch源码

2. (Decouple-SSAD) Decoupling Localization and Classification in Single Shot Temporal Action Detection (ICME 2019) TensorFlow源码

3. (PGCN) Graph Convolutional Networks for Temporal Action Localization (ICCV 2019) PyTorch源码

4. (S-2D-TAN) Learning Sparse 2D Temporal Adjacent Networks for Temporal Action Localization (winner solution for the HACS Temporal Action Localization Challenge at ICCV 2019)

4. 扩展(2D-TAN)  Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language (AAAI 2020)  PyTorch源码

5. (LCDC) Learning Motion in Feature Space: Locally-Consistent Deformable Convolution Networks for Fine-Grained Action Detection (ICCV 2019) PPT TensorFlow源码

6. (BLP) BLP -- Boundary Likelihood Pinpointing Networks for Accurate Temporal Action Localization (ICASSP 2019)

7. (GTAN) Gaussian Temporal Awareness Networks for Action Localization (CVPR 2019)

8. Relation Attention for Temporal Action Localization (IEEE Trans TMM 2019)

9. (C-TCN) Deep Concept-wise Temporal Convolutional Networks for Action Localization (arxiv 2019) PaddlePaddle源码

10. (AFO-TAD) AFO-TAD: Anchor-free One-Stage Detector for Temporal Action Detection (arxiv 2019)

11. (DBS) Video Imprint Segmentation for Temporal Action Detection in Untrimmed Videos (AAAI 2019)

12. (CMS-RC3D) Contextual Multi-Scale Region Convolutional 3D Network for Activity Detection (ICCVBIC 2019)

2018年

1. (ETP) Precise Temporal Action Localization by Evolving Temporal Proposals (ICMR 2018)

2. (Action Search) Action Search: Spotting Actions in Videos and Its Application to Temporal Action Localization (ECCV 2018) TensorFlow源码

3. (TAL-Net) Rethinking the Faster R-CNN Architecture for Temporal Action Localization (CVPR 2018)

4. One-shot Action Localization by Learning Sequence Matching Network (CVPR 2018)

5. Temporal Action Detection by Joint Identification-Verification (arxiv 2018)

6. (TPC) Exploring Temporal Preservation Networks for Precise Temporal Action Localization (AAAI 2018)

7. (SAP) A Self-Adaptive Proposal Model for Temporal Action Detection based on Reinforcement Learning (AAAI 2018) Torch源码

8. Diagnosing Error in Temporal Action Detectors (ECCV 2018)

2017年

1. (TCN) Temporal Context Network for Activity Localization in Videos (ICCV 2017) 源码

2. (SSN) Temporal Action Detection with Structured Segment Networks (ICCV 2017) PyTorch源码

3. (R-C3D) R-C3D: Region Convolutional 3D Network for Temporal Activity Detection (ICCV 2017) caffe源码 PyTorch复现

4. (TCNs) Temporal Convolutional Networks for Action Segmentation and Detection (CVPR 2017) TensorFlow源码

5. (SMS) Temporal Action Localization by Structured Maximal Sums (CVPR 2017) 源码

6. (SCC) SCC: Semantic Context Cascade for Efficient Action Detection (CVPR 2017)

7. (CDC) CDC: Convolutional-De-Convolutional Networks for Precise Temporal Action Localization in Untrimmed Videos (CVPR 2017) 源码 项目地址

8. (SS-TAD) End-to-End, Single-Stream Temporal ActionDetection in Untrimmed Videos (BMVC 2017) PyTorch源码

9. (CBR) Cascaded Boundary Regression for Temporal Action Detection (BMVC 2017) TensorFlow源码

10. (SSAD) Single Shot Temporal Action Detection (ACM MM 2017)

2016年及之前

1. (PSDF) Temporal Action Localization with Pyramid of Score Distribution Features (CVPR 2016)

2. Temporal Action Detection using a Statistical Language Model (CVPR 2016) 源码

3. (S-CNN) Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs (CVPR 2016) 源码 项目地址

4. End-to-end Learning of Action Detection from Frame Glimpses in Videos (CVPR 2016) 源码

---

三、Weakly Supervised Temporal Action Detection

2020年

1. (WSGN) Weakly Supervised Gaussian Networks for Action Detection (WACV 2020)

2. Weakly Supervised Temporal Action Localization Using Deep Metric Learning (WACV 2020)

3. Action Graphs: Weakly-supervised Action Localization with Graph Convolution Networks (WACV 2020)

4. (DGAM) Weakly-Supervised Action Localization by Generative Attention Modeling (CVPR 2020) 源码

5. (EM-MIL) Weakly-Supervised Action Localization with Expectation-Maximization Multi-Instance Learning (arxiv 2020)

6. Relational Prototypical Network for Weakly Supervised Temporal Action Localization (AAAI 2020)

7. (Bas-Net) Background Suppression Networkfor Weakly-supervised Temporal Action Localization (AAAI 2020) 源码

8. Background Modeling via Uncertainty Estimation for Weakly-supervised Action Localization (arxiv 2020) 源码

9. Adversarial Background-Aware Loss for Weakly-supervised Temporal Activity Localization (ECCV 2020) 源码

10. Weakly Supervised Temporal Action Localization with Segment-Level Labels (arxiv 2020)

2019年

 

GitHub 地址：https://github.com/zhenyingfang/Awesome-Temporal-Action-Detection-Temporal-Action-Proposal-Generation