行为检测_[论文整理] 行为proposal生成、时序行为检测、弱监督时序行为检测

时序行为检测 & 弱监督时序行为检测 & 时序行为proposal生成 论文整理

Temporal Action Detection & Weakly Supervised Temporal Action Detection & Temporal Action Proposal Generation

---

附(几个pre-train 模型相关)：

1. (BSP) Boundary-sensitive Pre-training for Temporal Localization in Videos (arxiv 2020)

2. (TSP) TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks (arxiv 2020)

一、Temporal Action Proposal Generation

2020年

1.天威大佬在VALSE线上talk temporal action proposal和detection相关的录像 (2020.03.18, 提取码：7y8g)

2. (RapNet) Accurate Temporal Action Proposal Generation with Relation-Aware Pyramid Network (AAAI 2020) (新论文还没开到放出来，放了个作者提交到ActivityNet 2019的报告) 新论文链接 作者的talk

3. (DBG) Fast Learning of Temporal Action Proposal via Dense Boundary Generator (AAAI 2020) TensorFlow源码

4. (BC-GNN)Boundary Content Graph Neural Network for Temporal Action Proposal Generation (ECCV 2020)

5. (BSN++)BSN++: Complementary Boundary Regressor with Scale-Balanced RelationModeling for Temporal Action Proposal Generation (arxiv 2020)

6. Bottom-Up Temporal Action Localization with Mutual Regularization (ECCV 2020) TensorFlow源码

2019年

1. (SRG) SRG: Snippet Relatedness-based Temporal Action Proposal Generator (IEEE Trans 2019)

2. (DPP) Deep Point-wise Prediction for Action Temporal Proposal (ICONIP 2019) PyTorch源码

3. (半监督) Learning Temporal Action Proposals With Fewer Labels (ICCV 2019)

4. (BMN) BMN: Boundary-Matching Network for Temporal Action Proposal Generation (ICCV 2019) PyTorch代码(非官方) PaddlePaddle代码

5. (MGG) Multi-granularity Generator for Temporal Action Proposal (CVPR 2019)

6. Investigation on Combining 3D Convolution of Image Data and Optical Flow to Generate Temporal Action Proposals (2019 CVPR Workshop)

7. (CMSN) CMSN: Continuous Multi-stage Network and Variable Margin Cosine Loss for Temporal Action Proposal Generation (arxiv 2019)

8. A high performance computing method for accelerating temporal action proposal generation (arxiv 2019)

9. Multi-Granularity Fusion Network for Proposal and Activity Localization: Submission to ActivityNet Challenge 2019 Task 1 and Task 2 (ActvityNet challenge 2019)

2018年

1. (CTAP) CTAP: Complementary Temporal Action Proposal Generation (ECCV 2018) TensorFlow源码

2. (BSN) BSN: Boundary Sensitive Network for Temporal Action Proposal Generation (ECCV 2018) TensorFlow源码PyTorch源码

3. (SAP)SAP: Self-Adaptive Proposal Model for Temporal Action Detection based on Reinforcement Learning (AAAI 2018) Torch源码

2017年

1. (TURN TAP) TURN TAP: Temporal Unit Regression Network for Temporal Action Proposals (ICCV 2017) TensorFlow源码

2. (SST) SST: Single-Stream Temporal Action Proposals (CVPR 2017) theano代码TensorFlow代码

3. YoTube: Searching Action Proposal via Recurrent and Static Regression Networks (IEEE Trans 2017)

4. A Pursuit of Temporal Accuracy in General Activity Detection (arxiv 2017) PyTorch源码

2016年及之前

20. (DAPs) DAPs: Deep Action Proposals for Action Understanding (ECCV 2016) 代码

---

二、Temporal Action Detection

2020年

1. (TsaNet) Scale Matters: Temporal Scale Aggregation Network for Precise Action Localization in Untrimmed Videos (ICME 2020)

2. Constraining Temporal Relationship for Action Localization (arxiv 2020)

3. (PBRNet) Progressive Boundary Refinement Network for Temporal Action Detection (AAAI 2020)

4. (AGCN-P-3DCNNs) Graph Attention based Proposal 3D ConvNets for Action Detection (AAAI 2020)

5. (G-TAD) G-TAD: Sub-Graph Localization for Temporal Action Detection (CVPR 2020) PyTorch源码 视频

6. (CBR-Net) CBR-Net: Cascade Boundary Refinement Network for Action Detection:Submission to ActivityNet Challenge 2020 (Task 1) (ActivityNet Challenge 2020)

7. Temporal Action Localization with Variance-Aware Networks (arxiv 2020)

8. Boundary Uncertainty in a Single-Stage Temporal Action Localization Network (arxiv 2020)

9. Revisiting Anchor Mechanisms for Temporal Action Localization (Tip 2020) PyTorch源码

10. (C-TCN) Deep Concept-wise Temporal Convolutional Networks for Action Localization (MM 2020) PaddlePaddle源码

11. (MLTPN) Multi-Level Temporal Pyramid Network for Action Detection (PRCV 2020)

12. (SALAD) SALAD: Self-Assessment Learning for Action Detection (arxiv 2020)

13. (特征提取) TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks (arxiv 2020)

14. Multi-shot Temporal Event Localization: a Benchmark (arxiv 2020) project code 数据集

2019年

1. (TGM) Temporal Gaussian Mixture Layer for Videos (ICML 2019) PyTorch源码

2. (Decouple-SSAD) Decoupling Localization and Classification in Single Shot Temporal Action Detection (ICME 2019) TensorFlow源码

3. (PGCN) Graph Convolutional Networks for Temporal Action Localization (ICCV 2019) PyTorch源码

4. (S-2D-TAN) Learning Sparse 2D Temporal Adjacent Networks for Temporal Action Localization (winner solution for the HACS Temporal Action Localization Challenge at ICCV 2019)

4. 扩展(2D-TAN) Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language (AAAI 2020) PyTorch源码

5. (LCDC) Learning Motion in Feature Space: Locally-Consistent Deformable Convolution Networks for Fine-Grained Action Detection (ICCV 2019) PPT TensorFlow源码

6. (BLP) BLP -- Boundary Likelihood Pinpointing Networks for Accurate Temporal Action Localization (ICASSP 2019)

7. (GTAN) Gaussian Temporal Awareness Networks for Action Localization (CVPR 2019)

8. Relation Attention for Temporal Action Localization (IEEE Trans TMM 2019)

9. (AFO-TAD) AFO-TAD: Anchor-free One-Stage Detector for Temporal Action Detection (arxiv 2019)

10. (DBS) Video Imprint Segmentation for Temporal Action Detection in Untrimmed Videos (AAAI 2019)

11. (CMS-RC3D) Contextual Multi-Scale Region Convolutional 3D Network for Activity Detection (ICCVBIC 2019)

12. Exploring Feature Representation and Training strategies in Temporal Action Localization (ICIP 2019)

13. Temporal Action Localization using Long Short-Term Dependency (arxiv 2019)

2018年

1. (ETP) Precise Temporal Action Localization by Evolving Temporal Proposals (ICMR 2018)

2. (Action Search) Action Search: Spotting Actions in Videos and Its Application to Temporal Action Localization (ECCV 2018) TensorFlow源码

3. (TAL-Net) Rethinking the Faster R-CNN Architecture for Temporal Action Localization (CVPR 2018)

4. One-shot Action Localization by Learning Sequence Matching Network (CVPR 2018)

5. Temporal Action Detection by Joint Identification-Verification (arxiv 2018)

6. (TPC) Exploring Temporal Preservation Networks for Precise Temporal Action Localization (AAAI 2018)

7. (SAP) A Self-Adaptive Proposal Model for Temporal Action Detection based on Reinforcement Learning (AAAI 2018) Torch源码

8. Diagnosing Error in Temporal Action Detectors (ECCV 2018)

2017年

1. (TCN) Temporal Context Network for Activity Localization in Videos (ICCV 2017) 源码

2. (SSN) Temporal Action Detection with Structured Segment Networks (ICCV 2017) PyTorch源码

3. (R-C3D) R-C3D: Region Convolutional 3D Network for Temporal Activity Detection (ICCV 2017) caffe源码 PyTorch复现

4. (TCNs) Temporal Convolutional Networks for Action Segmentation and Detection (CVPR 2017) TensorFlow源码

5. (SMS) Temporal Action Localization by Structured Maximal Sums (CVPR 2017) 源码

6. (SCC) SCC: Semantic Context Cascade for Efficient Action Detection (CVPR 2017)

7. (CDC) CDC: Convolutional-De-Convolutional Networks for Precise Temporal Action Localization in Untrimmed Videos (CVPR 2017) 源码 项目地址

8. (SS-TAD) End-to-End, Single-Stream Temporal ActionDetection in Untrimmed Videos (BMVC 2017) PyTorch源码

9. (CBR) Cascaded Boundary Regression for Temporal Action Detection (BMVC 2017) TensorFlow源码

10. (SSAD) Single Shot Temporal Action Detection (ACM MM 2017)

2016年及之前

1. (PSDF) Temporal Action Localization with Pyramid of Score Distribution Features (CVPR 2016)

2. Temporal Action Detection using a Statistical Language Model (CVPR 2016) 源码

3. (S-CNN) Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs (CVPR 2016) 源码 项目地址

4. End-to-end Learning of Action Detection from Frame Glimpses in Videos (CVPR 2016) 源码

---

三、Weakly Supervised Temporal Action Detection

2021年

1. A Hybrid Attention Mechanism for Weakly-Supervised Temporal Action Localization.(暂时还没有论文地址) (AAAI 2021)

2020年

1. (WSGN) Weakly Supervised Gaussian Networks for Action Detection (WACV 2020)

2. Weakly Supervised Temporal Action Localization Using Deep Metric Learning (WACV 2020)

3. Action Graphs: Weakly-supervised Action Localization with Graph Convolution Networks (WACV 2020)

4. (DGAM) Weakly-Supervised Action Localization by Generative Attention Modeling (CVPR 2020) 源码

5. (EM-MIL) Weakly-Supervised Action Localization with Expectation-Maximization Multi-Instance Learning (arxiv 2020)

6. Relational Prototypical Network for Weakly Supervised Temporal Action Localization (AAAI 2020)

7. (Bas-Net) Background Suppression Networkfor Weakly-supervised Temporal Action Localization (AAAI 2020) 源码

8. Background Modeling via Uncertainty Estimation for Weakly-supervised Action Localization (arxiv 2020) 源码

9. Adversarial Background-Aware Loss for Weakly-supervised Temporal Activity Localization (ECCV 2020) 源码

10. Weakly Supervised Temporal Action Localization with Segment-Level Labels (arxiv 2020)

11. Two-Stream Consensus Network for Weakly-Supervised Temporal Action Localization (ECCV 2020 spotlight)

12. (ECM) Equivalent Classification Mapping for Weakly Supervised Temporal Action Localization (arxiv 2020)

13. Learning Temporal Co-Attention Models for Unsupervised Video Action Localization (CVPR 2020)

14. Action Completeness Modeling with Background Aware Networks for Weakly-Supervised Temporal Action Localization (ACM MM 2020)

15.(D2-Net) D2-Net: Weakly-Supervised Action Localization via Discriminative Embeddingsand Denoised Activations (arxiv 2020)

16. (SF-Net) SF-Net: Single-Frame Supervision for Temporal Action Localization (ECCV 2020) code.PyTorch

17. Point-Level Temporal Action Localization: Bridging Fully-supervised Proposals to Weakly-supervised Losses (arxiv 2020)

2019年

1. (AdapNet) AdapNet: Adaptability Decomposing Encoder-Decoder Network for Weakly Supervised Action Recognition and Localization (TNNLS)

2. Breaking Winner-Takes-All: Iterative-Winners-Out Networks for Weakly Supervised Temporal Action Localization (Tip)

3. Weakly-Supervised Temporal Localization via Occurrence Count Learning (ICML 2019) TensorFlow源码

4. (MAAN) Marginalized Average Attentional Network for Weakly-Supervised Learning (ICLR 2019) PyTorch源码

5. Weakly-supervised Action Localization with Background Modeling (ICCV 2019)

6. (TSM) Temporal Structure Mining for Weakly Supervised Action Detection (ICCV 2019)

7. (CleanNet) Weakly Supervised Temporal Action Localization through Contrast basedEvaluation Networks (ICCV 2019)

8. (3C-Net) 3C-Net: Category Count and Center Loss for Weakly-Supervised Action Localization (ICCV 2019) PyTorch源码

9. (CMCS) Completeness Modeling and Context Separation for Weakly SupervisedTemporal Action Localization (CVPR 2019) PyTorch源码

10. (RefineLoc) RefineLoc: Iterative Refinement for Weakly-Supervised Action Localization (arxiv 2019) 主页

11. (TTC-Loc) Towards Train-Test Consistency for Semi-supervised Temporal Action Localization (arxiv 2019)

12. (ASSG) Adversarial Seeded Sequence Growing for Weakly-Supervised Temporal Action Localization (ACM MM 2019)

13. (TSRNet) Learning Transferable Self-attentive Representations for Action Recognition in Untrimmed Videos with Weak Supervision (AAAI 2019)

14. (STAR) Segregated Temporal Assembly Recurrent Networks for Weakly Supervised Multiple Action Detection (AAAI 2019)

2018年

1. Weakly Supervised Temporal Action Detection with Shot-Based Temporal Pooling Network (ICONIP 2018)

2. (W-TALC) W-TALC: Weakly-supervised Temporal Activity Localization and Classification (ECCV 2018) PyTorch源码

3. (AutoLoc) AutoLoc: Weakly-supervised Temporal Action Localization (ECCV 2018) 源码

4. (STPN) Weakly Supervised Action Localization by Sparse Temporal Pooling Network (CVPR 2018) 源码

5. Step-by-step Erasion, One-by-one Collection: A Weakly Supervised Temporal Action Detector (ACM MM 2018)

6. (CPMN) Cascaded Pyramid Mining Network for Weakly Supervised Temporal Action Localization (ACCV 2018)

2017年

1. (Hide-and-Seek) Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localization (ICCV 2017)

2. (UntrimmedNets) UntrimmedNets for Weakly Supervised Action Recognition and Detection (CVPR 2017) 源码

---

GitHub更新地址​github.com