该文章只在本人的csdn和github账号发布,禁止任何人在任何其他平台以任何形式的转载。感谢理解!
收集整理的点云入门资料。
带有论文链接的完整版本移步这里:
https://github.com/FengZicai/3D-Point-Cloud-Get-Started
麻烦同学们给个星星吧!
3D Point Cloud Get Started
This summary includes traditional algorithms and deep learning methods, which refers to paper with code, shenlanxueyuan, and My blog (in Chinese).
I participated in the LIDAR object detection track of DEECAMP 2020. The added information refers to the baseline of this competition track.
Lidar and point cloud
For the principle of lidar, you can refer to the following articles:
https://zhuanlan.zhihu.com/p/33792450
https://pdal.io/workshop/lidar-introduction.html
Dataset
-
PASCAL3D+ (2014) [Link]
12 categories, on average 3k+ objects per category, for 3D object detection and pose estimation. -
ModelNet (2015) [Link]
127915 3D CAD models from 662 categories
ModelNet10: 4899 models from 10 categories
ModelNet40: 12311 models from 40 categories, all are uniformly orientated -
ShapeNet (2015) [Link]
3Million+ models and 4K+ categories. A dataset that is large in scale, well organized and richly annotated.
ShapeNetCore [Link]: 51300 models for 55 categories. -
NYU Depth Dataset V2 (2012) [Link]
1449 densely labeled pairs of aligned RGB and depth images from Kinect video sequences for a variety of indoor scenes. -
SUNRGB-D 3D Object Detection Challenge [Link]
19 object categories for predicting a 3D bounding box in real world dimension
Training set: 10,355 RGB-D scene images, Testing set: 2860 RGB-D images -
ScanNet (2017) [Link]
An RGB-D video dataset containing 2.5 million views in more than 1500 scans, annotated with 3D camera poses, surface reconstructions, and instance-level semantic segmentations. -
Facebook House3D: A Rich and Realistic 3D Environment (2017) [Link]
House3D is a virtual 3D environment which consists of 45K indoor scenes equipped with a diverse set of scene types, layouts and objects sourced from the SUNCG dataset. All 3D objects are fully annotated with category labels. Agents in the environment have access to observations of multiple modalities, including RGB images, depth, segmentation masks and top-down 2D map views. -
KITTI Benckmark
paper link
The KITTI (Karlsruhe Institute of Technology and Toyota Technological Institute) dataset is a widely used computer vision benchmark which was released in 2012. A Volkswagen station was fitted with grayscale and color cameras, a Velodyne 3D Laser Scanner and a GPS/IMU system. They have datasets for various scenarios like urban, residential, highway, and campus. -
nuScenes Benckmark
paper link
nuTonomy scenes (nuScenes) is the first dataset to carry the full autonomous vehicle sensor suite: 6 cameras, 5 radars and 1 lidar, all with full 360 degree field ofview. nuScenes comprises 1000 scenes, each 20s long and fully annotated with 3D bound- ing boxes for 23 classes and 8 attributes. It has 7x as many annotations and 100x as many images as the pioneering KITTI dataset.
Tradition algorithms
The following algorithms and registration-related deep learning methods refer to the course named 3D Point Cloud Analysis. The code of which can be access here.
PCA & Kernel PCA
Suface Normal
DownSampling
- grid sampling
- FPS
- Normal Space Sampling
Nearset Neighbor Problem
- KD-Tree
- Octree
Clustering
- k-means
- GMM
- EM
- Spectral Clustering
- Mean Shift
- DBSCAN
Model Fitting
- Least squares
- Hough Transformation
- RANSAC
Feature Detection
- Harris 3D&6D
- ISS(Intrinsic Shape Signatures)
Feature Description
- PFH & FPFH
- SHOT
Registration
- ICP
- NDT
Review article
Deep Learning for 3D Point Clouds: A Survey
[Paper] [Code] [My Blog1] [My Blog2]
Review: deep learning on 3D point clouds
[Paper]
A Review on Object Pose Recovery: from 3D Bounding Box Detectors to Full 6D Pose Estimators
[Paper]
3D Point Cloud Classification and Segmentation
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
[Paper] [Code] [My Blog]
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
[Paper] [Code] [My Blog]
PointConv: Deep Convolutional Networks on 3D Point Clouds
[Paper] [Code] [My Blog]
PointSIFT: A SIFT-like Network Module for 3D Point Cloud Semantic Segmentation
[Paper]
Point Cloud Augmentation
PointAugment: an Auto-Augmentation Framework for Point Cloud Classification
[Paper] [Code] [My Blog]
3D Shape Completion
Learning Representations and Generative Models for 3D Point Clouds
[Paper] [Code] [My Blog]
3D Object Detection
Second: Sparsely embedded convolutional detection
[Paper]
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
[Paper] [Code]
PIXOR: Real-time 3D Object Detection from Point Clouds
[Paper]
PointPillars: Fast Encoders for Object Detection from Point Clouds
[Paper] [Code]
PointRCNN:3D Object Proposal Generation and Detection from Point Cloud
[Paper] [Code] [My Blog]
IPOD: Intensive Point-based Object Detector for Point Cloud
[Paper]
Deep Hough Voting for 3D Object Detection in Point Clouds
[Paper]
YOLO3D
[Paper]
Complex-YOLO: An Euler-Region-Proposal for Real-time 3D Object Detection on Point Clouds
[Paper]
Complexer-YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Clouds
[Paper]
Joint 3D Proposal Generation and Object Detection from View Aggregation
[Paper]
Multi-View 3D Object Detection Network for Autonomous Driving
[Paper]
PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection
[Paper] [Code] [My Blog]
PointPainting: Sequential Fusion for 3D Object Detection
[Paper] [Code] [My Blog]
Moving Point Cloud Processing
PointRNN: Point Recurrent Neural Network for Moving Point Cloud Processing
[Paper] [Code1] [Code2] [My Blog]
3D Object Tracking
Leveraging Shape Completion for 3D Siamese Tracking
[Paper] [Code]
P2B: Point-to-Box Network for 3D Object Tracking in Point Clouds
[Paper] [Code]
3D Multi-Object Tracking
A Baseline for 3D Multi-Object Tracking
[Paper] [Code]
Probabilistic 3D Multi-Object Tracking for Autonomous Driving
[Paper] [Code]
Center-based 3D Object Detection and Tracking
[Paper] [Code]
Argoverse: 3D Tracking and Forecasting With Rich Maps
[Paper] [Code] [My Blog]
Feature Detection & Feature Description & Registration
3DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registration
[Paper] [Code]
SO-Net: Self-Organizing Network for Point Cloud Analysis
[Paper] [Code]
USIP: Unsupervised Stable Interest Point Detection from 3D Point Clouds
[Paper] [Code]
Blogs
https://zhuanlan.zhihu.com/p/58734240