目标检测中常用的数据增强、backbone、head、neck、损失函数

转载链接：https://zhuanlan.zhihu.com/p/137769687

一、数据增强方式

random erase
CutOut
MixUp
CutMix
色彩、对比度增强
旋转、裁剪

解决数据不均衡：
Focal loss
hard negative example mining
OHEM
S-OHEM
GHM（较大关注easy和正常hard样本，较少关注outliners）
PISA

二、常用backbone

VGG
ResNet（ResNet18，50，100）
ResNeXt
DenseNet
SqueezeNet
Darknet（Darknet19,53）
MobileNet
ShuffleNet
DetNet
DetNAS
SpineNet
EfficientNet（EfficientNet-B0/B7）
CSPResNeXt50
CSPDarknet53

三、常用Head

Dense Prediction (one-stage):

RPN
SSD
YOLO
RetinaNet
(anchor based)
CornerNet
CenterNet
MatrixNet
FCOS(anchor free)
Sparse Prediction (two-stage):

Faster R-CNN
R-FCN
Mask RCNN (anchor based)
RepPoints(anchor free)

四、常用neck

Additional blocks:
SPP
ASPP
RFB
SAM
Path-aggregation blocks:

FPN
PAN
NAS-FPN
Fully-connected FPN
BiFPN
ASFF
SFAM
NAS-FPN

五、Skip-connections

Residual connections
Weighted residual connections
Multi-input weighted residual connections
Cross stage partial connections (CSP)

六、常用激活函数和Loss

激活函数：
ReLU
LReLU
PReLU
ReLU6
Scaled Exponential Linear Unit (SELU)
Swish
hard-Swish
Mish

Loss：
MSE
Smooth L1
Balanced L1
KL Loss
GHM loss
IoU Loss
Bounded IoU Loss
GIoU Loss
CIoU Loss
DIoU Loss

七、正则化和BN方式

正则化：
DropOut
DropPath
Spatial DropOut
DropBlock

BN：
Batch Normalization (BN)
Cross-GPU Batch Normalization (CGBN or SyncBN)
Filter Response Normalization (FRN)
Cross-Iteration Batch Normalization (CBN)

八、训练技巧

Label Smoothing
Warm Up