yolov5-6.0网络添加小目标检测头 TensorRT部署

niuyuanye

已于 2023-02-01 09:33:21 修改

阅读量5.4k

点赞数 5

分类专栏： TensorRT yolov5 小目标文章标签： c++ Tensorrt

于 2023-01-13 12:36:37 首次发布

本文链接：https://blog.csdn.net/niuyuanye/article/details/114286950

版权

TensorRT 同时被 3 个专栏收录

2 篇文章 1 订阅

订阅专栏

yolov5

2 篇文章 0 订阅

订阅专栏

小目标

1 篇文章 0 订阅

订阅专栏

小目标检测使用TPH-YOLOv5 中的yolov5l-xs-tph.yaml模型；对其中的C3STR替换为C3模块；本文的TensorRT部署是基于yolov5l-xs-tph修改后的模型训练部署，其精度一般主要学习如何TensorRT部署，是在wang-xinyu基础上简单修改；

TPH-YOLOv5 ：https://github.com/cv516Buaa/tph-yolov5
yolov5l-xs-tph.yaml模型修改后：tensorrt-nyy: yolov5-6.0网络添加小目标检测头 TensorRT部署；

1、模型训练
具体修改在head 部分 anchors改为4； C3STR改为C3

# YOLOv5 🚀 by Ultralytics, GPL-3.0 license

# Parameters
nc: 10  # number of classes
depth_multiple: 1.0  # model depth multiple
width_multiple: 1.0  # layer channel multiple
anchors: 4
  # - [10,13, 16,30, 33,23]  # P3/8
  # - [30,61, 62,45, 59,119]  # P4/16
  # - [116,90, 156,198, 373,326]  # P5/32
# anchors:
#   - [5,6, 8,14, 15,11]  #4
#   - [10,13, 16,30, 33,23]  # P3/8
#   - [30,61, 62,45, 59,119]  # P4/16
#   - [116,90, 156,198, 373,326]  # P5/32

# YOLOv5 v6.0 backbone
backbone:
  # [from, number, module, args]
  [[-1, 1, Conv, [64, 6, 2, 2]],  # 0-P1/2
   [-1, 1, Conv, [128, 3, 2]],  # 1-P2/4
   [-1, 3, C3, [128]],
   [-1, 1, Conv, [256, 3, 2]],  # 3-P3/8
   [-1, 6, C3, [256]],
   [-1, 1, Conv, [512, 3, 2]],  # 5-P4/16
   [-1, 9, C3, [512]],
   [-1, 1, Conv, [1024, 3, 2]],  # 7-P5/32
   [-1, 3, C3, [1024]],
   [-1, 1, SPPF, [1024, 5]],  # 9
  ]

# YOLOv5 v6.0 head
head:
  [[-1, 1, Conv, [512, 1, 1]],
   [-1, 1, nn.Upsample, [None, 2, 'nearest']],
   [[-1, 6], 1, Concat, [1]],  # cat backbone P4
   [-1, 3, C3, [512, False]],  # 13

   [-1, 1, Conv, [256, 1, 1]],
   [-1, 1, nn.Upsample, [None, 2, 'nearest']],
   [[-1, 4], 1, Concat, [1]],  # cat backbone P3
   [-1, 3, C3, [256, False]],  # 17 (P3/8-small)

   [ -1, 1, Conv, [ 128, 1, 1 ] ],
   [ -1, 1, nn.Upsample, [ None, 2, 'nearest' ] ],
   [ [ -1, 2 ], 1, Concat, [ 1 ] ],  # cat backbone P2
   [ -1, 2, C3, [ 128, False ] ],  # 21 (P2/4-xsmall)  C3STR

   [ -1, 1, Conv, [ 128, 3, 2 ] ],
   [ [ -1, 18, 4], 1, Concat, [ 1 ] ],  # cat head P3
   [ -1, 2, C3, [ 256, False ] ],  # 24 (P3/8-small)  C3STR

   [-1, 1, Conv, [256, 3, 2]],
   [[-1, 14, 6], 1, Concat, [1]],  # cat head P4
   [-1, 2, C3, [512, False]],  # 27 (P4/16-medium) C3STR

   [-1, 1, Conv, [512, 3, 2]],
   [[-1, 10], 1, Concat, [1]],  # cat head P5
   [-1, 2, C3, [1024, False]],  # 30 (P5/32-large)  C3STR

   [[21, 24, 27, 30], 1, Detect, [nc, anchors]],  # Detect(P3, P4, P5)
  ]

yolov5l-xs-tph.yaml模型修改后训练60epoch后的模型，其精度一般，训练数据使用VisDrone2019，训练结果如下图：

2、模型转换部署

按照wang-xinyu的步骤转换即可；

主要修改的地方：具体细节参考：tensorrt-nyy: yolov5-6.0网络添加小目标检测头 TensorRT部署；
CHECK_COUNT=3 修改为 CHECK_COUNT=4；
MAX_OUTPUT_BBOX_COUNT=1000 修改为MAX_OUTPUT_BBOX_COUNT=4000
TensorRT 层的添加主要在第17层以后的18-31层添加修改；
在scale = 8 修改为 scale = 4；
修改后测试图片如下：