tensorrt, batch
onnx2trt转多batch模型的时候,报错:
[2021-09-06 06:00:06 ERROR] Network has dynamic or shape inputs, but no optimization profile has been defined.
[2021-09-06 06:00:06 ERROR] Network validation failed.
terminate called after throwing an instance of 'std::runtime_error'
what(): Failed to create object
解决
onnx2trt不支持动态batch的模型转换。需要使用trtexec来进行模型转换。
trtexec的使用和推理耗时的评测请看下一篇博客。