onnx-tensorrt
视觉图像
这个作者很懒,什么都没留下…
展开
-
deepstream cuda tensorrt 安装
安装cuda 10.2 cundnn1. sudo bash cuda_10.2.89_440.33.01_linux.runDo you accept the above EULA? acceptCUDA Installer 取消Driver安装(Enter选择/取消)-> Install配置环境变量 vim ~/.bashrcexport PATH=/usr/local/cuda-10.2/bin:$PATHexport LD_LIBRARY_PATH=/usr/local/cu原创 2022-04-24 17:02:32 · 2673 阅读 · 0 评论 -
分类模型,pytorch->onnx->engine
import torchfrom model import resnet18import os os.environ['CUDA_DEVICE_ORDER'] = 'PCI_BUS_ID'os.environ['CUDA_VISIBLE_DEVICES'] = '1' device = torch.device("cuda" if torch.cuda.is_available() else "cpu") def model_converter(): # model = res.原创 2021-11-25 15:20:44 · 963 阅读 · 0 评论 -
onnx模型测试代码
import ioimport torchimport torch.onnxfrom model import resnet34import onnximport onnxruntimeimport numpy as npfrom PIL import Imagefrom torchvision import transforms,datasets import osclass_names = ['empty-run', 'have','empty-stop'] #这个顺序很重要,.原创 2021-11-23 14:11:25 · 1826 阅读 · 0 评论 -
使用trtexec将onnx生成trt
#生成静态batchsize的engine./trtexec --onnx=<onnx_file> \ --explicitBatch \ --saveEngine=<tensorRT_engine_file> \ --workspace=<size_in_megabytes> \ --fp16 #生成动态batchsize的engi.原创 2021-11-11 16:23:04 · 3916 阅读 · 0 评论