以tar包进行安装
1.解压:若后缀是.tar 执行下面语句进行解压。
tar -xvf TensorRT-8.5.3.1.Linux.x86_64-gnu.cuda-11.8.cudnn8.6.tar
2、移动到/usr/local 将库路径写入到环境中
echo ‘export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/TensorRT-8.5.3.1/lib’ >> ~/.bashrc
source ~/.bashrc
测试 :
> cd TensorRT-8.5.3.1/samlpes/sampleOnnxMNIST
> make
> cd TensorRT-8.5.3.1/bin
> ./sampleonnxmnist
3、cd 到对应的python文件夹下,运行对应的安装包;
pip install tensorrt-8.5.3.1-cp38-none-linux_x86_64.whl
4、安装uff 支持tensorflow
cd uff
pip install uff-0.6.9-py2.py3-none-any.whlv
5、安装graphsurgeon以支持自定义结构
cd graphsurgeon
pip install graphsurgeon-0.4.6-py2.py3-none-any.whl
6、安装onnx_graphsurgeon以支持onnx
cd onnx_grahsurgeon
pip install onnx_graphsurgeon-0.3.12-py2.py3-none-any.whl
下载路径
https://developer.nvidia.com/nvidia-tensorrt-8x-download