一、 安装cuda
官方推荐安装cuda10.2或者11.0,我安装的cuda10.2
cuda版本cuda_10.2.89_440.33.01_linux.run
二、 安装PyCuda
如果通过Python使用tensorRT的话,需要安装Pycuda,一般情况下只需要执行pip install pycuda就可以了。
有时安装会出现一些问题,这时就需要重新编译pycuda,参考:Installing PyCUDA on Linux
三、 安装tensorRT
1、 最新版本为tensorRT7,根据系统下载适合的tensorRT版本,这里下载的是TensorRT-7.0.0.11.CentOS-7.6.x86_64-gnu.cuda-10.2.cudnn7.6.tar.gz,下载地址为:https://developer.nvidia.com/nvidia-tensorrt-7x-download
#1、最新版本为tensorRT7,根据系统下载适合的tensorRT版本,这里下载的是
TensorRT-7.1.3.4.Ubuntu-16.04.x86_64-gnu.cuda-10.2.cudnn8.0.tar.gz
下载地址为:https://developer.nvidia.com/nvidia-tensorrt-7x-download
#2、解压缩
tar xzvf TensorRT-7.1.3.4.Ubuntu-16.04.x86_64-gnu.cuda-10.2.cudnn8.0.tar.gz
#3、安装TensorRT wheel 文件,根据python版本选择,这里是python3.7
cd TensorRT-7.1.3.4/python
pip install tensorrt-7.1.3.4-cp36-none-linux_x86_64.whl
#4、安装UFF
cd ./home/song/TensorRT-7.1.3.4/uff
pip install uff-0.6.9-py2.py3-none-any.whl
#5、安装graphsurgeon
cd /home/song/TensorRT-7.1.3.4/graphsurgeon
pip install graphsurgeon-0.4.5-py2.py3-none-any.whl
#6、配置环境变量
export PATH=$PATH:/usr/local/cuda-10.2/bin
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda-10.2/lib64
export LIBRARY_PATH=$LIBRARY_PATH:/usr/local/cuda-10.2/lib64
source /etc/profile
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/song/TensorRT-7.1.3.4/lib
source ~/.bashrc
#7、测试
song@song-Mi-Gaming-Laptop-15-6:~$ python
Python 3.7.0 (default, Jun 28 2018, 13:15:42)
[GCC 7.2.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorrt as trt
>>> print(trt.__version__)
7.1.3.4