[deepstream][原创]deepstream:5.1-21.02-triton的docker无法使用pytorch

最新推荐文章于 2024-08-30 16:06:34 发布

FL1623863129

最新推荐文章于 2024-08-30 16:06:34 发布

阅读量1.6k

点赞数

分类专栏：深度学习环境配置 Pytorch 文章标签： pytorch docker 人工智能

本文链接：https://blog.csdn.net/FL1623863129/article/details/121020098

版权

环境配置同时被 3 个专栏收录

249 篇文章 12 订阅

订阅专栏

深度学习

197 篇文章 20 订阅

订阅专栏

Pytorch

15 篇文章 1 订阅

订阅专栏

deepstream:5.1-21.02-triton的docker安装pytorch后会提示

libtorch_cuda_cpp.so: undefined symbol

参照Unable to Import PyTorch - #4 by mchi - DeepStream SDK - NVIDIA Developer Forums解决方法

it’s caused by PyTorch version incompatibilities.
After installing torch, remove “/opt/tritonserver/lib/pytorch/” from the LD_LIBRARY_PATH, torch can then work, otherwise it will links to the lib under /opt/tritonserver/lib/pytorch/ and the failed due to incompatibilities. But, after changing LD_LIBRARY_PATH, nvinferserver plugin can’t work then.

According to Release Notes :: NVIDIA Deep Learning Triton Inference Server Documentation 1, triton is using a dedicated Pytorch repo: triton-inference-server/pytorch_backend 1, so the incompatibility may be expected.

May I know why you need torch in DS docker?

# pip3 install torch==1.8.1+cpu torchvision==0.9.1+cpu torchaudio===0.8.1 -f https://download.pytorch.org/whl/lts/1.8/torch_lts.html
# export LD_LIBRARY_PATH=/usr/src/tensorrt/lib:/opt/jarvis/lib/:/opt/kenlm/lib/:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
# python3 -c "import torch; print(torch.__version__)"
1.8.1+cpu