ImportError: /home/xxx/anaconda3/envs/glm-4-demo/lib/python3.12/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12: undefined symbol: __nvJitLinkComplete_12_4, version libnvJitLink.so.12
最近在Ubuntu上运行Glm4的大模型,总是报以上错误。
和通义千问沟通:
python vllmGlm4.py Traceback (most recent call last):
File "/server/repo/GLM-4/basic_demo/moda/vllmGlm4.py", line 1, in <module> from transformers import AutoTokenizer
File "/home/xxx/anaconda3/envs/glm-4-demo/lib/python3.12/site-packages/transformers/__init__.py", line 26, in <module> from . import dependency_versions_check
File "/home/xxx/anaconda3/envs/glm-4-demo/lib/python3.12/site-packages/transformers/dependency_versions_check.py", line 16, in <module> from .utils.versions import require_version, require_version_core
File "/home/xxx/anaconda3/envs/glm-4-demo/lib/python3.12/site-packages/transformers/utils/__init__.py", line 27, in <module> from .chat_template_utils import DocstringParsingException, TypeHintParsingException, get_json_schema
File "/home/xxx/anaconda3/envs/glm-4-demo/lib/python3.12/site-packages/transformers/utils/chat_template_utils.py", line 39, in <module> from torch import Tensor
File "/home/xxx/anaconda3/envs/glm-4-demo/lib/python3.12/site-packages/torch/__init__.py", line 367, in <module> from torch._C import * # noqa: F403
mportError: /home/wldst/anaconda3/envs/glm-4-demo/li