目录
安装 numpy
安装numpy的话参考下边的链接即可(亲测有效):
Linux下安装numpy_abc_321a的博客-CSDN博客_linux安装numpy
或者用pip 安装
pip install numpy
常见问题:
(1) numpy版本不正确,所以报错。
Traceback (most recent call last):
File "run_disamb.py", line 471, in <module>
main()
File "run_disamb.py", line 414, in main
global_step, tr_loss = train(args, train_dataset, model, tokenizer)
File "run_disamb.py", line 205, in train
results = evaluate(args, model, tokenizer)
File "run_disamb.py", line 280, in evaluate
all_pred_indexes = torch.cat(all_pred_indexes).numpy()
RuntimeError: Numpy is not available
解决方案: 先用pip卸载numpy,然后再装版本稍微高一点的numpy。比如我的是先从1.19.0 版本升到 1. 20.0版本 ,结果还是不行, 后来升到 1.22.3 版本就可以了。
$ pip uninstall numpy
$ pip install numpy==1.22.3 -i https://pypi.douban.com/simple/
(2) 由于下载源是国外的,一直报错超时。
(pytorch_1.10) [acctrm9ew5@login04 ~]$ pip install numpy==1.20
Collecting numpy==1.20
Downloading numpy-1.20.0-cp38-cp38-manylinux2010_x86_64.whl (15.4 MB)
━━━━━━━━━━━━━━━━╺━━━━━━━━━━━━━━━━━━━━━━━ 6.3/15.4 MB 11.5 kB/s eta 0:13:04
ERROR: Exception:
Traceback (most recent call last):
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 435, in _error_catcher
yield
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 516, in read
data = self._fp.read(amt) if not fp_closed else b""
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 90, in read
data = self.__fp.read(amt)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/http/client.py", line 459, in read
n = self.readinto(b)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/http/client.py", line 503, in readinto
n = self.fp.readinto(b)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/socket.py", line 669, in readinto
return self._sock.recv_into(b)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/ssl.py", line 1241, in recv_into
return self.read(nbytes, buffer)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/ssl.py", line 1099, in read
return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 167, in exc_logging_wrapper
status = run_func(*args)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapper
return func(self, options, args)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/commands/install.py", line 369, in run
requirement_set = resolver.resolve(
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 92, in resolve
result = self._result = resolver.resolve(
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/resolvers.py", line 481, in resolve
state = resolution.resolve(requirements, max_rounds=max_rounds)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/resolvers.py", line 348, in resolve
self._add_to_criteria(self.state.criteria, r, parent=None)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/resolvers.py", line 172, in _add_to_criteria
if not criterion.candidates:
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/structs.py", line 151, in __bool__
return bool(self._sequence)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 155, in __bool__
return any(self)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 143, in <genexpr>
return (c for c in iterator if id(c) not in self._incompatible_ids)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 47, in _iter_built
candidate = func()
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 206, in _make_candidate_from_link
self._link_candidate_cache[link] = LinkCandidate(
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 297, in __init__
super().__init__(
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 162, in __init__
self.dist = self._prepare()
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 231, in _prepare
dist = self._prepare_distribution()
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 308, in _prepare_distribution
return preparer.prepare_linked_requirement(self._ireq, parallel_builds=True)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 438, in prepare_linked_requirement
return self._prepare_linked_requirement(req, parallel_builds)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 483, in _prepare_linked_requirement
local_file = unpack_url(
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 165, in unpack_url
file = get_http_url(
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 106, in get_http_url
from_path, content_type = download(link, temp_dir.path)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/network/download.py", line 147, in __call__
for chunk in chunks:
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/cli/progress_bars.py", line 53, in _rich_progress_bar
for chunk in iterable:
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/network/utils.py", line 63, in response_chunks
for chunk in response.raw.stream(
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 573, in stream
data = self.read(amt=amt, decode_content=decode_content)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 538, in read
raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/contextlib.py", line 131, in __exit__
self.gen.throw(type, value, traceback)
File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 440, in _error_catcher
raise ReadTimeoutError(self._pool, None, "Read timed out.")
pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out.
解决方法:换一个源下载numpy。(我这里是在曙光平台上下载的,如果有小伙伴从这个源下载失败的话,可以再找个合适的源试试)
$ pip install numpy==1.20 -i https://pypi.douban.com/simple/
安装 nltk
pip install nltk
安装 torch
从下边链接中选个合适的版本
Previous PyTorch Versions | PyTorch
也可以从此链接中下载:
https://download.pytorch.org/whl/torch_stable.html
注:我的cuda 是 10.1 ,选的torch 版本是1.5.0,所以命令行是:
pip install torch==1.5.0+cu101 torchvision==0.6.0+cu101 -f https://download.pytorch.org/whl/torch_stable.html
安装 transformers
pip install transformers