pip安装 numpy, nltk,torch,transformers

目录

安装numpy

安装 nltk

安装Torch 

 安装transformers

---

安装 numpy

安装numpy的话参考下边的链接即可(亲测有效)：

Linux下安装numpy_abc_321a的博客-CSDN博客_linux安装numpy

或者用pip 安装

pip install numpy

常见问题：

(1)  numpy版本不正确，所以报错。

Traceback (most recent call last):
  File "run_disamb.py", line 471, in <module>
    main()
  File "run_disamb.py", line 414, in main
    global_step, tr_loss = train(args, train_dataset, model, tokenizer)
  File "run_disamb.py", line 205, in train
    results = evaluate(args, model, tokenizer)
  File "run_disamb.py", line 280, in evaluate
    all_pred_indexes = torch.cat(all_pred_indexes).numpy()
RuntimeError: Numpy is not available

 解决方案： 先用pip卸载numpy，然后再装版本稍微高一点的numpy。比如我的是先从1.19.0 版本升到 1. 20.0版本 ，结果还是不行， 后来升到 1.22.3 版本就可以了。

$ pip uninstall numpy

$ pip install numpy==1.22.3 -i https://pypi.douban.com/simple/

 (2)  由于下载源是国外的，一直报错超时。

(pytorch_1.10) [acctrm9ew5@login04 ~]$ pip install numpy==1.20
Collecting numpy==1.20
  Downloading numpy-1.20.0-cp38-cp38-manylinux2010_x86_64.whl (15.4 MB)
     ━━━━━━━━━━━━━━━━╺━━━━━━━━━━━━━━━━━━━━━━━ 6.3/15.4 MB 11.5 kB/s eta 0:13:04
ERROR: Exception:
Traceback (most recent call last):
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 435, in _error_catcher
    yield
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 516, in read
    data = self._fp.read(amt) if not fp_closed else b""
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 90, in read
    data = self.__fp.read(amt)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/http/client.py", line 459, in read
    n = self.readinto(b)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/http/client.py", line 503, in readinto
    n = self.fp.readinto(b)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 167, in exc_logging_wrapper
    status = run_func(*args)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapper
    return func(self, options, args)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/commands/install.py", line 369, in run
    requirement_set = resolver.resolve(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 92, in resolve
    result = self._result = resolver.resolve(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/resolvers.py", line 481, in resolve
    state = resolution.resolve(requirements, max_rounds=max_rounds)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/resolvers.py", line 348, in resolve
    self._add_to_criteria(self.state.criteria, r, parent=None)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/resolvers.py", line 172, in _add_to_criteria
    if not criterion.candidates:
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/structs.py", line 151, in __bool__
    return bool(self._sequence)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 155, in __bool__
    return any(self)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 143, in <genexpr>
    return (c for c in iterator if id(c) not in self._incompatible_ids)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 47, in _iter_built
    candidate = func()
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 206, in _make_candidate_from_link
    self._link_candidate_cache[link] = LinkCandidate(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 297, in __init__
    super().__init__(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 162, in __init__
    self.dist = self._prepare()
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 231, in _prepare
    dist = self._prepare_distribution()
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 308, in _prepare_distribution
    return preparer.prepare_linked_requirement(self._ireq, parallel_builds=True)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 438, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 483, in _prepare_linked_requirement
    local_file = unpack_url(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 165, in unpack_url
    file = get_http_url(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 106, in get_http_url
    from_path, content_type = download(link, temp_dir.path)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/network/download.py", line 147, in __call__
    for chunk in chunks:
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/cli/progress_bars.py", line 53, in _rich_progress_bar
    for chunk in iterable:
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/network/utils.py", line 63, in response_chunks
    for chunk in response.raw.stream(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 573, in stream
    data = self.read(amt=amt, decode_content=decode_content)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 538, in read
    raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 440, in _error_catcher
    raise ReadTimeoutError(self._pool, None, "Read timed out.")
pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out.

 解决方法：换一个源下载numpy。(我这里是在曙光平台上下载的，如果有小伙伴从这个源下载失败的话，可以再找个合适的源试试)

$ pip install numpy==1.20 -i https://pypi.douban.com/simple/

 

安装 nltk

pip install nltk

安装 torch 

从下边链接中选个合适的版本 

Previous PyTorch Versions | PyTorch

也可以从此链接中下载：

https://download.pytorch.org/whl/torch_stable.html

注：我的cuda 是 10.1 ，选的torch 版本是1.5.0，所以命令行是：

pip install torch==1.5.0+cu101 torchvision==0.6.0+cu101 -f https://download.pytorch.org/whl/torch_stable.html

​

 安装 transformers

pip install  transformers