记录生成离线pytest依赖包

因为需要在一台访问外网受限的Ubuntu主机上安装pytest，记录一下如何生成离线依赖包。

准备

• 先找一台可以接入外网的主机
• 更换pypi源

root@eve-ng:~/deb_package# vim ~/.pip/pip.conf 

[global]
index-url = http://mirrors.aliyun.com/pypi/simple/

[global]
index-url =

[install]
use-mirrors = true
mirrors = http://mirrors.aliyun.com/pypi/simple/
trusted-host=mirrors.aliyun.com

生成

• 安装python-pip并升级

root@eve-ng:~# mkdir pkg_py
root@eve-ng:~# cd pkg_py/
root@eve-ng:~/pkg_py# apt install pip
root@eve-ng:~/pkg_py# pip install --upgrade pip

• 获取pytest的离线包和依赖包

root@eve-ng:~/deb_package# pip download -d ./ pytest==3.3.0
...
root@eve-ng:~/pkg_py# ls -l
total 920
-rw-r--r-- 1 root root  39472 Apr 27 08:56 attrs-19.3.0-py2.py3-none-any.whl
-rw-r--r-- 1 root root  17697 Apr 27 08:56 funcsigs-1.0.2-py2.py3-none-any.whl
-rw-r--r-- 1 root root  11953 Apr 27 08:56 pluggy-0.6.0-py2-none-any.whl
-rw-r--r-- 1 root root  83824 Apr 27 08:56 py-1.8.1-py2.py3-none-any.whl
-rw-r--r-- 1 root root 184202 Apr 27 08:56 pytest-3.3.0-py2.py3-none-any.whl
-rw-r--r-- 1 root root 583351 Apr 27 08:56 setuptools-44.1.0-py2.py3-none-any.whl
-rw-r--r-- 1 root root  10938 Apr 27 08:56 six-1.14.0-py2.py3-none-any.whl

• 生成requirements

root@eve-ng:~/pkg_py# ls -l | awk '{print $9}'>> requirements.txt
root@eve-ng:~/pkg_py# 
root@eve-ng:~/pkg_py# cat requirements.txt 

attrs-19.3.0-py2.py3-none-any.whl
funcsigs-1.0.2-py2.py3-none-any.whl
pluggy-0.6.0-py2-none-any.whl
py-1.8.1-py2.py3-none-any.whl
pytest-3.3.0-py2.py3-none-any.whl
requirements.txt
setuptools-44.1.0-py2.py3-none-any.whl
six-1.14.0-py2.py3-none-any.whl
root@eve-ng:~/pkg_py# 

验证

• 本地安装验证

root@eve-ng:~/pkg_py# pip install --no-index --find-links=./ -r requirements.txt 
WARNING: pip is being invoked by an old script wrapper. This will fail in a future version of pip.
Please see https://github.com/pypa/pip/issues/5599 for advice on fixing the underlying issue.
To avoid this problem you can invoke Python with '-m pip' instead of running pip directly.
/usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/__init__.py:83: RequestsDependencyWarning: Old version of cryptography ([1, 2, 3]) may cause slowdown.
  warnings.warn(warning, RequestsDependencyWarning)
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support int
Looking in links: ./
Requirement already satisfied: attrs==19.3.0 from file:///root/pkg_py/attrs-19.3.0-py2.py3-none-any.whl in /usr/local/lib/python2.7/dist-packages (from -r requirements.txt (line 2)) (19.3.0)
Requirement already satisfied: funcsigs==1.0.2 from file:///root/pkg_py/funcsigs-1.0.2-py2.py3-none-any.whl in /usr/local/lib/python2.7/dist-packages (from -r requirements.txt (line 3)) (1.0.2)
Requirement already satisfied: pluggy==0.6.0 from file:///root/pkg_py/pluggy-0.6.0-py2-none-any.whl in /usr/local/lib/python2.7/dist-packages (from -r requirements.txt (line 4)) (0.6.0)
Requirement already satisfied: py==1.8.1 from file:///root/pkg_py/py-1.8.1-py2.py3-none-any.whl in /usr/local/lib/python2.7/dist-packages (from -r requirements.txt (line 5)) (1.8.1)
Processing ./pytest-3.3.0-py2.py3-none-any.whl
Processing ./setuptools-44.1.0-py2.py3-none-any.whl
Processing ./six-1.14.0-py2.py3-none-any.whl
Installing collected packages: setuptools, six, pytest
  Attempting uninstall: setuptools
    Found existing installation: setuptools 20.7.0
    Uninstalling setuptools-20.7.0:
      Successfully uninstalled setuptools-20.7.0
  Attempting uninstall: six
    Found existing installation: six 1.10.0
    Uninstalling six-1.10.0:
      Successfully uninstalled six-1.10.0
Successfully installed pytest-3.3.0 setuptools-44.1.0 six-1.14.0
root@eve-ng:~/pkg_py# 

• 启动python看能否正确import

root@eve-ng:~/pkg_py# python
Python 2.7.12 (default, Apr 15 2020, 17:07:12) 
[GCC 5.4.0 20160609] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import pytest
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python2.7/dist-packages/pytest.py", line 13, in <module>
    from _pytest.fixtures import fixture, yield_fixture
  File "/usr/local/lib/python2.7/dist-packages/_pytest/fixtures.py", line 839, in <module>
    class FixtureFunctionMarker(object):
  File "/usr/local/lib/python2.7/dist-packages/_pytest/fixtures.py", line 841, in FixtureFunctionMarker
    params = attr.ib(convert=attr.converters.optional(tuple))
TypeError: attrib() got an unexpected keyword argument 'convert'
>>> 
root@eve-ng:~/pkg_py# 

排障

• 上网查资料发现，是因为attrs的版本19.3.0不适合，需要切换到19.1.0
• 下载attrs==19.1.0

root@eve-ng:~/pkg_py# pip download attrs==19.1.0

• 安装

root@eve-ng:~/pkg_py# pip install attrs-19.1.0-py2.py3-none-any.whl
...
Installing collected packages: attrs
  Attempting uninstall: attrs
    Found existing installation: attrs 19.3.0
    Uninstalling attrs-19.3.0:
      Successfully uninstalled attrs-19.3.0
Successfully installed attrs-19.1.0
root@eve-ng:~/pkg_py# 

• 重试,此时可以正确import pytest

root@eve-ng:~/pkg_py# python   
Python 2.7.12 (default, Apr 15 2020, 17:07:12) 
[GCC 5.4.0 20160609] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import pytest
>>> 

小结

• 将requirements.txt中的attrs的版本修改为19.1.0

root@eve-ng:~/pkg_py# cat requirements.txt 

attrs-19.1.0-py2.py3-none-any.whl
funcsigs-1.0.2-py2.py3-none-any.whl
pluggy-0.6.0-py2-none-any.whl
py-1.8.1-py2.py3-none-any.whl
pytest-3.3.0-py2.py3-none-any.whl
setuptools-44.1.0-py2.py3-none-any.whl
six-1.14.0-py2.py3-none-any.whl
root@eve-ng:~/pkg_py# 

• 将pkg_py打包发到不能访问外网的主机上，按照requirements.txt安装

# pip install --no-index --find-links=./ -r requirements.txt