agentpool
Python打造自己的爬虫代理池
agentpool是基于python3.7版本的。
安装python3.7
yum -y install gcc gcc-c++ make zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel db4-devel libpcap-devel xz-devel libffi-devel mariadb mariadb-server mariadb-devel
wget https://www.python.org/ftp/python/3.7.2/Python-3.7.2.tgz
tar -zxvf Python-3.7.0.tgz
cd Python-3.7.0
./configure
make && make install
python3 -V