https://www.jianshu.com/p/bfc6acf769d5
https://blog.csdn.net/wetest_tencent/article/details/51272981
proxies = {
‘http:’: ‘http://proxy_xxx.com:8090’
‘https’:’https://proxy.xxx.com:端口号’
‘http:’: ‘http://121.x.xxx.xxx‘,
‘https:’: ‘https://144.xxx.xxx.xxx’
}
两种格式,http 和 https
创建多进程调用map方法,开启多进程后爬取
https://family-treesy.github.io/2017/12/14/%E4%BB%8A%E6%97%A5%E5%A4%B4%E6%9D%A1/