![](https://img-blog.csdnimg.cn/20201014180756918.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
爬虫
文章平均质量分 80
bihl.
长路漫漫,唯代码作伴
展开
-
队列爬取,实时爬取更新进度
from multiprocessing import Process,Queue,Lockimport requestsimport timeimport randomimport multiprocessing as mpimport refrom lxml import etreefrom selenium import webdriverimport more_itertools as mifrom lxml.html import fromstring, tostringf..原创 2021-02-04 10:43:51 · 218 阅读 · 0 评论 -
多进程爬虫
from multiprocessing import Process,Queue,Managerimport requestsimport timeimport randomimport multiprocessing as mpimport refrom lxml import etreefrom selenium import webdriverimport more_itertools as mifrom lxml.html import fromstring, tostring原创 2020-11-06 15:27:15 · 241 阅读 · 0 评论