爬虫
文章平均质量分 80
bihl.
长路漫漫,唯代码作伴
展开
-
队列爬取,实时爬取更新进度
from multiprocessing import Process,Queue,Lock import requests import time import random import multiprocessing as mp import re from lxml import etree from selenium import webdriver import more_itertools as mi from lxml.html import fromstring, tostring f..原创 2021-02-04 10:43:51 · 238 阅读 · 0 评论 -
多进程爬虫
from multiprocessing import Process,Queue,Manager import requests import time import random import multiprocessing as mp import re from lxml import etree from selenium import webdriver import more_itertools as mi from lxml.html import fromstring, tostring原创 2020-11-06 15:27:15 · 284 阅读 · 0 评论