本文介绍了如何使用Python3的selenium库来爬取一个包含动态加载内容的在线试卷网站，详细解析了爬取过程和技术要点。
from selenium import webdriver
import pymongo
import json
import time
import re
# 使用终极武器了.
# 修改头文件，防止被识别为爬虫
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
class Zujuan(object):
def __init__(self):
self.list = ["question_id", "question_type", "question_channel_type", "question_status", "chid", "xd",
"parent_id",
"is_objective", "difficult_index", "master_level", "exam_type", "evaluated", "region_ids",
"grade_id",
"question_source", "mode", "kid_num", "paperid", "save_num", "oldqid", "paper", "list",
"extra_file",
import pymongo
import json
import time
import re
# 使用终极武器了.
# 修改头文件，防止被识别为爬虫
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
class Zujuan(object):
def __init__(self):
self.list = ["question_id", "question_type", "question_channel_type", "question_status", "chid", "xd",
"parent_id",
"is_objective", "difficult_index", "master_level", "exam_type", "evaluated", "region_ids",
"grade_id",
"question_source", "mode", "kid_num", "paperid", "save_num", "oldqid", "paper", "list",
"extra_file",
最低0.47元/天 解锁文章
810
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
