Selenium+Python实现百度热搜数据的获取

一，准备环境

• pycharm 2022.2

• python 3.10

• chromedriver

• selenium 4.3.0

• pymysql 0.7.11

• mysql 5.7

二，导入项目模块

import os
import pymysql
import datetime
from selenium import webdriver
from selenium.webdriver.common.by import By

三, 测试百度热搜接口是否通畅

url = 'https://top.baidu.com/board?tab=realtime'
res = requests.get(url)
print(res.status_code)

返回状态码为200即为接口通畅

四，进入百度热搜

options = webdriver.ChromeOptions()
options.add_experimental_option('useAutomationExtension', False)
options