selenium -- 智能等待

是大嘟嘟呀

已于 2022-06-14 16:13:19 修改

阅读量9.1k

点赞数 1

分类专栏：网络爬虫文章标签： selenium python 测试工具

于 2022-02-14 12:01:57 首次发布

本文链接：https://blog.csdn.net/MarkAdc/article/details/122921813

版权

网络爬虫专栏收录该内容

29 篇文章 5 订阅

订阅专栏

代码

# -*- coding: utf-8 -*-
# @Author   : zbz

url = "https://www.amazon.com/product-reviews/B091F3815B/ref=cm_cr_arp_d_viewopt_fmt?formatType=current_format"

from selenium.webdriver import Chrome, ChromeOptions
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By

options = ChromeOptions()
options.add_experimental_option('excludeSwitches', ['enable-automation'])
options.add_experimental_option('useAutomationExtension', False)
options.add_argument('lang=en-us')
options.add_argument("--headless")
browser = Chrome(options=options)
browser.execute_cdp_cmd("Page.addScriptToEvaluateOnNewDocument", {
    "source": """
    Object.defineProperty(navigator, 'webdriver', {
      get: () => undefined
    })
  """
})
browser.get(url)
try:
    element = WebDriverWait(browser, 3).until(
        lambda x: x.find_element(By.XPATH, '//div[@data-hook="cr-filter-info-review-rating-count"]')
    )
    print(element.text)
except Exception as e:
    print(type(e))
    print(e)