Python3-爬虫~selenium\phantomjs\爬取XX网页电影过程中向下滚动网页问题

最新推荐文章于 2020-12-07 11:51:40 发布

Arthur54271

最新推荐文章于 2020-12-07 11:51:40 发布

阅读量475

点赞数

分类专栏： Python3 爬虫 selenium 文章标签： scroll 爬虫 selenium phantomjs

本文链接：https://blog.csdn.net/zbrj12345/article/details/80365117

版权

Python3 同时被 3 个专栏收录

104 篇文章 0 订阅

订阅专栏

爬虫

40 篇文章 0 订阅

订阅专栏

selenium

10 篇文章 0 订阅

订阅专栏

from selenium import webdriver
import os,time

driver=webdriver.PhantomJS()

driver.get('https://movie.douban.com/typerank?type_name=%E5%89%A7%E6%83%85&type=11&interval_id=100:90&action=')
time.sleep(10)
driver.save_screenshot('douban/movie1.png')

#滚动条滚动
js='document.body.scrollTop=10000'
time.sleep(3)
driver.execute_script(js)
time.sleep(10)
driver.save_screenshot('douban/movie2.png')

content=driver.page_source

with open('douban/movie.html','w',encoding='utf-8') as f:
    f.write(content)

driver.quit()

/Library/Frameworks/Python.framework/Versions/3.6/bin/python3.6 /Users/apple/PycharmProjects/stage4/spider/2018_3_14/04scroll.py

Process finished with exit code 0