【无标题】

最新推荐文章于 2024-10-02 10:53:34 发布

qq_33603542

最新推荐文章于 2024-10-02 10:53:34 发布

阅读量390

点赞数 9

文章标签： python

本文链接：https://blog.csdn.net/qq_33603542/article/details/135775724

版权

本文介绍了如何使用Python的DrissionPage和DataRecorder库爬取IT桔子网站的投资事件数据，但受限于会员权限，仅抓取前三页内容并进行数据记录。

摘要由CSDN通过智能技术生成

一个爬取桔子数据的，抛砖引玉，由于会员限制，好像只能前三页

import sys
from DrissionPage import ChromiumPage
from DataRecorder import Recorder
import time

import time
# 创建页面对象
page = ChromiumPage()
# 创建记录器对象
recorder = Recorder('data1.csv')

recorder.add_data(("时间", "company","hangye","lunci","jine","touzifang","guzhi","xaingqing"))
# 访问网页

page.get('https://www.itjuzi.com/investevent')
a = 0
while True:
    ele_rows = page.eles(".el-table__row")
    print(len(ele_rows))  # 当前页条数
    a = a+len(ele_rows)
    print(a)  # 当前页条数
    for ele_row in ele_rows:
        ele_cells = ele_row.eles('.cell')
        shijian = ele_cells[1].text
        gongsi = ele_cells[2].text
        hangye = ele_cells[3].text
        lunci = ele_cells[4].text
        jine = ele_cells[5].text
        touzifang = ele_cells[6].text
        guzhi = ele_cells[7].text
        xiangqing = ele_cells[8].text
        recorder.add_data((shijian, gongsi, hangye, lunci, jine, touzifang, guzhi, xiangqing))
    recorder.record()
    time.sleep(10)
    page.ele('.el-icon el-icon-arrow-right').click()