爬取起点中文网的小说

最新推荐文章于 2024-04-16 06:05:59 发布

weixin_43716908

最新推荐文章于 2024-04-16 06:05:59 发布

阅读量626

点赞数

分类专栏：爬虫文章标签： python

本文链接：https://blog.csdn.net/weixin_43716908/article/details/84402558

版权

爬虫专栏收录该内容

1 篇文章 0 订阅

订阅专栏

运行无反应，也不报错，啥毛病??

import xlwt
import requests
from lxml import etree
import time

all_info_list=[]
def get_info(url):
    html=requests.get(url)
    selector=etree.HTML(html.text)
    infos=selector.xpath('//ul[@class="all_img_list cf"]/li')
    for info in infos:
        title=info.xpath('div[2]/h4/a/text()')[0]
        author=info.xpath('div[2]/p[1]/a[1]/text()')[0]
        style_1=info.xpath('div[2]/p[1]/a[2]/text()')[0]
        style_2=info.xpath('div[2]/p[1]/a[3]/text()')[0]
        style=style_1+'.'+style_2
        complete=info.xpath('div[2]/p[1]/span[1]/text()')
        introduce=info.xpath('div[2]/p[2]')[0].strip()
        word=info.xpath('div[2]/p[3]/span/span[1]/text()')[0].strip('万字')
        info_list=['title','author','style','complete','imtroduce','word']
        all_info_list.append(info_list)
    time.sleep(3)
if __name__=="__main__":
    urls=['https://www.qidian.com/all?page={}'.format(str(i)) for i 
    in range(1,29655)]
    for url in urls:
        get_info(url)
    header=['title','author','style','complete','introduce','word'] 
    book=xlwt.Workbook(encoding='utf-8')
    sheet=book.add_sheet('Sheet1')
    for h in range(len(header)):
        sheet.write(0,h,header[h])
    i=1
    for list in all_info_list:
        j=0
        for data in list:
            sheet.write(i,j,data)
            j+=1
        i+=1
book.save('H:/python/xiaoshuo.xls')