‘NoneType‘ object has no attribute ‘text‘

最新推荐文章于 2024-05-22 17:19:43 发布

kkkkkkkkkkaZZL

最新推荐文章于 2024-05-22 17:19:43 发布

阅读量1k

点赞数

分类专栏： python报错文章标签： python

本文链接：https://blog.csdn.net/m0_46499080/article/details/107741392

版权

python报错专栏收录该内容

4 篇文章 0 订阅

订阅专栏

python3
pycharm
小白写一个爬三国演义的代码，报这个错
说是content = div_tag.text这里'NoneType' object has no attribute 'text'
谁知道
原因竟然是detail_url = 'https://www.shicimingju.com/'+ li.a['href']多了一个/
这八竿子打不着啊。。。。

删掉后 detail_url = 'https://www.shicimingju.com'+ li.a['href'] 成功

结果：
在这里插入图片描述

from bs4 import BeautifulSoup
import requests

if __name__ == "__main__":
    headers = {
                             'User-Agent':'Mozilla/5.0(Windows NT 10.0;Win64;x64)AppleWebKit/537.36(KHTML,likeGecko)Chrome/83.0.4103.116Safari/537.36'
                }
    url = 'https://www.shicimingju.com/book/sanguoyanyi.html'
    res = requests.get(url=url,headers=headers)
    page_text = res.text
    # 实例化对象
    soup = BeautifulSoup(page_text,'lxml')
    # 解析
    li_list = soup.select('.book-mulu > ul > li')
    fp = open('./sanguo.text','w',encoding='utf-8')
    for li in li_list:
        title = li.a.string
        detail_url = 'https://www.shicimingju.com'+ li.a['href']
        # 对详情页发起请求
        detail_page_text = requests.get(url=detail_url,headers=headers).text
        # 解析出详情页内容
        detail_soup = BeautifulSoup(detail_page_text,'lxml')
        div_tag = detail_soup.find('div',class_='chapter_content')
        # 拿到内容
        content = div_tag.text
        fp.write(title+':'+content+'\n')
        print(title,'爬取成功!!')