Python xpath爬取天气预报与存储

最新推荐文章于 2022-08-07 22:57:31 发布

狮子雨恋

最新推荐文章于 2022-08-07 22:57:31 发布

阅读量454

点赞数 1

分类专栏： Python爬虫笔记 python笔记

本文链接：https://blog.csdn.net/qq_42692319/article/details/109336597

版权

这篇博客中，作者分享了自己在使用Python xpath爬取天气预报时遇到的错误及修正过程。虽然无人发现程序的错误，但作者自我反省并提供了含有两处明显错误的代码段，鼓励读者帮助找出可能存在的其他问题。

摘要由CSDN通过智能技术生成

还好没人看到这个程序有错，哈哈哈
纠正程序如下:

# -*- coding: utf-8 -*-
"""
Created on Wed Oct 28 10:54:06 2020

@author: YuDi
"""

import requests
from lxml import etree
import time
import xlwt
headers = {
   
     'User-Agent':'Mozilla/5.0'}
url = "http://www.weather.com.cn/weather/101280101.shtml"
response = requests.get(url,headers=headers)
content = response.content.decode('utf-8')
html = etree.HTML(content)
weather_list = []
res = html.xpath('//div[@id="7d"]/ul/li')
for re in res:
    weather_day = re.xpath('.//h1/text()')[0]
    weather_wea = re.xpath('.//p[@class="wea"]/text()')[0]
    if re.xpath('.//p[@class="tem"]/span/text()'):
         weather_tem_max = re.xpath('.//p[@class="tem"]/span/text()')[0]
    else:
        weather_tem_max = re.xpath('.//p[@class="tem"]/i/text()')[0]
    weather_tem_min = re.xpath('.//p[@class="tem"]/i/text()')[0]
    weather_win1 = re.xpath('.//p[@class="win"]/em/span/@title')[0]
    try:
        weather_win2 = re.xpath('.//p[@class="win"]/em/span/@title')