xpath应用(一）58同城二手房网页房屋信息爬取

最新推荐文章于 2024-07-30 16:50:04 发布

离落想AC

最新推荐文章于 2024-07-30 16:50:04 发布

阅读量438

点赞数 2

分类专栏：爬虫文章标签： xpath python

本文链接：https://blog.csdn.net/xiaotiancaililuo/article/details/116940567

版权

爬虫专栏收录该内容

11 篇文章 0 订阅

订阅专栏

话不多说，上代码！！！

# -*- coding: UTF-8 -*-
# @Time : 2021/5/17 10:25
# @Author : 李如旭
# @File ：58tc.py
# @Software: PyCharm


import  requests
from lxml import etree
if __name__=='__main__':
    #获取数据
    headers = {
        'User-Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3947.100 Safari/537.36'
    }
    url = 'https://zb.58.com/ershoufang/'
    page_text = requests.get(url=url,headers=headers).text
    #实例化对象
    tree = etree.HTML(page_text)
    #获取标签数据，标签定位
    a_list = tree.xpath('//div[@class="property"]/a')
    fp = open('./58.text','w',encoding='utf-8')
    for a in a_list:
        title = a.xpath('./div[2]/div[1]/div[1]/h3/text()')[0]
        price = a.xpath('./div[2]/div[2]/p[@class="property-price-total"]/span[1]/text()')[0]+'万'
        print(title)
        print(price)
        fp.write(title)
        fp.write(price + '\n')