Python爬虫之路5.etree爬图片（2022.1.14）

最新推荐文章于 2023-08-03 16:12:05 发布

lixuefei_1993

最新推荐文章于 2023-08-03 16:12:05 发布

阅读量339

点赞数

分类专栏： python爬虫文章标签： python 爬虫开发语言

本文链接：https://blog.csdn.net/lixuefei_1993/article/details/122492682

版权

python爬虫专栏收录该内容

13 篇文章 0 订阅

订阅专栏

# 爬壁纸
import requests
from lxml import etree
import os
url = "https://pic.netbian.com/4kdongman/"
headers = {
    "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36"
}
page_text = requests.get(url=url,headers=headers).text
tree = etree.HTML(page_text)

li_list = tree.xpath('//div[@class="slist"]/ul/li')
if not os.path.exists("pic_libs"):
    os.mkdir("pic_libs")
for li in li_list:
    #https://pic.netbian.com/uploads/allimg/220111/002720-1641832040faa9.jpg
    pic_src ="https://pic.netbian.com" + li.xpath('./a/img/@src')[0]
    pic_name = li.xpath('./a/img/@src')[0]
    pic_name = pic_name.encode('iso-8859-1').decode('gbk')
    img_name = pic_name.split("/",-1)[-1]
    print(pic_name)
    # 将图片文件保存到本地
    img_data = requests.get(url=pic_src,headers=headers).content
    img_path = "pic_libs/" + img_name
    with open(img_path, "wb") as f:
        f.write(img_data)
        print("ok")