结合一位博主的分享,见链接
简单练习下X-path获取网站上图片URL信息和图片名称
源码:
import requests #导入requests
#网页支持get请求,使用requests中的get请求
url = “https://pic.netbian.com/4kdongman/index.html” #导入URL地址
headers = {“user-agent”:“Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3947.100 Safari/537.36”} #导入headers
res = requests.get(url,headers=headers).text.encode(“ISO-8859-1”) #获取URL,并且进行中文转码
from lxml import etree #导入Xpath
tree = etree.HTML(res) #实例化HTML
pictict = tree.xpath(‘//div[@class=“slist”]//li’) #获取
- 的数据
for list in pictict:
html = ‘https://pic.netbian.com’ + list.xpath(“./a/img/@src”)[0] #加网址,循环获取图片的url
name = list.xpath(“./a/img/@alt”)[0] + “.png” #获取图片名称
print(html, name) #把信息显示出来`