打开京东商城,选择笔记本电脑区域,第一页的链接是 https://list.jd.com/list.html?cat=670,671,672&page=1,第二页page属性就变成了2,以此类推
查看网页源代码,接触过html的人很快就会发现链接图片的标签,格式如下:
<img width="220" height="220" data-img="1" data-lazy-img="//img14.360buyimg.com/n7/jfs/t10123/170/1203650051/249444/b4748f86/59ddb765N62523179.jpg">
那么对应的正则表达式就是
pattern = '<img width="220" height="220" data-img="1" data-lazy-img="//(.+?\.jpg)">'
()是指获取()里面的匹配内容,懒惰模式,只要遇到 . 就结束
代码:获取1-9页的商品图片
import re
import urllib.request
def catch_pic(url, page):
html = urllib.request.urlopen(url).read()
html = html.decode('utf-8')
pattern = '<img width="220" height="220" data-img="1" data-lazy-img="//(.+?\.jpg)">'
imagelist = re.compile(pattern).findall(html)
x = 1
for imageurl in imagelist:
imagename = "F:/pythonpic/jd_pic/" + str(page) + "_" + str(x) + ".jpg"
imageurl = "http://" + imageurl
try:
urllib.request.urlretrieve(imageurl, filename=imagename)
except urllib.error.URLError as e:
if hasattr(e, "code"):
x += 1
if hasattr(e, "reason"):
x += 1
x += 1
for i in range(1, 10):
url = "https://list.jd.com/list.html?cat=670,671,672&page=" + str(i)
catch_pic(url, i)