Python爬虫（六）爬京东商品图片

打开京东商城，选择笔记本电脑区域，第一页的链接是 https://list.jd.com/list.html?cat=670,671,672&page=1，第二页page属性就变成了2，以此类推

查看网页源代码，接触过html的人很快就会发现链接图片的标签，格式如下：

<img width="220" height="220" data-img="1" data-lazy-img="//img14.360buyimg.com/n7/jfs/t10123/170/1203650051/249444/b4748f86/59ddb765N62523179.jpg">

那么对应的正则表达式就是

pattern = '<img width="220" height="220" data-img="1" data-lazy-img="//(.+?\.jpg)">'

()是指获取()里面的匹配内容，懒惰模式，只要遇到 . 就结束

代码：获取1-9页的商品图片

import re
import urllib.request


def catch_pic(url, page):
    html = urllib.request.urlopen(url).read()
    html = html.decode('utf-8')
    pattern = '<img width="220" height="220" data-img="1" data-lazy-img="//(.+?\.jpg)">'

    imagelist = re.compile(pattern).findall(html)
    x = 1
    for imageurl in imagelist:
        imagename = "F:/pythonpic/jd_pic/" + str(page) + "_" + str(x) + ".jpg"
        imageurl = "http://" + imageurl
        try:
            urllib.request.urlretrieve(imageurl, filename=imagename)
        except urllib.error.URLError as e:
            if hasattr(e, "code"):
                x += 1
            if hasattr(e, "reason"):
                x += 1
        x += 1


for i in range(1, 10):
    url = "https://list.jd.com/list.html?cat=670,671,672&page=" + str(i)
    catch_pic(url, i)