Python爬取国家地理杂志的图片

一、简介：Python爬取国家地理杂志的图片

二、代码展示

from bs4 import BeautifulSoup
import requests
import os

os.mkdir('./img/')

URL = "http://www.nationalgeographic.com.cn/animals/"

html = requests.get(URL).text

soup = BeautifulSoup(html,'lxml')
img_ul = soup.findAll('ul',{"class":"img_list"})

for ul in img_ul:
    imgs = ul.findAll('img')
    for img in imgs:
        url = img['src']
        r = requests.get(url)
        image_name = url.split('/')[-1]
        with open('./img/%s' % image_name, 'wb') as f:
            #requests下载资源：以chunk大小下载，下载一点保存一点
            #r.iter_content(chunk_size=128)设置chunk大小
            for chunk in r.iter_content(chunk_size=128):
                f.write(chunk)
        print('Saved %s' % image_name)

三、代码重点讲解 

requests下载资源精简版：

r = requests.get(url)

#在当前目录img下新建img1.png，存放下载图片
with open('./img/img1.png','wb') as f:
    f.write(r.content)

四、参考链接

莫烦Python: 

https://morvanzhou.github.io/tutorials/data-manipulation/scraping/3-02-download/

https://github.com/MorvanZhou/easy-scraping-tutorial/blob/master/source_code/3-3-practice-download-images.py