转载了一个斗图深神器的爬虫

源哥学

于 2021-03-25 16:10:16 发布

阅读量115

点赞数

分类专栏：好玩文章标签： python

原文链接：https://blog.csdn.net/zhiguigu/article/details/115068468?utm_medium=distribute.pc_category.none-task-blog-hot-2.nonecase&dist_request_id=1328270.10288.16166597046855021&depth_1-utm_source=distribute.pc_category.none-task-blog-hot-2.nonecase

版权

好玩专栏收录该内容

2 篇文章 0 订阅

订阅专栏

原创作者:玛森教育

import os
import requests
from bs4 import BeautifulSoup
if not os.path.exists('./images/'):
    os.mkdir('./images/')

headers={
'user-agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36'
}
url = 'https://fabiaoqing.com/biaoqing/lists/page/5.html'

response = requests.get(url, headers = headers).text

soup = BeautifulSoup(response)

img_list = soup.find_all('img',class_='ui image lazy')

for img in img_list:
    img_url = img['data-original']
    img_title = img['title']
    print(img_url,img_title)

    try:
        with open('./images/' + img_title+os.path.splitext(img_url)[-1],'wb') as f:
             image = requests.get(img_url,headers=headers).content
             f.write(image)
             print('保存成功',img_title)
    except:
        pass