***注意点:一定要关闭fidder等抓包软件,才能使用 ***
文章目录
1、爬百度图片
import requests
import re
import os
import time
headers = {'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.125 Safari/537.36'}
name = input('您要爬取什么图片')
num = 0
x = input('您要爬取几张呢?,输入1等于60张图片。')
for i in range(int(x)):
name_1 = 'D:\\图片\\'
url = 'https://image.baidu.com/search/flip?tn=baiduimage&ie=utf-8&word='+name+'&pn='+str(i*30)
res = requests.get(url,headers=headers)
htlm_1 = res.content.decode()
a = re.findall('"objURL":"(.*?)",',htlm_1)
if not os.path.exists(name_1):
os.makedirs(name_1)
for b in a:
num = num +1
try:
img = requests.get(b)
except Exception as e:
print('第'+str(num)+'张图片无法下载------------')
print(str(e))
continue
f = open(name_1+name+str(num)+'.jpg','ab')
print('---------正在下载第'+str(num)+'张图片----------')
f.write(img.content)
f.close()
print('下载完成')
1.1、需要修改内容:header的内容
header地址:headers–request headers user-Agent
1.2一定一定一定要关闭fiddler等抓包软件,以免证书问题报错
以下是下载展示
2、爬下图片后,有的格式和内容不符合,则删除,再重新对图片进行命名
参考地址:
https://www.jianshu.com/p/6e4000a7066c
3、把图片拖到服务器文件下载路径,再应用到数据库。
作者地址:https://blog.csdn.net/m0_48968928/article/details/108219554?ops_request_misc=%257B%2522request%255Fid%2522%253A%2522161406019416780266265398%2522%252C%2522scm%2522%253A%252220140713.130102334.pc%255Fall.%2522%257D&request_id=161406019416780266265398&biz_id=0&utm_medium=distribute.pc_search_result.none-task-blog-2allfirst_rank_v2~rank_v29_name-2-108219554.pc_search_result_before_js&utm_term=%E7%88%AC%E7%99%BE%E5%BA%A6%E4%B9%A0%E5%A4%A7%E5%A4%A7%E7%85%A7%E7%89%87