请教大佬淘宝图片爬虫错误
今天看视频跟着学写了一个淘宝图片爬虫,不知道怎么回事老是爬不下来。看了看代码,跟老师的一样,不知道为什么就爬不下来?
看了下执行结果,返回如下:
C:/Users/Administrator/PycharmProjects/pythonProject/淘宝.py
进程已结束,退出代码为 0
然后考虑打印 imglist,得到结果如下:
[]
[]
[]
[]
[]
进程已结束,退出代码为 0
看了下全是空,看来没有取到值,但是不知道原因是什么?检查了下代码好像也没错,哪位大佬给讲讲,谢谢
import urllib.request
import urllib.parse
import random
import re
import ssl
keyname=“上衣”
key=urllib.parse.quote(keyname)
uapools=[
“Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.22 Safari/537.36 SE 2.X MetaSr 1.0”,
“Mozilla/5.0 (Linux; Android 6.0.1; Moto G (4)) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.198 Mobile Safari/537.36”,
“Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; WOW64; Trident/6.0)”
]
def ua(uapools):
thisua=random.choice(uapools)
headers = (“User-Agent”,thisua)
opener = urllib.request.build_opener()
opener.addheaders = [headers]
urllib.request.install_opener(opener)
for i in range(5):
url=“https://s.taobao.com/search?q=”+key+"&s="+str(i44)
ua(uapools)
data=urllib.request.urlopen(url).read().decode(“UTF-8”,“ignore”)
pat=’“pic_url”:"//(.?)"’
imglist=re.compile(pat).findall(data)
print(imglist)
for j in range(len(imglist)):
thisimg=imglist[j]
thisimgurl="https://"+thisimg
localfile="E:\\Python\\练习\\淘宝网\\"+str(i)+str(j)+".jpg"
urllib.request.urlretrieve(thisimgurl,filename=localfile)