pipelines
我们重写ImagesPipeline方法来实现将图片存到本地。
# 首先导包
import scrapy
from scrapy.pipelines.images import ImagesPipeline
# 重写方法
class Pictures360Pipeline(ImagesPipeline):
def get_media_requests(self, item, info):
image_link = item['thumb']
yield scrapy.Request(image_link)
Settings
添加图片存放路径
IMAGES_STORE = "/Users/renming/Desktop/scrapy/2_案例/3_360网图爬取/images"
IMAGES_STORE这个变量不能有一点错误