Scrapy中多个Spider对应多个pipeline情况

在spider中配置：

# spider1
class WeiboSpider(scrapy.Spider):
    name = 'weibo'
    custom_settings = {
        'ITEM_PIPELINES': {
            'XwNewsCmnt.pipelines.XwnewscmntPipeline': 300
        }
    }
# spider2
class WeiboUserInfoSpider(scrapy.Spider):
    name = 'weibo_user_info'
    custom_settings = {
        'ITEM_PIPELINES': {
            'XwNewsCmnt.pipelines.XwnewsuserPipeline': 301
        }
    }

在settings里面也要配置pipeline：

ITEM_PIPELINES = {
    'XwNewsCmnt.pipelines.XwnewscmntPipeline': 300,
    'XwNewsCmnt.pipelines.XwnewsuserPipeline': 301,
}