(1)sv_item_exporter.py
首先,在spiders文件夹下,新建个文件,名叫:csv_item_exporter.py
里面内容为
from scrapy.conf import settings
from scrapy.exporters import CsvItemExporter
class MyProjectCsvItemExporter(CsvItemExporter):
def __init__(self, *args, **kwargs):
delimiter = settings.get('CSV_DELIMITER', ',')
kwargs['delimiter'] = delimiter
fields_to_export = settings.get('FIELDS_TO_EXPORT', [])
if fields_to_export:
kwargs['fields_to_export'] = fields_to_export
super(MyProjectCsvItemExporter, self).__init__(*args, **kwargs)
(2)设置settings.py配置
在settings.py后面加入下面代码
FEED_EXPORTERS = {
'csv': 'hotsale.spiders.csv_item_exporter.MyProjectCsvItemExporter',
}
FIELDS_TO_EXPORT = [
'sid',
'star',
'reviews',
'price',
'rank',
'title',
'salesrank'
]
FIELDS_TO_EXPORT=[]
这个排序字段更换成items.py里面的字段,按需要的顺序排列。