linux scrapy 运行,scrapyd找不到文件,win10,linux运行没问题,scrapyd部署后就不行了?...

2019-03-11 10:00:41 [scrapy.utils.log] INFO: Scrapy 1.6.0 started (bot: china_canton_railway)

2019-03-11 10:00:41 [scrapy.utils.log] INFO: Versions: lxml 3.7.2.0, libxml2 2.9.4, cssselect 1.0.3, parsel 1.5.1, w3lib 1.20.0, Twisted 18.9.0, Python 3.6.0 |Anaconda 4.3.1 (64-bit)| (default, Dec 23 2016, 12:22:00) - [GCC 4.4.7 20120313 (Red Hat 4.4.7-1)], pyOpenSSL 16.2.0 (OpenSSL 1.1.1b 26 Feb 2019), cryptography 2.6.1, Platform Linux-3.10.0-862.14.4.el7.x86_64-x86_64-with-centos-7.5.1804-Core

2019-03-11 10:00:41 [scrapy.crawler] INFO: Overridden settings: {‘BOT_NAME’: ‘china_canton_railway’, ‘COMMANDS_MODULE’: ‘china_canton_railway.commands’, ‘DOWNLOAD_DELAY’: 0.3, ‘LOG_FILE’: ‘logs/china_canton_test/guangzhou_erqi_spider/78b6048e43a111e980a3fa163ea6ef8a.log’, ‘NEWSPIDER_MODULE’: ‘china_canton_railway.spiders’, ‘SPIDER_MODULES’: [‘china_canton_railway.spiders’]}

2019-03-11 10:00:41 [scrapy.extensions.telnet] INFO: Telnet Password: 04ecbfec93b2c400

2019-03-11 10:00:41 [scrapy.middleware] INFO: Enabled extensions:

[‘scrapy.extensions.corestats.CoreStats’,

‘scrapy.extensions.telnet.TelnetConsole’,

‘scrapy.extensions.memusage.MemoryUsage’,

‘scrapy.extensions.logstats.LogStats’]

2019-03-11 10:00:41 [twisted] CRITICAL: Unhandled error in Deferred:

2019-03-11 10:00:41 [twisted] CRITICAL:

Traceback (most recent call last):

File “/usr/local/anaconda3/lib/python3.6/site-packages/twisted/internet/defer.py”, line 1418, in _inlineCallbacks

result = g.send(result)

File “/usr/local/anaconda3/lib/python3.6/site-packages/scrapy/crawler.py”, line 79, in crawl

self.spider = self._create_spider(*args, **kwargs)

File “/usr/local/anaconda3/lib/python3.6/site-packages/scrapy/crawler.py”, line 102, in _create_spider

return self.spidercls.from_crawler(self, *args, **kwargs)

File “/usr/local/anaconda3/lib/python3.6/site-packages/scrapy/spiders/init.py”, line 51, in from_crawler

spider = cls(*args, **kwargs)

File “/tmp/china_canton_test-1552269621-sk6exnce.egg/china_canton_railway/spiders/guagzhou_erqi.py”, line 10, in init

File “/tmp/china_canton_test-1552269621-sk6exnce.egg/china_canton_railway/spiders/common_spider.py”, line 27, in init

File “/tmp/china_canton_test-1552269621-sk6exnce.egg/utils/city_data.py”, line 6, in get_city_dict

FileNotFoundError: [Errno 2] No such file or directory: ‘city_id.txt’

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值