python没有错误但是不显示结果_scrapy脚本运行时没有出现(明显的)错误,但不包含数据...

evans-mbp:ourfirstscraper evanyamaguchi$ scrapy crawl redditbot2018-01-0413:24:53[scrapy.utils.log]INFO:Scrapy1.5.0started(bot:ourfirstscraper)2018-01-0413:24:53[scrapy.utils.log]INFO:Versions:lxml4.1.1.0,libxml22.9.7,cssselect1.0.3,parsel1.3.1,w3lib1.18.0,Twisted17.9.0,Python3.6.4(v3.6.4:d48ecebad5,Dec182017,21:07:28)-[GCC4.2.1(AppleInc.build5666)(dot3)],pyOpenSSL17.5.0(OpenSSL1.1.0g2Nov2017),cryptography2.1.4,PlatformDarwin-17.3.0-x86_64-i386-64bit2018-01-0413:24:53[scrapy.crawler]INFO:Overriddensettings:{'BOT_NAME':'ourfirstscraper','FEED_FORMAT':'csv','FEED_URI':'reddit.csv','NEWSPIDER_MODULE':'ourfirstscraper.spiders','ROBOTSTXT_OBEY':True,'SPIDER_MODULES':['ourfirstscraper.spiders']}2018-01-0413:24:53[scrapy.middleware]INFO:Enabledextensions:['scrapy.extensions.corestats.CoreStats','scrapy.extensions.telnet.TelnetConsole','scrapy.extensions.memusage.MemoryUsage','scrapy.extensions.feedexport.FeedExporter','scrapy.extensions.logstats.LogStats']2018-01-0413:24:53[scrapy.middleware]INFO:Enableddownloader middlewares:['scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware','scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware','scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware','scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware','scrapy.downloadermiddlewares.useragent.UserAgentMiddleware','scrapy.downloadermiddlewares.retry.RetryMiddleware','scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware','scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware','scrapy.downloadermiddlewares.redirect.RedirectMiddleware','scrapy.downloadermiddlewares.cookies.CookiesMiddleware','scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware','scrapy.downloadermiddlewares.stats.DownloaderStats']2018-01-0413:24:53[scrapy.middleware]INFO:Enabledspider middlewares:['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware','scrapy.spidermiddlewares.offsite.OffsiteMiddleware','scrapy.spidermiddlewares.referer.RefererMiddleware','scrapy.spidermiddlewares.urllength.UrlLengthMiddleware','scrapy.spidermiddlewares.depth.DepthMiddleware']2018-01-0413:24:53[scrapy.middleware]INFO:Enableditem pipelines:[]2018-01-0413:24:53[scrapy.core.engine]INFO:Spideropened2018-01-0413:24:53[scrapy.extensions.logstats]INFO:Crawled0pages(at0pages/min),scraped0items(at0items/min)2018-01-0413:24:53[scrapy.extensions.telnet]DEBUG:Telnetconsole listening on127.0.0.1:60232018-01-0413:24:53[scrapy.downloadermiddlewares.redirect]DEBUG:Redirecting(301)tofrom2018-01-0413:24:53[scrapy.core.engine]DEBUG:Crawled(200)(referer:None)2018-01-0413:24:53[scrapy.downloadermiddlewares.redirect]DEBUG:Redirecting(301)tofrom2018-01-0413:24:53[scrapy.core.engine]DEBUG:Crawled(200)(referer:None)2018-01-0413:24:53[scrapy.core.engine]INFO:Closingspider(finished)2018-01-0413:24:53[scrapy.statscollectors]INFO:DumpingScrapystats:{'downloader/request_bytes':945,'downloader/request_count':4,'downloader/request_method_count/GET':4,'downloader/response_bytes':36092,'downloader/response_count':4,'downloader/response_status_count/200':2,'downloader/response_status_count/301':2,'finish_reason':'finished','finish_time':datetime.datetime(2018,1,4,18,24,53,755172),'log_count/DEBUG':5,'log_count/INFO':7,'memusage/max':66359296,'memusage/startup':66359296,'response_received_count':2,'scheduler/dequeued':2,'scheduler/dequeued/memory':2,'scheduler/enqueued':2,'scheduler/enqueued/memory':2,'start_time':datetime.datetime(2018,1,4,18,24,53,205879)}2018-01-0413:24:53[scrapy.core.engine]INFO:Spiderclosed(finished)

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值