WebCollector 爬百度搜索关键字排名为何过几天返回结果全部是0? 10C

最新推荐文章于 2021-07-11 21:54:39 发布

你好大师

最新推荐文章于 2021-07-11 21:54:39 发布

阅读量782

点赞数

分类专栏： Java

本文链接：https://blog.csdn.net/sj7121/article/details/77249153

版权

Java 专栏收录该内容

1 篇文章 0 订阅

订阅专栏

WebCollector 爬百度搜索关键字排名为何过几天返回结果全部是0?
重启服务又好了,是哪里设置不对还是百度封掉了呢? ?

2017-08-16 00:02:04.582 [INFO] [default task-6] [com.egou.admin.impl.webcollector.facade.BaicrawlersFacadeServiceImpl.startGetResult():242] 屏风隔断效果图
2017-08-16 00:02:04.696 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawler.Crawler.start():104] start depth 1
2017-08-16 00:02:04.696 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():348] open generator:cn.edu.hfut.dmic.webcollector.plugin.ram.RamGenerator
2017-08-16 00:02:04.697 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():350] init segmentWriter:cn.edu.hfut.dmic.webcollector.plugin.ram.RamDBManager
2017-08-16 00:02:05.703 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():372] -activeThreads=0, spinWaiting=0, fetchQueue.size=0
2017-08-16 00:02:05.703 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():413] clear all activeThread
2017-08-16 00:02:05.704 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():418] close generator:cn.edu.hfut.dmic.webcollector.plugin.ram.RamGenerator
2017-08-16 00:02:05.704 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():420] close segmentwriter:cn.edu.hfut.dmic.webcollector.plugin.ram.RamDBManager
2017-08-16 00:02:05.705 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawldb.DBManager.merge():75] start merge
2017-08-16 00:02:05.705 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawldb.DBManager.merge():78] merge fetch database
2017-08-16 00:02:05.705 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawldb.DBManager.merge():84] merge link database
2017-08-16 00:02:05.706 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawldb.DBManager.merge():91] end merge
2017-08-16 00:02:05.706 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawler.Crawler.start():126] depth 1 finish: