nutch存储数据文件sequencefile mapfile对应keyValue

最新推荐文章于 2024-10-16 10:13:45 发布

lan_13217

最新推荐文章于 2024-10-16 10:13:45 发布

阅读量96

点赞数

分类专栏： nutch 文章标签： java 大数据

本文链接：https://blog.csdn.net/lan_13217/article/details/84485503

版权

nutch 专栏收录该内容

1 篇文章 0 订阅

订阅专栏


crawldb
(org.apache.hadoop.io.Text,org.apache.nutch.crawl.CrawlDatum)
segments/content
(org.apache.hadoop.io.Text,org.apache.nutch.protocol.Content)
segments/crawl_fetch
(org.apache.hadoop.io.Text,org.apache.nutch.crawl.CrawlDatum)
segments/parse_data
(org.apache.hadoop.io.Text,org.apache.nutch.parse.ParseData)
segments/parse_text
(org.apache.hadoop.io.Text,org.apache.nutch.parse.ParseText)
segments/crawl_generate
(org.apache.hadoop.io.Text,org.apache.nutch.crawl.CrawlDatum)
segments/crawl_parse
(org.apache.hadoop.io.Text,org.apache.nutch.crawl.CrawlDatum)

[url]https://github.com/apache/nutch/blob/branch-1.7/src/java/org/apache/nutch/crawl/CrawlDatum.java[/url]

[url]https://github.com/apache/nutch/blob/branch-1.7/src/java/org/apache/nutch/protocol/Content.java[/url]

[url]https://github.com/apache/nutch/blob/branch-1.7/src/java/org/apache/nutch/parse/ParseData.java[/url]

[url]https://github.com/apache/nutch/blob/branch-1.7/src/java/org/apache/nutch/parse/ParseText.java[/url]