nutch中使用的是插件来进行正文提取的,在nutch的源代码中找不到正文提取的源代码。只有在plugins中才有正文提取模块。
plugins中调用的是org.w3c.dom的包来进行正文提取的。这是一个用来解析xml的包。 html是xml的一个子集,自然也可以拿它来分析。
首先,介绍下什么是dom.
DOM stans for Document Object Model.
The DOM presents an HTML document as a tree-structure (a node tree), with elements, attributes, and text.
然后是SAX.
SAX, the Simple API for XML, is a standard interface for event-based XML parsing, developed collaboratively by the members of the XML-DEV mailing list, currently hosted by OASIS.
(未完待续,等有时间补上。。。)