htmlparser 读书笔记

htmlparser是一个纯的java写的html解析的库，它不依赖于其它的java库文件，主要用于改造或

提取html。

 

HTML Parser is a Java library used to parse HTML in either a linear or nested fashion. Primarily used for transformation or extraction, it features filters, visitors, custom tags and easy to use JavaBeans. It is a fast, robust and well tested package.

htmlparser提供了两个jar包，一个是htmllexer.jar，另一个是htmlparser.jar。

 

htmllexer.jar提供了一种轻量级的解析方法，只对html线性解析字符串、注释、标鉴。而htmlparser.jar提供了包括htmllexer.jar所实现的功能，同是支持嵌套的标鉴等复杂html解析。

 

To use the library, you will need to add either the htmllexer.jar or htmlparser.jar to your classpath when compiling and running. The htmllexer.jar provides low level access to generic string, remark and tag nodes on the page in a linear, flat, sequential manner. The htmlparser.jar, which includes the classes found in htmllexer.jar, provides access to a page as a sequence of nested differentiated tags containing string, remark and other tag nodes.

If your application requires only modest structural knowledge of the page, and is primarily concerned with individual, isolated nodes, you should consider using the lightweight lexer. But if your application requires knowledge of the nested structure of the page, for example processing tables, you will probably want to use the full parser.

 

htmlparser提供了提取（Extraction）与改造(TransFormation)两个功能.

 

更多信息请参考官方网站： http://htmlparser.sourceforge.net/

 

code segment如下:

 

Parser parser = new Parser(url); //url指定html文件的地址，可以是本地文件，也可以是网络文件
    parser.setEncoding("UTF-8");

 

NodeFilter selectFilter = new NodeClassFilter(SelectTag.class);
    NodeFilter textareaFilter = new NodeClassFilter(TextareaTag.class);
    NodeFilter inputFilter = new NodeClassFilter(InputTag.class);
    NodeFilter formFilter = new NodeClassFilter(FormTag.class);

HasAttributeFilter inputAttributeFilter = new HasAttributeFilter("type", "text");
    AndFilter andFilter = new AndFilter(inputFilter,inputAttributeFilter); //AndFilter,指定文本输入框标鉴

 

OrFilter lastFilter = new OrFilter();
    lastFilter.setPredicates(new NodeFilter[] { selectFilter, textareaFilter, andFilter, formFilter });
    NodeList nl = parser.parse(null);
    NodeList nodelist = nl.extractAllNodesThatMatch(lastFilter, true);//true提定是否递归match
    Node[] nodes = nodelist.toNodeArray();

 

ArrayList<String> result = new ArrayList<String>();

for (int i = 0; i < nodes.length; i++) {
      Node node = nodes[i];
      Tag tag = (Tag) node;
      if (tag instanceof FormTag) {
        tag.setAttribute("action", ""); //设定form标鉴的action地址
      } else if (tag instanceof SelectTag) {
        if (tag.toHtml().contains("multiple")) {
          ((SelectTag) tag).removeChild(tag.getChildren().size() - 1); // remove掉最后一个Node
        }
        result.add(tag.getAttribute("name"));
      } else {

    result.add(tag.getAttribute("name"));
      }
    }