利用Nutch实现分类搜索（三）（加入query plugin）

 

此篇文章是把type字段的搜索加入到nutch中，到此所有工作即将完成，让我们看看如何做这一步。

在src/plugin/目录下加入query-type目录，其中的文件结构可以参考query-url，并作相应的修改。

加入TypeQueryFilter.java文件，目录层次为query-type/src/java/com/zju/repu/searcher/type/TypeQueryFilter.java，实现FieldQueryFilter接口。实现很简单。

package com.zju.repu.searcher.type; import org.apache.nutch.searcher.FieldQueryFilter; import org.apache.hadoop.conf.Configuration; import org.apache.commons.logging.Log; import org.apache.commons.logging.LogFactory; /** * Handles "type:" query clauses, causing them to search the field indexed by * BasicIndexingFilter. */ public class TypeQueryFilter extends FieldQueryFilter { public static final Log LOG = LogFactory.getLog(TypeQueryFilter.class); public TypeQueryFilter() { super("type"); LOG.info ("Added type"); } public void setConf(Configuration conf) { super.setConf(conf); } }  

加入build.xml。

<?xml version="1.0"?> <project name="query-type" default="jar-core"> <import file="../build-plugin.xml"/> </project>  

加入plugin.xml，注意extention point是"org.apache.nutch.searcher.QueryFilter"，是TypeQueryFilter的公共的接口。

<?xml version="1.0" encoding="UTF-8"?> <plugin id="query-type" name="Type Query Filter" version="1.0.0" provider-name="repu.zju.com"> <runtime> <library name="query-type.jar"> <export name="*"/> </library> </runtime> <requires> <import plugin="nutch-extensionpoints"/> </requires> <extension id="com.zju.repu.searcher.type.TypeQueryFilter" name="Nutch Type Query Filter" point="org.apache.nutch.searcher.QueryFilter"> <implementation id="TypeQueryFilter" class="com.zju.repu.searcher.type.TypeQueryFilter"> <parameter name="fields" value="type"/> </implementation> </extension> </plugin>  

另外还需要把这个query-type加入编译系统，修改src/plugin/build.xml，添加如下编译入口：

<target name="deploy"> <ant dir="query-type" target="deploy"/> </target> <target name="clean"> <ant dir="query-type" target="clean"/> </target> 

利用如下代码测试搜索功能：

public SearchResultItem[] processOrder (String inStr) { // Do processing... System.out.println ("processOrder called for customer, inStr=" + inStr); SearchResults searchResults = new SearchResults (); try { // configure nutch Configuration nutchConf = NutchConfiguration.create (); NutchBean nutchBean = new NutchBean (nutchConf); Query nutchQuery = new Query (nutchConf); nutchQuery.addRequiredTerm (inStr, "type"); nutchQuery.getParams ().setMaxHitsPerDup (100); Hits nutchHits = nutchBean.search (nutchQuery); System.out.println ("Search for " + inStr); // display the number of hits System.out.println ("Found " + nutchHits.getLength () + " hits."); // get the details about each hit (includes title, URL, a summary // and the date when this was fetched) for (int i = 0; i < nutchHits.getLength (); i++) { Hit hit = nutchHits.getHit (i); HitDetails details = nutchBean.getDetails (hit); String title = details.getValue ("title"); String url = details.getValue ("url"); String summary = nutchBean.getSummary (details, nutchQuery) .toString (); System.out.println ("Title is: " + title); System.out.println ("(" + url + ")"); Date date = new Date (nutchBean.getFetchDate (details)); System.out.println ("Date Fetched: " + date); System.out.println (summary + "/n"); System.out.println ("----------------------------------------"); searchResults.add (title, url, summary); } nutchBean.close (); } catch (Throwable e) { e.printStackTrace (); } return searchResults.toArray (); }  

至此，大功告成！