lucene入门代码六（使用FastVectorHighlighter高亮）

最新推荐文章于 2021-07-01 20:19:56 发布

iteye_19207

最新推荐文章于 2021-07-01 20:19:56 发布

阅读量799

点赞数

分类专栏： Apache lucene 文章标签： lucene apache FastVectorHighlighter

本文链接：https://blog.csdn.net/iteye_19207/article/details/82338154

版权

Apache lucene 专栏收录该内容

7 篇文章 0 订阅

订阅专栏

1.本代码需要的jar包有：
[color=red]lucene-fast-vector-highlighter-3.0.0.jar[/color]
[color=green]lucene-core-3.0.0.jar
lucene-analyzers-3.0.0.jar
[/color]

[color=red]2.为什么要使用FastVectorHighlighter？[/color]
[color=green]Highlighter是流行和广泛使用的Lucene应用，但索引大文件时，Highlighter是相当费时的，如果增加字符数分析与setMaxDocCharsToAnalyze。替代Highlighter，FastVectorHighlighter首次增加在Lucene的2.9版本，并提供更快的性能。超过Highlighte的FastVectorHighlighter的优势不仅是速度但也在功能上。首先，FastVectorHighlighter可以支持字段是记号化ngram断词。Highlighter不能支持的非常好。二，更有趣的是，FastVectorHighlighter可以输出五彩标记凸显出来，FastVectorHighlighter可以支持“per phrase”标记，而不是“per term”的标签。[/color]
代码如下：


package com.yale.lucene;

import java.io.FileWriter;

import org.apache.lucene.analysis.Analyzer;
import org.apache.lucene.analysis.standard.StandardAnalyzer;
import org.apache.lucene.document.Document;
import org.apache.lucene.document.Field;
import org.apache.lucene.document.Field.Index;
import org.apache.lucene.document.Field.Store;
import org.apache.lucene.document.Field.TermVector;
import org.apache.lucene.index.IndexWriter;
import org.apache.lucene.index.IndexWriter.MaxFieldLength;
import org.apache.lucene.queryParser.QueryParser;
import org.apache.lucene.search.IndexSearcher;
import org.apache.lucene.search.Query;
import org.apache.lucene.search.ScoreDoc;
import org.apache.lucene.search.TopDocs;
import org.apache.lucene.search.vectorhighlight.BaseFragmentsBuilder;
import org.apache.lucene.search.vectorhighlight.FastVectorHighlighter;
import org.apache.lucene.search.vectorhighlight.FieldQuery;
import org.apache.lucene.search.vectorhighlight.FragListBuilder;
import org.apache.lucene.search.vectorhighlight.FragmentsBuilder;
import org.apache.lucene.search.vectorhighlight.ScoreOrderFragmentsBuilder;
import org.apache.lucene.search.vectorhighlight.SimpleFragListBuilder;
import org.apache.lucene.store.Directory;
import org.apache.lucene.store.RAMDirectory;
import org.apache.lucene.util.Version;
/**
 * 
 * 使用FastVectorHighlighter高亮
 *
 */
public class FastVectorHighlighterSample
{
	static final String[] DOCS = {
			"the quick brown fox jumps over the lazy dog",
			"the quick gold fox jumped over the lazy black dog",
			"the quick fox jumps over the black dog",
			"the red fox jumped over the lazy dark gray dog" };
	static final String QUERY = "quick OR fox OR \"lazy dog\"~1";
	static final String F = "f";
	static Directory dir = new RAMDirectory();
	static Analyzer analyzer = new StandardAnalyzer(Version.LUCENE_30);
	static String FILENAME = "F://新建文件夹//luceneTest//dataSource//highlight.html";

	public static void main(String[] args) throws Exception
	{
		// 创建索引
		makeIndex();
		// 搜索
		searchIndex(FILENAME);
	}

	static void makeIndex() throws Exception
	{
		IndexWriter writer = new IndexWriter(dir, analyzer, true,
				MaxFieldLength.UNLIMITED);
		for (String d : DOCS)
		{
			Document doc = new Document();
			doc.add(new Field(F, d, Store.YES, Index.ANALYZED,
					TermVector.WITH_POSITIONS_OFFSETS));
			writer.addDocument(doc);
		}
		writer.close();

	}

	static void searchIndex(String filename) throws Exception
	{
		QueryParser parser = new QueryParser(Version.LUCENE_30, F, analyzer);
		Query query = parser.parse(QUERY);
		FastVectorHighlighter highlighter = getHighlighter();
		FieldQuery fieldQuery = highlighter.getFieldQuery(query);
		IndexSearcher searcher = new IndexSearcher(dir);
		TopDocs docs = searcher.search(query, 10);
		FileWriter writer = new FileWriter(filename);
		writer.write("<html>");
		writer.write("<body>");
		writer.write("<p>QUERY : " + QUERY + "</p>");
		for (ScoreDoc scoreDoc : docs.scoreDocs)
		{
			String snippet = highlighter.getBestFragment(fieldQuery,
					searcher.getIndexReader(), scoreDoc.doc, F, 100);
			if (snippet != null)
			{
				writer.write(scoreDoc.doc + " : " + snippet + "<br/>");
			}
		}
		writer.write("</body></html>");
		writer.close();
		searcher.close();
		System.out.println("完成");
	}

	static FastVectorHighlighter getHighlighter()
	{
		FragListBuilder fragListBuilder = new SimpleFragListBuilder();
		FragmentsBuilder fragmentsBuilder = new ScoreOrderFragmentsBuilder(
				BaseFragmentsBuilder.COLORED_PRE_TAGS,
				BaseFragmentsBuilder.COLORED_POST_TAGS);
		return new FastVectorHighlighter(true, true, fragListBuilder,
				fragmentsBuilder);
	}

}

效果图如下：

[img]http://dl.iteye.com/upload/attachment/0069/0401/da7d6765-3501-3d60-8c63-293810fe7c2d.png[/img]

iteye_19207

关注

0
点赞
踩
1

收藏

觉得还不错? 一键收藏
0
评论
lucene入门代码六（使用FastVectorHighlighter高亮）

1.本代码需要的jar包有： [color=red]lucene-fast-vector-highlighter-3.0.0.jar[/color][color=green]lucene-core-3.0.0.jar lucene-analyzers-3.0.0.jar [/color][color=red]2.为什么要使用FastVectorHighlighter？[/c...
复制链接

扫一扫