分布式搜索Lily安装与配置

http://blog.csdn.net/morning_pig/article/details/8569842

参考文档：

http://docs.ngdata.com/lily-docs-current/414-lily/432-lily.html

1.Installing Hadoop, HBase and ZooKeeper

此处省略几百字...

2.HBase: deploy extra jars

copy以下包到hbase lib下：

[html]  view plain copy

1. lib/org/lilyproject/lily-hbase-ext/2.0/lily-hbase-ext-2.0.jar  
2. lib/org/lilyproject/lily-bytes/2.0/lily-bytes-2.0.jar  
3. lib/org/lilyproject/lily-util/2.0/lily-util-2.0.jar  
4. lib/org/lilyproject/lily-repository-api/2.0/lily-repository-api-2.0.jar  
5. lib/org/lilyproject/lily-repository-id-impl/2.0/lily-repository-id-impl-2.0.jar  
6. lib/org/lilyproject/lily-hbaseindex-base/2.0/lily-hbaseindex-base-2.0.jar  
7. lib/com/gotometrics/orderly/orderly/0.11/orderly-0.11.jar  
8. lib/org/lilyproject/lily-indexer-derefmap-indexfilter/2.0/lily-indexer-derefmap-indexfilter-2.0.jar  

3.Hadoop: cleanup old Avro jars

[html]  view plain copy

1. $find /usr/lib/hadoop* -name "avro*jar" -exec rm {} \;  

4.Installing Solr

下载solr.4.1版本，解压后找到solr/example/目录，使用如下命令启动solr：

[html]  view plain copy

1. $java -jar start.jar  
2. ...  
3. INFO: Loading spell index for spellchecker: default  
4. Feb 4, 2013 5:48:54 PM org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener newSearcher  
5. INFO: Loading spell index for spellchecker: wordbreak  
6. Feb 4, 2013 5:48:54 PM org.apache.solr.core.SolrCore registerSearcher  
7. INFO: [collection1] Registered new searcher Searcher@6839ea58 main{StandardDirectoryReader(segments_1:1)}  
8. Feb 4, 2013 5:48:54 PM org.apache.solr.core.CoreContainer registerCore  
9. INFO: registering core: collection1  
10. Feb 4, 2013 5:48:54 PM org.apache.solr.servlet.SolrDispatchFilter init  
11. INFO: user.dir=/home/solr-4.1.0/example  
12. Feb 4, 2013 5:48:54 PM org.apache.solr.servlet.SolrDispatchFilter init  
13. INFO: SolrDispatchFilter.init() done  
14. 2013-02-04 17:48:54.651:INFO:oejs.AbstractConnector:Started SocketConnector@0.0.0.0:8983  

solr安装验证：

5.Configuring Lily to connect to your HBase, Hadoop & ZooKeeper

Then adjust the following files:

[html]  view plain copy

1. conf/general/hbase.xml  
2. conf/general/mapreduce.xml  
3. conf/general/zookeeper.xml  
4. conf/repository/repository.xml  
5. conf/rpc/rpc.xml  

6.Running The Lily Server Process

[html]  view plain copy

1. $su hdfs  
2. $bin/lily-server  
3. [INFO ][10:21:21,192][main      ] org.kauriproject.runtime.info - Starting the Kauri Runtime.  
4. [INFO ][10:21:21,470][main      ] org.kauriproject.runtime.info - Reading module configurations of 12 modules.  
5. [INFO ][10:21:21,987][main      ] org.kauriproject.runtime.info - Starting the modules.  
6. [INFO ][10:21:21,997][main      ] org.kauriproject.runtime.info - Starting module pluginregistry - /home/lily-2.0/lib/org/lilyproject/lily-pluginregistry-impl/2.0/lily-pluginregistry-impl-2.0.jar  
7. [INFO ][10:21:22,590][main      ] org.kauriproject.runtime.info - Starting module general - /home/lily-2.0/lib/org/lilyproject/lily-general-module/2.0/lily-general-module-2.0.jar  
8. [INFO ][10:21:24,621][main      ] org.kauriproject.runtime.info - Starting module rowlog - /home/lily-2.0/lib/org/lilyproject/lily-rowlog-module/2.0/lily-rowlog-module-2.0.jar  
9. [INFO ][10:21:25,771][main      ] org.kauriproject.runtime.info - Starting module indexer-integration - /home/lily-2.0/lib/org/lilyproject/lily-indexer-integration-module/2.0/lily-indexer-integration-module-2.0.jar  
10. [INFO ][10:21:25,928][main      ] org.kauriproject.runtime.info - Starting module repository - /home/lily-2.0/lib/org/lilyproject/lily-repository-module/2.0/lily-repository-module-2.0.jar  
11. [INFO ][10:21:30,155][main      ] org.kauriproject.runtime.info - Starting module indexer - /home/lily-2.0/lib/org/lilyproject/lily-indexer-module/2.0/lily-indexer-module-2.0.jar  
12. [INFO ][10:21:30,579][main      ] org.kauriproject.runtime.info - Starting module avro - /home/lily-2.0/lib/org/lilyproject/lily-rpc-module/2.0/lily-rpc-module-2.0.jar  
13. [INFO ][10:21:31,018][main      ] org.kauriproject.runtime.info - Starting module template - /home/lily-2.0/lib/org/kauriproject/kauri-template-service-impl/0.4-r1966/kauri-template-service-impl-0.4-r1966.jar  
14. [INFO ][10:21:31,660][main      ] org.kauriproject.runtime.info - Starting module representation - /home/lily-2.0/lib/org/kauriproject/kauri-representationbuilder-impl/0.4-r1966/kauri-representationbuilder-impl-0.4-r1966.jar  
15. [INFO ][10:21:31,727][main      ] org.kauriproject.runtime.info - Starting module routing - /home/lily-2.0/lib/org/kauriproject/kauri-routing-impl/0.4-r1966/kauri-routing-impl-0.4-r1966.jar  
16. [INFO ][10:21:31,783][main      ] org.kauriproject.runtime.info - Starting module rest - /home/lily-2.0/lib/org/lilyproject/lily-rest-module/2.0/lily-rest-module-2.0.jar  
17. [INFO ][10:21:31,914][main      ] org.kauriproject.runtime.info - Starting module webui - /home/lily-2.0/lib/org/lilyproject/lily-webui-module/2.0/lily-webui-module-2.0.jar  
18. [INFO ][10:21:31,956][main      ] org.kauriproject.runtime.info - Starting restservice public access.  
19. [INFO ][10:21:32,133][main      ] org.kauriproject.runtime.info - Runtime initialisation finished.  
20. [INFO ][10:21:32,135][main      ] org.kauriproject.runtime.info - Kauri Runtime started [February 5, 2013 10:21:32 AM CST]  

 

Lily 常用命令

分类： Lily 2013-02-05 16:37  154人阅读  评论(0)  收藏  举报

1.查看lily中的索引列表    

[html]  view plain copy

1. $ ./lily-list-indexes -z hdfs004:2181  

2.增加索引    

[html]  view plain copy

1. $ ./lily-add-index -z hdfs004 \  
2.                    -c samples/dynamic_indexerconf/dynamic_indexerconf.xml \  
3.                    -n genericindex \  
4.                    -sm classic \  
5.                    -s shard1:http://hdfs004:8983/solr  

3.启动lily

[html]  view plain copy

1. $bin/lily-server  

4.导入Record到Lily

[html]  view plain copy

1. $bin/lily-import samples/books/books_sample