http://blog.csdn.net/morning_pig/article/details/8569842
参考文档:
http://docs.ngdata.com/lily-docs-current/414-lily/432-lily.html
1.Installing Hadoop, HBase and ZooKeeper
此处省略几百字...
2.HBase: deploy extra jars
copy以下包到hbase lib下:
- lib/org/lilyproject/lily-hbase-ext/2.0/lily-hbase-ext-2.0.jar
- lib/org/lilyproject/lily-bytes/2.0/lily-bytes-2.0.jar
- lib/org/lilyproject/lily-util/2.0/lily-util-2.0.jar
- lib/org/lilyproject/lily-repository-api/2.0/lily-repository-api-2.0.jar
- lib/org/lilyproject/lily-repository-id-impl/2.0/lily-repository-id-impl-2.0.jar
- lib/org/lilyproject/lily-hbaseindex-base/2.0/lily-hbaseindex-base-2.0.jar
- lib/com/gotometrics/orderly/orderly/0.11/orderly-0.11.jar
- lib/org/lilyproject/lily-indexer-derefmap-indexfilter/2.0/lily-indexer-derefmap-indexfilter-2.0.jar
3.Hadoop: cleanup old Avro jars
- $find /usr/lib/hadoop* -name "avro*jar" -exec rm {} \;
4.Installing Solr
下载solr.4.1版本,解压后找到solr/example/目录,使用如下命令启动solr:
- $java -jar start.jar
- ...
- INFO: Loading spell index for spellchecker: default
- Feb 4, 2013 5:48:54 PM org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener newSearcher
- INFO: Loading spell index for spellchecker: wordbreak
- Feb 4, 2013 5:48:54 PM org.apache.solr.core.SolrCore registerSearcher
- INFO: [collection1] Registered new searcher Searcher@6839ea58 main{StandardDirectoryReader(segments_1:1)}
- Feb 4, 2013 5:48:54 PM org.apache.solr.core.CoreContainer registerCore
- INFO: registering core: collection1
- Feb 4, 2013 5:48:54 PM org.apache.solr.servlet.SolrDispatchFilter init
- INFO: user.dir=/home/solr-4.1.0/example
- Feb 4, 2013 5:48:54 PM org.apache.solr.servlet.SolrDispatchFilter init
- INFO: SolrDispatchFilter.init() done
- 2013-02-04 17:48:54.651:INFO:oejs.AbstractConnector:Started SocketConnector@0.0.0.0:8983
solr安装验证:
5.Configuring Lily to connect to your HBase, Hadoop & ZooKeeper
Then adjust the following files:
- conf/general/hbase.xml
- conf/general/mapreduce.xml
- conf/general/zookeeper.xml
- conf/repository/repository.xml
- conf/rpc/rpc.xml
6.Running The Lily Server Process
- $su hdfs
- $bin/lily-server
- [INFO ][10:21:21,192][main ] org.kauriproject.runtime.info - Starting the Kauri Runtime.
- [INFO ][10:21:21,470][main ] org.kauriproject.runtime.info - Reading module configurations of 12 modules.
- [INFO ][10:21:21,987][main ] org.kauriproject.runtime.info - Starting the modules.
- [INFO ][10:21:21,997][main ] org.kauriproject.runtime.info - Starting module pluginregistry - /home/lily-2.0/lib/org/lilyproject/lily-pluginregistry-impl/2.0/lily-pluginregistry-impl-2.0.jar
- [INFO ][10:21:22,590][main ] org.kauriproject.runtime.info - Starting module general - /home/lily-2.0/lib/org/lilyproject/lily-general-module/2.0/lily-general-module-2.0.jar
- [INFO ][10:21:24,621][main ] org.kauriproject.runtime.info - Starting module rowlog - /home/lily-2.0/lib/org/lilyproject/lily-rowlog-module/2.0/lily-rowlog-module-2.0.jar
- [INFO ][10:21:25,771][main ] org.kauriproject.runtime.info - Starting module indexer-integration - /home/lily-2.0/lib/org/lilyproject/lily-indexer-integration-module/2.0/lily-indexer-integration-module-2.0.jar
- [INFO ][10:21:25,928][main ] org.kauriproject.runtime.info - Starting module repository - /home/lily-2.0/lib/org/lilyproject/lily-repository-module/2.0/lily-repository-module-2.0.jar
- [INFO ][10:21:30,155][main ] org.kauriproject.runtime.info - Starting module indexer - /home/lily-2.0/lib/org/lilyproject/lily-indexer-module/2.0/lily-indexer-module-2.0.jar
- [INFO ][10:21:30,579][main ] org.kauriproject.runtime.info - Starting module avro - /home/lily-2.0/lib/org/lilyproject/lily-rpc-module/2.0/lily-rpc-module-2.0.jar
- [INFO ][10:21:31,018][main ] org.kauriproject.runtime.info - Starting module template - /home/lily-2.0/lib/org/kauriproject/kauri-template-service-impl/0.4-r1966/kauri-template-service-impl-0.4-r1966.jar
- [INFO ][10:21:31,660][main ] org.kauriproject.runtime.info - Starting module representation - /home/lily-2.0/lib/org/kauriproject/kauri-representationbuilder-impl/0.4-r1966/kauri-representationbuilder-impl-0.4-r1966.jar
- [INFO ][10:21:31,727][main ] org.kauriproject.runtime.info - Starting module routing - /home/lily-2.0/lib/org/kauriproject/kauri-routing-impl/0.4-r1966/kauri-routing-impl-0.4-r1966.jar
- [INFO ][10:21:31,783][main ] org.kauriproject.runtime.info - Starting module rest - /home/lily-2.0/lib/org/lilyproject/lily-rest-module/2.0/lily-rest-module-2.0.jar
- [INFO ][10:21:31,914][main ] org.kauriproject.runtime.info - Starting module webui - /home/lily-2.0/lib/org/lilyproject/lily-webui-module/2.0/lily-webui-module-2.0.jar
- [INFO ][10:21:31,956][main ] org.kauriproject.runtime.info - Starting restservice public access.
- [INFO ][10:21:32,133][main ] org.kauriproject.runtime.info - Runtime initialisation finished.
- [INFO ][10:21:32,135][main ] org.kauriproject.runtime.info - Kauri Runtime started [February 5, 2013 10:21:32 AM CST]
1.查看lily中的索引列表
- $ ./lily-list-indexes -z hdfs004:2181
2.增加索引
- $ ./lily-add-index -z hdfs004 \
- -c samples/dynamic_indexerconf/dynamic_indexerconf.xml \
- -n genericindex \
- -sm classic \
- -s shard1:http://hdfs004:8983/solr
3.启动lily
- $bin/lily-server
4.导入Record到Lily
- $bin/lily-import samples/books/books_sample