安装 360的 poseidon

wget https://services.gradle.org/distributions/gradle-3.5-all.zip
unzip gradle-3.5-all.zip
mv gradle-3.5 /usr/local
vi /etc/profile
加上
GRADLE_HOME=/usr/local/gradle-3.5
export PATH=$PATH:$GRADLE_HOME/bin
source /etc/profile
gradle -v

看到

------------------------------------------------------------
Gradle 3.5
------------------------------------------------------------

Build time:   2017-04-10 13:37:25 UTC
Revision:     b762622a185d59ce0cfc9cbc6ab5dd22469e18a6

Groovy:       2.4.10
Ant:          Apache Ant(TM) version 1.9.6 compiled on June 29 2015
JVM:          1.8.0_121 (Oracle Corporation 25.121-b13)
OS:           Linux 2.6.32-696.el6.x86_64 amd64

说明成功。

=============================

wget http://memcached.org/files/memcached-1.4.36.tar.gz
tar -zxf memcached-1.4.36.tar.gz
cd memcached-1.4.36
./configure && make && make test && sudo make install
ls -al /usr/local/bin/mem*  查看是否成功

/usr/local/bin/memcached -d -m 1024 -u root -l 0.0.0.0 -p 11211 -c 1024 -P /tmp/memcached.pid

-d 选项是启动一个守护进程
-m 是分配给Memcache使用的内存数量,单位是MB
-u 是运行Memcache的用户
-l 是监听的服务器IP地址
-p 是设置Memcache监听的端口
-c 选项是最大运行的并发连接数,默认是1024,按照服务器的负载量来设定,
-P 是设置保存Memcache的pid文件

kill `cat /tmp/memcached.pid`  结束Memcache进程

=============================

安装 启动 redis

=============================

安装 启动 hadoop: http://blog.csdn.net/gold2008/article/details/72403729


=============================

mkdir -p /root/go/src/github.com/Qihoo360

cd /root/go/src/github.com/Qihoo360
git clone https://github.com/Qihoo360/poseidon
cd poseidon
sh ./build.sh

mkdir /usr/local/poseidon
cd dist
cp -rf * /usr/local/poseidon
tar -zxf idgenerator*.tar.gz
tar -zxf poseidon_proxy*.tar.gz
tar -zxf poseidon_searcher*.tar.gz
tar -zxf meta*.tar.gz

sh /usr/local/poseidon/idgenerator/serverctl start    监听 39360
sh /usr/local/poseidon/meta/serverctl start           监听 39610
sh /usr/local/poseidon/proxy/serverctl start          监听 39460
sh /usr/local/poseidon/searcher/serverctl start       监听 39504

tar -xf hdfsreader-0.1.tar
mv hdfsreader-0.1 hdfsreader

vi /usr/local/poseidon/hdfsreader/etc/core-site.xml
<value>hdfs://localhost:9000</value>

sh /usr/local/poseidon/hdfsreader/bin/hdfsReader.sh start

tar -zxf docformat-0.1.tar.gz
mv docformat-0.1 docformat

vi /usr/local/poseidon/docformat/etc/docformat.json
"hadoop_cmd":"./bin/real-hadoop.sh"

sh /usr/local/poseidon/docformat/bin/install.sh start


wget https://raw.githubusercontent.com/liwei-ch/poseidonlog/master/weibo_data.tar.gz
tar -xvf weibo_data.tar.gz
sh /usr/local/poseidon/docformat/bin/demo.sh /usr/local/poseidon/weibo_data.txt


tar -xf index-0.1.tar
mv index-0.1 index
sh /usr/local/poseidon/index/bin/start.sh 2017-05-16


出现错误 doc meta setter map reduce test 2017-05-16 failed, 经过多次测试是 hadoop 没有安装配置好,一定要按照说明步骤仔细操作。



  • 2
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值