CDH5.3.6在centos6.5上集群安装（2）

29、将zookeeper-3.4.5-cdh5.3.6.tar.gz 上传至lining01 /opt/modules/cdh

cd /opt/modules/cdh
tar -zxvf zookeeper-3.4.5-cdh5.3.6.tar.gz
cd /opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6
mkdir data
cd /opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/conf
cp zoo_sample.cfg zoo.cfg

30、在zoo.cfg中配置data路径

dataDir=/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/data
server.1=192.168.198.131:2878:3878
server.2=192.168.198.132:2898:3898
server.3=192.168.198.133:2889:3889
clientPort=3384

31、建立data文件夹和myid文件 myid设为1
32、将/zookeeper-3.4.5-cdh5.3.6 复制到lining06、lining07
myid文件分别设置为2、3
33、三台主机/zookeeper-3.4.5-cdh5.3.6/bin目录下的所有文件授权给所有用户

chmod -R 777 /opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/bin

34、关闭防火墙步骤

service iptables stop
chkconfig iptables off
service iptables status

35、在lining05 查看启动状态

37、同步时间

yum -y install ntp ntpdate

vim /etc/sysconfig/clock

ZONE = “Asia/Shanghai”
UTC = false
ARC = false

ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

设置时间同步

ntpdate cn.pool.ntp.org
hwclock --systohc
hwclock -w

设置定时任务同步时间

crontab -e
00 12 * * * /usr/sbin/ntpdate cn.pool.ntp.org

38、在linging05上运行zookeeper
/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/bin/zkServer.sh start
在linging06上运行zookeeper
/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/bin/zkServer.sh restart
在linging07上运行zookeeper
/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/bin/zkServer.sh restart

39、在linging05上查看zookeeper状
/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/bin/zkServer.sh status
在linging06上查看zookeeper状
/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/bin/zkServer.sh status
在linging07上查看zookeeper状
/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/bin/zkServer.sh status

40、伪分布安装HBase
上传HBase至/opt/modules/cdh/

tar -zxvf hbase-0.98.6-cdh5.3.6.tar.gz

41、hbase-site.xml

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://lining05:9000/hbase</value>
</property>
<property>
<name>hbase.tmp.dir</name>
<value>/opt/modules/cdh/hbase-0.98.6-cdh5.3.6/data/tmp</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/data</value>
</property>
<property>
<name>hbase.master</name>
<value>lining05:60000</value>
</property>
<property>
<name>hbase.zookeeper.property.clientPort</name>
<value>2181</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>lining05,lining06,lining07</value>
</property>
</configuration>

42、更改 regionservers
在 regionservers 文件中添加slave列表：
lining06
lining07

43、启动HBASE

/opt/modules/cdh/hbase-0.98.6-cdh5.3.6/bin/start-hbase.sh

44、查看lining05JPS

5215 HMaster
4193 DataNode
5330 Jps
4498 ResourceManager
4074 NameNode
4957 QuorumPeerMain
4594 NodeManager

查看lining06jps

2628 NodeManager
2827 QuorumPeerMain
2528 DataNode
3044 Jps
2961 HRegionServer

查看lining07jps

2810 QuorumPeerMain
2523 DataNode
3022 Jps
2939 HRegionServer
2619 NodeManager

45、关闭Hbase

 /opt/modules/cdh/hbase-0.98.6-cdh5.3.6/bin/hbase-daemons.sh stop regionserver

46、将sqoop-1.4.5-cdh5.3.6.tar.gz 上传至 /opt/modules/cdh/

cd /opt/modules/cdh/
tar -zxvf sqoop-1.4.5-cdh5.3.6.tar.gz

47、/etc/profile

export SQOOP_HOME=/opt/modules/cdh/sqoop-1.4.5-cdh5.3.6
export PATH=$PATH:$SQOOP_HOME/bin

48、sqoop-env.sh

cd /opt/modules/cdh/sqoop-1.4.5-cdh5.3.6/conf
cp sqoop-env-template.sh sqoop-env.sh

export HADOOP_COMMON_HOME=/opt/modules/cdh/hadoop-2.5.0-cdh5.3.6

export HADOOP_MAPRED_HOME=/opt/modules/cdh/hadoop-2.5.0-cdh5.3.6

export HBASE_HOME=/opt/modules/cdh/hbase-0.98.6-cdh5.3.6

export HIVE_HOME=/opt/modules/cdh/hive-0.13.1-cdh5.3.6

export ZOOCFGDIR=/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6

49、导入驱动包
将mysql-connector-java-5.1.27.jar 上传至/opt/modules/cdh/sqoop-1.4.5-cdh5.3.6/lib 再上传至 /opt/modules/cdh/hadoop-2.5.0-cdh5.3.6/lib
50、启动mysql
service mysqld start
51、测试sqoop连接mysql
sqoop list-databases --connect jdbc:mysql://localhost:3306/ --username root -P
52、转sqoop hive hbase 联合实验