cdh5.3.2集群搭建

机器列表：

10.50.1.37 cdh-test01 （跳板机，你们从这台登录）
10.50.1.38 cdh-test02
10.50.1.45 cdh-test03
10.50.1.70 cdh-test04
10.50.1.84 cdh-test05

目前系统盘是50G 数据盘是50G
配置每个机子的host

关闭iptables
$ service iptables stop
$ chkconfig iptables off

关闭SELINUX
$ vim /etc/selinux/config
$ SELINUX=disabled

配置机器之间互相可以免密登陆
批量执行脚本

根据list，执行批量操作命令
#!/bin/bash

NOW_LIST=("cdh-test01" "cdh-test02" "cdh-test03" "cdh-test04" "cdh-test05")

echo $NOW_LIST

SSH_USER="root"
for i in ${NOW_LIST[@]}; do
        f_cmd="ssh -i /tmp/hd-cm.rsa $SSH_USER@$i \"$*\""
        echo $f_cmd
    if eval $f_cmd; then
        echo "OK"
    else
        echo "FAIL"
    fi
done


根据list，执行批量复制命令
#!/bin/bash

NOW_LIST=("cdh-test01" "cdh-test02" "cdh-test03" "cdh-test04" "cdh-test05")

echo $NOW_LIST

SSH_USER="root"
for i in ${NOW_LIST[@]}; do
        f_cmd="scp -i /tmp/hd-cm.rsa $1 $SSH_USER@$i:$2"
        echo $f_cmd
    if eval $f_cmd; then
        echo "OK"
    else
        echo "FAIL"
    fi
done

给其中一台机子安装httpd服务

archive.cloudera.com

依赖的软件服务（在要安装CM的机器上进行，需要上网）cdh-test01机器
#yum -y install postgresql-server
yum -y install httpd
yum -y install perl
yum -y install bind-utils
yum -y install cyrus-sasl-gssapi
yum -y install nc
yum -y install openssh-clients

主要是为了装httpd服务

准备cm和cdh的包http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.2/
=> /var/www/html/cloudera-manager/5.3.2

http://archive-primary.cloudera.com/cdh5/parcels/5.3.2/

=> /var/www/html/parcels/5.3.2

（parcels的sha1文件改为sha文件）

所有文件在：dmp_admin的/var/data/dmp2/cdh5.3.2_install目录下

修改parcels里面sha1文件为sha

事实证明只要这两种文件集，就足够了

（可选：把本机作为archive.cloudera.com）

$ service httpd start
$ chkconfig httpd on

mv CDH-5.3.2-1.cdh5.3.2.p0.10-el6.parcel.sha1 CDH-5.3.2-1.cdh5.3.2.p0.10-el6.parcel.sha

创建yum源
$ vim /etc/yum.repos.d/cloudera-manager.repo
[cloudera-manager]
name=cloudera manager
baseurl=http://10.96.30.173/cloudera-manager/5.3.2
enabled=1
gpgcheck = 0

将文件scp到要安装的其它机器上

所有机器，yum clean all

安装jdk
所有节点：

$ yum install oracle-j2sdk1.7
配置Java环境变量，执行：

ln -s /usr/java/jdk1.7.0_67-cloudera /usr/java/default
echo -e ‘export JAVA_HOME=/usr/java/default’ >> /etc/profile
echo -e ‘export PATH=$JAV{A}_{H}OME/bin:$PATH’>> /etc/profile
echo -e ‘export CLASSPATH=.:$JAVA_HOME/lib’>> /etc/profile

echo -e ‘export JRE_HOME=$JAVA_HOME/jre’>> /etc/profile

source /etc/profile
安装cloudera manger agent
所有节点：
yum -y install cloudera-manager-agent
修改 cloudera-manager-agent配置文件,将server_host修改为master
vim /etc/cloudera-scm-agent/config.ini
server_host=master
安装cloudera manager server
master节点:
yum install cloudera-manager-server cloudera-manager-deamons

将parcels复制到/opt/cloudera/parcel-repo
cp /var/www/html/parcels/5.6.0/. /opt/cloudera/parcel-repo
安装mysql见集群mysql安装详解
创建所需要的数据库和用户
mysql> create database scm default character set utf8;
mysql> grant all on scm.* TO ‘scm’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
mysql> create database amon default character set utf8;
mysql> grant all on amon.* TO ‘amon’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
mysql> create database rman default character set utf8;
mysql> grant all on rman.* TO ‘rman’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
mysql> create database metastore default character set utf8;
mysql> grant all PRIVILEGES on metastore.* TO ‘hive’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
mysql> create database sentry default character set utf8;
mysql> grant all PRIVILEGES on sentry.* TO ‘sentry’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
mysql> create database nav default character set utf8;
mysql> grant all PRIVILEGES on nav.* TO ‘nav’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
mysql> create database navms default character set utf8;
mysql> grant all PRIVILEGES on navms.* TO ‘navms’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
mysql> flush privileges;

create database scm default character set utf8;
grant all on scm.* TO ‘scm’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
create database amon default character set utf8;
grant all on amon.* TO ‘amon’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
create database rman default character set utf8;
grant all on rman.* TO ‘rman’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
create database metastore default character set utf8;
grant all PRIVILEGES on metastore.* TO ‘hive’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
create database sentry default character set utf8;
grant all PRIVILEGES on sentry.* TO ‘sentry’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
create database nav default character set utf8;
grant all PRIVILEGES on nav.* TO ‘nav’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
create database navms default character set utf8;
grant all PRIVILEGES on navms.* TO ‘navms’@‘localhost’ IDENTIFIED BY ‘123456’ WITH GRANT OPTION;
flush privileges;

需要访问mysql的节点上安装mysql-connector-java.jar
将数据库驱动mysql-connector-java.jar放到/usr/share/java目录下，用于cloudera manager连接mysql数据库
注意： 下载的mysql驱动要改名为mysql-connector-java.jar或者用ln命令建立链接
为cloudera manager配置外部数据库
/usr/share/cmf/schema/scm_prepare_database.sh mysql scm scm 123456
/opt/cm-5.1.3/share/cmf/schema/scm_prepare_database.sh mysql cm -hlocalhost -uroot -pxxxx --scm-host localhost scm scm scm

3.5 启动服务
所有节点：
$ service cloudera-scm-agent start
master节点：
$ service cloudera-scm-server start
3.6 禁用大页
$ echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
$ echo never > /sys/kernel/mm/transparent_hugepage/enabled
$ echo never > /sys/kernel/mm/transparent_hugepage/defrag
在/etc/rc.local中添加
echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
echo never > /sys/kernel/mm/transparent_hugepage/enabled
echo never > /sys/kernel/mm/transparent_hugepage/defrag
3.7 swappiness设置为0
$ vim /etc/sysctl.conf
在sysctl.conf中添加：
vm.swappiness = 0
然后执行：
$ sysctl -p

在浏览器中输入http://本机的IP:7180，用户名和密码都是：admin

确定后会刷新出本地的parcel包


不需要手动建立dfs/nn dfs/dn 等配置的文件夹，会自动创建
手动创建会出现各种权限问题



数据库连接不上，数据库权限问题
增加权限即可。

解决办法一：
所有的机器开启 service ntpd start 服务
在每台服务器上执行：ntpdate asia.pool.ntp.org 同步所有的服务器的时间

进入hive
查询出错权限问题

改成777就可以了