centos7.2下的CDH集群安装

1 修改主节点hosts文件，分发到各从节点

 

2.主节点 生成认证文件authorized_keys，并分发到各从节点

ssh-keygen -trsa

cat~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

chmod 600~/.ssh/authorized_keys

scp  -P 822 ~/.ssh/authorized_keys root@slaver1:~/.ssh

 

3.修改各节点主机名

Hostnamectl set-hostnameservername --static

4.关闭防火墙

Systemctl stopfirewalld.service

 

5.所有节点安装jdk8

rpm –ivh jdk-8u91-linux-x64.rpm

配置环境变量

在 /etc/profile 文件末尾 加上：

exportJAVA_HOME=/usr/java/jdk1.8.0_91

exportPATH=$JAVA_HOME/bin:$PATH

export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

测试java环境;

6.在主节点安装mysql

6.1配置域名解析

vi  /etc/resovl.conf

在最后面加上：

servername8.8.8.8

servername8.8.4.4

6.2手动下载yum源，并解压

http://repo.mysql.com/mysql-community-release-el7-5.noarch.rpm

6.3yum安装mysql

yum installmysql-server

密码改为（root/Root123.）

6.4创建存hadoop各组件元数据的库

-- 创建hive数据元数据库，并赋予权限

      create database metastore DEFAULTCHARACTER SET latin1;

      grant all on metastore.* TO 'hive'@'%'IDENTIFIED BY 'hive_password';

      -- 创建scm数据库，并赋予权限

      create database scm DEFAULT CHARACTER SETutf8;

      grant all on scm.* TO 'scm'@'%' IDENTIFIEDBY 'scm_password';

      -- 创建amon数据库，并赋予权限

      create database amon DEFAULT CHARACTER SETutf8;

      grant all on amon.* TO 'amon'@'%'IDENTIFIED BY 'amon_password';

      -- 创建rmon数据库，并赋予权限

      create database rmon DEFAULT CHARACTER SETutf8;

      grant all on rmon.* TO 'scm'@'%'IDENTIFIED BY 'rmon_password';

      -- 创建sentry数据库，并赋予权限

      create database sentry DEFAULT CHARACTERSET utf8;

      grant all on sentry.* TO 'sentry'@'%'IDENTIFIED BY 'sentry_password';

      -- 创建hue数据库，并赋予权限

      create database hue CHARACTER SET utf8;

      grant all on hue.* to 'hue'@'%' identifiedby 'secretpassword';

      -- 创建oozie数据库

      create database oozie CHARACTER SET utf8;

      grant all privileges on oozie.* to'oozie'@'%' identified by 'oozie';

6.5下载mysql驱动到/usr/share/java（不存在就新建该目录）

7.CM5安装

7.1下载cloudera-manager-centos7-cm5.8.3_x86_64.tar.gz

解压到/opt/

 7.2添加cloudera-scm用户

sudo useradd--system --home=/opt/cloudera-manager/cm-5.8.3/run/cloudera-scm-server--no-create-home --shell=/bin/false --comment "Cloudera SCM User"cloudera-scm

7.3修改/opt/cm-5.8.3/etc/cloudera-scm-agent/config.ini下面的server_host=master

将/ usr/share/java下的驱动cp到/opt/cloudera-manager/cm-5.8.3/share/cmf/lib目录下

7.4将cm-5.8.3分发到各节点的/opt目录下：

scp –P 822  –r /opt/cloudera-manager/cm-5.8.3  root@slaver1:/opt

7.5为Cloudera Manager 5建立数据库：

/opt/cm-5.8.3/share/cmf/schema/scm_prepare_database.shmysql scm -hlocalhost -uroot –pRoot123. --scm-host localhost scm scm scm

8.下载CDH-5.8.2-1.cdh5.8.2.p0.3-el6.parcel，CDH-5.8.2-1.cdh5.8.2.p0.3-el6.parcel.sha,manifest.json

8.1上传到/opt/cloudera-manager/cloudera/parcel-repo

8.2先启动主节点的/opt/cm-5.8.3/etc/init.d/cloudera-scm-server

./cloudera-scm-serverstart

 

然后启动所有节点的/opt/cm-5.8.3/etc/init.d/cloudera-scm-agent

./cloudera-scm-agentstart