CDH5.16.2 企业级真正离线部署

前言

哎，Cloudera食言而肥，之前是CDH6.3.3开始取消免费版，现在成了所有版本（包括旧版）全部收费，资本的力量啊。
不提了，完全内网环境下，还是可以使用的，本篇就来部署一下CDH5.16.2，之前有一篇CDH6.3.1部署提到过，而且目前公司使用的组件版本是基于CDH5.16.2的。

集群环境准备

• CDH5的集群环境准备，与CDH6基本相同，参考之前这篇CDH6.3.1部署

CDH部署

1. 下载所需包

1. cloudera-manager-centos7-cm5.16.2_x86_64.tar.gz
http://archive.cloudera.com/cm5/cm/5/cloudera-manager-centos7-cm5.16.2_x86_64.tar.gz

2. CDH-5.16.1-1.cdh5.16.1.p0.3-el7.parcel
http://archive.cloudera.com/cdh5/parcels/5.16.2/CDH-5.16.2-1.cdh5.16.2.p0.8-el7.parcel

3. CDH-5.16.1-1.cdh5.16.1.p0.3-el7.parcel.sha1
http://archive.cloudera.com/cdh5/parcels/5.16.2/CDH-5.16.2-1.cdh5.16.2.p0.8-el7.parcel.sha1

4. manifest.json
http://archive.cloudera.com/cdh5/parcels/5.16.2/manifest.json

2. 离线部署 cm server及agent

1. 所有节点创建目录及解压
mkdir /opt/cloudera-manager
tar -zxvf cloudera-manager-centos7-cm5.16.2_x86_64.tar.gz -C /opt/cloudera-manager

2. 所有节点修改agent的配置，指向server的节点hadoop001
cd /opt/cloudera-manager/cm-5.16.2/etc/cloudera-scm-agent
vi config.ini
# 修改
server_host=cdh001

3. 主节点修改server配置
cd /opt/cloudera-manager/cm-5.16.2/etc/cloudera-scm-server
vi db.properties
# 修改
com.cloudera.cmf.db.type=mysql
com.cloudera.cmf.db.host=cdh001
com.cloudera.cmf.db.name=cmf
com.cloudera.cmf.db.user=cmf
com.cloudera.cmf.db.password=password
com.cloudera.cmf.db.setupType=EXTERNAL

4. 所有节点创建用户
useradd --system --home=/opt/cloudera-manager/cm-5.16.2/run/cloudera-scm-server/ --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

5. 目录修改用户及用户组
chown -R cloudera-scm:cloudera-scm /opt/cloudera-manager

3. cdh001节点部署离线parcel源

1. 部署离线parcel源
mkdir -p /opt/cloudera/parcel-repo

2. 把parcel包放到parcel源路径下
cp CDH-5.16.2-1.cdh5.16.2.p0.8-el7.parcel /opt/cloudera/parcel-repo/
cp CDH-5.16.2-1.cdh5.16.2.p0.8-el7.parcel.sha1 /opt/cloudera/parcel-repo/CDH-5.16.2-1.cdh5.16.2.p0.8-el7.parcel.sha
cp manifest.json /opt/cloudera/parcel-repo/

3. 目录修改用户及用户组
chown -R cloudera-scm:cloudera-scm /opt/cloudera/

4. 所有节点创建软件安装目录、用户及用户组权限

mkdir -p /opt/cloudera/parcels 
chown -R cloudera-scm:cloudera-scm /opt/cloudera/

CDH启动

1. 主节点启动server
/opt/cloudera-manager/cm-5.16.2/etc/init.d/cloudera-scm-server start
/opt/cloudera-manager/cm-5.16.2/etc/init.d/cloudera-scm-server status
2. 所有节点启动agent
/opt/cloudera-manager/cm-5.16.2/etc/init.d/cloudera-scm-agent start
/opt/cloudera-manager/cm-5.16.2/etc/init.d/cloudera-scm-agent status

3. 确保server和所有agent启动成功后，进入webui完成安装
http://cdh001:7180/