黑猴子的家：Cloudera Manager 之安装部署-CSDN博客

本文链接：https://blog.csdn.net/qq_28652401/article/details/116646391

CM下载地址：http://archive.cloudera.com/cm5/cm/5/
离线库下载地址：http://archive.cloudera.com/cdh5/parcels
注：以下所有操作均使用root用户

1、下载地址

http://archive.cloudera.com/cm5/cm/5/cloudera-manager-centos7-cm5.14.2_x86_64.tar.gz
http://archive.cloudera.com/cdh5/parcels/5.14.2/manifest.json
http://archive.cloudera.com/cdh5/parcels/5.14.2/CDH-5.14.2-1.cdh5.14.2.p0.3-el7.parcel.sha1
http://archive.cloudera.com/cdh5/parcels/5.14.2/CDH-5.14.2-1.cdh5.14.2.p0.3-el7.parcel
http://archive.cloudera.com/cm5/installer/5.14.2/cloudera-manager-installer.bin
http://archive.cloudera.com/cm5/repo-as-tarball/5.14.2/cm5.14.2-centos7.tar.gz

2、安装第三方依赖

在三台节点(所有agent的节点)上执行下载第三方依赖

[root@hadoop102 ~]# yum -y install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb mod_ssl httpd

[root@hadoop103 ~]# yum -y install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb mod_ssl httpd

[root@hadoop104 ~]# yum -y install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb mod_ssl httpd

尖叫提示：所有节点都执行

3、上传安装包

[root@hadoop102 software]# mkdir clouderamanager
[root@hadoop102 software]# cd clouderamanager/
[root@hadoop102 clouderamanager]# ls
CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel      cloudera-manager-centos7-cm5.14.1_x86_64.tar.gz
CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.sha
manifest.json

尖叫提示：由于安装包有点大，所以上传时间有点长，大约需要20分钟

4、解压ClouderaManager安装包

[root@hadoop102 software]# tar -xzvf clouderamanager/cloudera-manager-centos7-cm5.14.1_x86_64.tar.gz -C /opt/

尖叫提示：一定要解压到opt目录下

5、创建用户cloudera-scm

1)创建用户

[root@hadoop102 module]# useradd --system --home=/opt/cm-5.14.1/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

[root@hadoop103 module]# useradd --system --home=/opt/cm-5.14.1/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

[root@hadoop104 module]# useradd --system --home=/opt/cm-5.14.1/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

尖叫提示：三台机器都创建参数说明--system 创建一个系统账户--home 指定用户登入时的主目录，替换系统默认值/home/<用户名>--no-create-home 不要创建用户的主目录--shell 用户的登录 shell 名--comment 用户的描述信息

注意Cloudera Manager默认用户为cloudera-scm，创建具有此名称的用户是最简单的方法。安装完成后，将自动使用此用户。

2)查看用户

[root@hadoop102 cloudera-scm-server]# id cloudera-scm
uid=987(cloudera-scm) gid=981(cloudera-scm) groups=981(cloudera-scm)

6、查看解压后内容

[root@hadoop102 opt]# ls -l
drwxr-xr-x 4 1106 4001 36 Feb  8  2018 cloudera
drwxr-xr-x 9 1106 4001 88 Feb  8  2018 cm-5.14.1
drwxr-xr-x. 9 alex alex  212 May  5 09:51 module
drwxr-xr-x. 4 alex alex 4096 May  5 10:05 software

7、添加驱动包

1)位置1

[root@hadoop102 software]# cp mysql-connector-java-5.1.27-bin.jar  /opt/cm-5.14.1/share/cmf/lib/

2)位置2

[root@hadoop102 /]# cp mysql-connector-java-5.1.27-bin.jar /usr/share/java/mysql-connector-java.jar

尖叫提示: 注意jar包名称要修改为mysql-connector-java.jar
3)分发

[root@hadoop102 java]# xsync mysql-connector-java.jar

4)为什么要拷贝到这?

[root@hadoop102 cloudera-scm-agent]# pwd
/opt/cm-5.14.1/etc/cloudera-scm-agent
[root@hadoop102 cloudera-scm-agent]# vim config.ini
[JDBC]
#cloudera_mysql_connector_jar=/usr/share/java/mysql-connector-java.jar

8、配置agent

使从节点cloudera-manger-agent指向主节点服务器

[root@hadoop102 opt]# cd cm-5.14.1/
[root@hadoop102 cm-5.14.1]# vim etc/cloudera-scm-agent/config.ini
[General]
# Hostname of the CM server.
server_host=hadoop102

# Port that the CM server is listening on.
server_port=7182

9、在mysql中创建cm库

[root@hadoop102 opt]# cd cm-5.14.1/share/cmf/schema/
[root@hadoop102 schema]# ./scm_prepare_database.sh mysql cm -hhadoop102 -uroot -p000000 --scm-host hadoop102 scm scm scm

参数说明-h：Database host-u：Database username-p：Database Password--scm-host：SCM server's hostname

10、添加安装文件到CM仓目录

[root@hadoop102 software]# cp -r clouderamanager/CDH-5.14* \
/opt/cloudera/parcel-repo/

[root@hadoop102 software]# cp clouderamanager/manifest.json \
/opt/cloudera/parcel-repo/

[root@hadoop102 software]# cd /opt/cloudera/parcel-repo/
[root@hadoop102 parcel-repo]# ls
CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel
CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.sha
manifest.json

尖叫提示1CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.sha下载下来的时候是CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.sha1是需要改名字为CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.sha

尖叫提示2:cloudera manager的本地仓位置必须是 /opt/cloudera/parcel-repo/，这是默认位置

11、创建parcels文件夹

[root@hadoop102 opt]# mkdir -p cloudera/parcels

尖叫提示：parcels文件夹是安装路径

12、修改用户和用户组

[root@hadoop102 opt]# chown -R cloudera-scm:cloudera-scm cloudera/
[root@hadoop102 opt]# chown -R cloudera-scm:cloudera-scm cm-5.14.1/

13、分发cm

[root@hadoop102 opt]# xsync.sh cm-5.14.1/

14、分发cloudera

[root@hadoop102 opt]# xsync.sh cloudera/

15、修改hadoop103和hadoop104的用户组

[root@hadoop103 opt]# chown -R cloudera-scm:cloudera-scm cloudera/
[root@hadoop103 opt]# chown -R cloudera-scm:cloudera-scm cm-5.14.1/

[root@hadoop104 opt]# chown -R cloudera-scm:cloudera-scm cloudera/
[root@hadoop104 opt]# chown -R cloudera-scm:cloudera-scm cm-5.14.1/