非常详细的CDH6环境安装（离线版）

最新推荐文章于 2024-05-23 17:22:29 发布

笑里笑外~

最新推荐文章于 2024-05-23 17:22:29 发布

阅读量5.7k

点赞数 8

分类专栏： linux 文章标签：大数据 hadoop spark

本文链接：https://blog.csdn.net/qq_36488175/article/details/109130446

版权

linux 专栏收录该内容

3 篇文章 1 订阅

订阅专栏

大数据，就这！——CDH6环境安装（离线版）

CDH6环境安装（离线版）
一、预备阶段
- 1. 集群机器
- 2. 准备安装包
二、环境安装（关闭防火墙~）
注意

CDH6环境安装（离线版）

官网介绍:

CDH是Cloudera的100％开源平台发行版，包括Apache Hadoop，专为满足企业需求而构建。CDH提供开箱即用的企业使用所需的一切。通过将Hadoop与十几个其他关键的开源项目集成，Cloudera创建了一个功能先进的系统，可帮助您执行端到端的大数据工作流程。

简单来说：
CDH 是一个拥有集群自动化安装、中心化管理、集群监控、报警功能的一个工具（软件），使得集群的安装可以从几天的时间缩短为几个小时，运维人数也会从数十人降低到几个人，极大的提高了集群管理的效率。

说人话就是:
你安装CDH平台，然后通过CDH安装hadoop集群、spark集群、zookeeper、kafka、hive、hbase等，可以节省你一大笔安装配置的时间，以及启动成本。是不是很香？

提示：所有操作，均在root用户下进行的！！！

一、预备阶段

1. 集群机器

还不会安装虚拟机的兄嘚，可以看下我上篇环境安装大数据学习记录——基础环境搭建

虚拟机IP	hostname	Hadoop	Mysql	Spark	ZooKeeper
196.168.44.136	cdh1	Y	Y	Y	Y
196.168.44.137	cdh2	Y		Y	Y
196.168.44.138	cdh3	Y		Y	Y

2. 准备安装包

jdk:
oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm

mysql:
mysql-5.7.26-1.el7.x86_64.rpm-bundle.tar
mysql-connector-java-5.1.47.tar.gz

cloudera-repos-6.2.0:
cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm
cloudera-manager-server-6.2.0-968826.el7.x86_64.rpm

parcel-6.2.0
CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel
CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel.sha
PHOENIX-1.0.jar
PHOENIX-5.0.0-cdh6.2.0.p0.1308267-el7.parcel
PHOENIX-5.0.0-cdh6.2.0.p0.1308267-el7.parcel.sha
manifest.json

下载连接：

链接：https://pan.baidu.com/s/1u8Khvy_nlvCFbcJRtanurg
提取码：wl0w

二、环境安装（关闭防火墙~）

systemctl stop firewalld.service

1.修改hostname和hosts(所有节点)

设置hostname修改配置文件

[root@cdh1 ~]# vi /etc/hostname 
cdh1

[root@cdh1 ~]# vi /etc/sysconfig/network
# Created by anaconda
NETWORKING=yes
HOSTNAME=server4

设置/etc/hosts

[root@cdh1 ~]# vi /etc/hosts


#127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
#::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

192.168.44.136   cdh1
192.168.44.137   cdh2
192.168.44.138   cdh3

重启！

同样的操作在三台服务器上，完成修改，并重启

2.SSH免密登录（所有节点）

执行指令：ssh-keygen -t rsa -P “”,（在三台机器上都执行！！！）

[root@cdh1 .ssh]# ssh-keygen -t rsa -P ""
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa):
/root/.ssh/id_rsa already exists.
Overwrite (y/n)? y
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:iOi8fyUMkomZv/nHwC7TXNjnlDNHJ1BrWSE4ik9u81I root@cdh1
The key's randomart image is:
+---[RSA 2048]----+
|         oo o.   |
|        +  =     |
| + o . . o+      |
|+ +.o.o. .o .    |
| ..o.O. So o     |
| o. + X E .      |
|  o* = X +       |
|  =.+ = o        |
|  .=oo .         |
+----[SHA256]-----+

查看生产公钥和私钥

[root@cdh1 ~]# cd .ssh/
[root@cdh1 .ssh]# ll
总用量 16
-rw------- 1 root root 1675 10月 13 19:09 id_rsa
-rw-r--r-- 1 root root  399 10月 13 19:09 id_rsa.pub
-rw-r--r-- 1 root root  542 10月 16 22:03 known_hosts

在cdh1 上创建 authorized_keys 文件

[root@cdh1 ~]# mkdir authorized_keys
[root@cdh1 ~]# cat  id_rsa.pub >>  authorized_keys
[root@cdh1 .ssh]# cat authorized_keys 
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2Y3pNroVHG5VvsIyfIsdBn8HY+OB6Y9r2VxdERzvk8JOE3Sj+U9oX/Ztep5HZDfPEd7MrGQwdYvN9tY/5uhxSTFUciYd5IqG96QKOkipBMC8TSgLF0OvsWq5PBayA0SmRagH2Kx7hJTbcaJvyh0hdQz72ka6FJYHGSZ8Pf5eRW4TJOx5D/jp15kwfnEhLCoBryzSEl8rHl+3Ej+Mk2r04KMlE+N7QMvStFrS3Ohi1FZhAxN8pCi0CROPzu1LqvP7OK5d344w2azyJFjzwLwzjD+AMje2/2j0RrFuieU2iYF+W3h7lJb+DCWMhyeNVKJJsauqTgNGNFIscaphfl2PV root@cdh1

查看其他两台（cdh2,cdh3）的id_rsa.pub文件，复制内容到cdh1的authorized_keys中。

[root@cdh2 .ssh]# cat  id_rsa.pub
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYFmai7YQ57G8BtbCvG69rLqio1QnTcQGf5XfJdUIpbWwW92VQpjdALFpXRUXlY1J/39G8Ekp226MqmNa7UdnI/ZZEc4rpqJBKl2HrWkLTV+3ViqnObXqjWSJACEiXItaEP47JjQqBrj4mqbMkhd079MsOlRPMHWDmTWsGEm/LS6ou9tgIWK00n59ocgQJpUB/UChk1Hg5cZLQKZk2IYQabPC96L7Rmv3XFpFwma48Q/X+qfbGCRx8YaAGQ7zloF1+DhyAsVLDwgL/RoD8fFWd7uIImziGtq0nrqEyVH3RBI/VioDPscrxITPlzjg5O6ly9W1wszzY0y9D0X49TKQ7 root@cdh2
[root@cdh3 .ssh]# cat  id_rsa.pub
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCwk+oSEePZkQqensjvCc3FLEmIk9C5T8Pm8Ofo8L/odX//A32dn0WlNdhwej85FKMw8x6ar7HliPSQPc5DZ7yLcmP8GTh1eZwLDVvBMM1mF88IyDFNyQiNR6BDOmexKrzfPhkW48wwisxKc4N1SP/mDeCePbn31ew1ImCitMAW3b3OKOSYwDlVJp5xmzp8v774BD64jomL+y6DUK+O6euvukTW6fN0mCkPapyPWBYIkqsqsM4OcdeGgzdW6b7q8FQ4qmkwaxzNmCPdfW4MVSrkwxPcdtmGXGv9DdOIoHOAO4duET8grLu8rbTe8ByKBzUWmXzxZ0DHxKNkntr0P0yr root@cdh3
##复制之后
[root@cdh1 .ssh]# cat authorized_keys 
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2Y3pNroVHG5VvsIyfIsdBn8HY+OB6Y9r2VxdERzvk8JOE3Sj+U9oX/Ztep5HZDfPEd7MrGQwdYvN9tY/5uhxSTFUciYd5IqG96QKOkipBMC8TSgLF0OvsWq5PBayA0SmRagH2Kx7hJTbcaJvyh0hdQz72ka6FJYHGSZ8Pf5eRW4TJOx5D/jp15kwfnEhLCoBryzSEl8rHl+3Ej+Mk2r04KMlE+N7QMvStFrS3Ohi1FZhAxN8pCi0CROPzu1LqvP7OK5d344w2azyJFjzwLwzjD+AMje2/2j0RrFuieU2iYF+W3h7lJb+DCWMhyeNVKJJsauqTgNGNFIscaphfl2PV root@cdh1
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYFmai7YQ57G8BtbCvG69rLqio1QnTcQGf5XfJdUIpbWwW92VQpjdALFpXRUXlY1J/39G8Ekp226MqmNa7UdnI/ZZEc4rpqJBKl2HrWkLTV+3ViqnObXqjWSJACEiXItaEP47JjQqBrj4mqbMkhd079MsOlRPMHWDmTWsGEm/LS6ou9tgIWK00n59ocgQJpUB/UChk1Hg5cZLQKZk2IYQabPC96L7Rmv3XFpFwma48Q/X+qfbGCRx8YaAGQ7zloF1+DhyAsVLDwgL/RoD8fFWd7uIImziGtq0nrqEyVH3RBI/VioDPscrxITPlzjg5O6ly9W1wszzY0y9D0X49TKQ7 root@cdh2
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCwk+oSEePZkQqensjvCc3FLEmIk9C5T8Pm8Ofo8L/odX//A32dn0WlNdhwej85FKMw8x6ar7HliPSQPc5DZ7yLcmP8GTh1eZwLDVvBMM1mF88IyDFNyQiNR6BDOmexKrzfPhkW48wwisxKc4N1SP/mDeCePbn31ew1ImCitMAW3b3OKOSYwDlVJp5xmzp8v774BD64jomL+y6DUK+O6euvukTW6fN0mCkPapyPWBYIkqsqsM4OcdeGgzdW6b7q8FQ4qmkwaxzNmCPdfW4MVSrkwxPcdtmGXGv9DdOIoHOAO4duET8grLu8rbTe8ByKBzUWmXzxZ0DHxKNkntr0P0yr root@cdh3

把cdh1上的authorized_keys 分发到cdh2和cdh3上

[root@cdh1 .ssh]# scp authorized_keys root@cdh2:/root/.ssh/
[root@cdh1 .ssh]# scp authorized_keys root@cdh3:/root/.ssh/

测试连接

[root@cdh1 ~]# ssh cdh2
Last login: Sat Oct 17 10:59:10 2020
[root@cdh2 ~]# exit
登出
Connection to cdh2 closed.
[root@cdh1 ~]#

3.配置NTP服务（所有节点）

修改时区（改为中国标准时区）

 [root@cdh1 ~]#  ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

安装ntp

 [root@cdh1 ~]#  ntp yum -y install ntp

3.修改配置

  [root@cdh1 ~]#  vim /etc/ntp.conf
# For more information about this file, see the man pages
# ntp.conf(5), ntp_acc(5), ntp_auth(5), ntp_clock(5), ntp_misc(5), ntp_mon(5).

driftfile /var/lib/ntp/drift

# Permit time synchronization with our time source, but do not
# permit the source to query or modify the service on this system.
restrict default nomodify notrap nopeer noquery

# Permit all access over the loopback interface.  This could
# be tightened as well, but to do so would effect some of
# the administrative functions.
restrict 127.0.0.1
restrict ::1

# Hosts on local network are less restricted.
#restrict 192.168.1.0 mask 255.255.255.0 nomodify notrap

# Use public servers from the pool.ntp.org project.
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
#server 0.centos.pool.ntp.org iburst
#server 1.centos.pool.ntp.org iburst
#server 2.centos.pool.ntp.org iburst
#server 3.centos.pool.ntp.org iburst

server ntp.aliyun.com

#broadcast 192.168.1.255 autokey        # broadcast server
#broadcastclient                        # broadcast client
#broadcast 224.0.1.1 autokey            # multicast server
#multicastclient 224.0.1.1              # multicast client
#manycastserver 239.255.254.254         # manycast server
#manycastclient 239.255.254.254 autokey # manycast client

# Enable public key cryptography.
#crypto

includefile /etc/ntp/crypto/pw

# Key file containing the keys and key identifiers used when operating
# with symmetric key cryptography. 
keys /etc/ntp/keys

4.重新启动 ntp 服务：

  [root@cdh1 ~]#  service ntpd restart

5.设置开机自启：

  [root@cdh1 ~]#  systemctl enable ntpd.service

4.安装httpd（所有节点）

 [root@cdh1 ~]#   yum -y install httpd

 [root@cdh1 ~]#  service httpd start 

 [root@cdh1 ~]#  service  httpd status

5.安装JDK（所有节点）

检查是否安装过java

 [root@cdh1 ~]#  rpm -qa | grep java

如果有，则先卸载

 [root@cdh1 ~]#  yum remove java*

安装jdk–(这里说明一下，必须要安装cdh对应版本的jdk，不然就gg)

 [root@cdh1 ~]#  rpm -ivh oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm

配置环境变量

 [root@cdh1 ~]#  vi /etc/profile
 #JDK1.8--添加
export JAVA_HOME=/usr/java/jdk1.8.0_181-cloudera
export PATH=$JAVA_HOME/bin:$PATH

刷新环境变量

 [root@cdh1 ~]#  source /etc/profile

检查是否安装成功

[root@cdh1 ~]# java -version
java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)

6.安装Mysql

创建目录

[root@cdh1 ~]# mkdir -p /usr/share/java

上传mysql-connector-java.jar

[root@cdh1 java]# ll
总用量 984
-rw-r--r-- 1 root root 1007502 8月   7 2018 mysql-connector-java.jar

检查是否安装过mysql

[root@cdh1 java]#  rpm -qa | grep mysql

如果安装了，先卸载

 [root@cdh1 java]#  yum -y remove  mysql

上传mysql安装包

[root@cdh1 ~]# mkdir -p /opt/mysql
[root@cdh1 ~]# cd /opt/mysql
[root@cdh1 mysql]# ll
-rw-r--r-- 1 root root  530882560 10月 14 18:15 mysql-5.7.26-1.el7.x86_64.rpm-bundle.tar
[root@cdh1 mysql]# tar -zxvf mysql-5.7.26-1.el7.x86_64.rpm-bundle.tar
[root@cdh1 mysql]# ll
-rw-r--r-- 1 root root  530882560 10月 14 18:15 mysql-5.7.26-1.el7.x86_64.rpm-bundle.tar
-rw-r--r-- 1 7155 31415  25381952 4月  15 2019 mysql-community-client-5.7.26-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415    280904 4月  15 2019 mysql-community-common-5.7.26-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415   3838100 4月  15 2019 mysql-community-devel-5.7.26-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415  47076368 4月  15 2019 mysql-community-embedded-5.7.26-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415  24086952 4月  15 2019 mysql-community-embedded-compat-5.7.26-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415 130023844 4月  15 2019 mysql-community-embedded-devel-5.7.26-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415   2274268 4月  15 2019 mysql-community-libs-5.7.26-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415   2118444 4月  15 2019 mysql-community-libs-compat-5.7.26-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415 173541272 4月  15 2019 mysql-community-server-5.7.26-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415 122249684 4月  15 2019 mysql-community-test-5.7.26-1.el7.x86_64.rpm

安装mysql

[root@cdh1 mysql]# rpm -ivh mysql-community-common-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-libs-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-client-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-devel-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-server-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-libs-compat-5.7.26-1.el7.x86_64.rpm

启动mysql

## 初始化mysql使mysql目录的拥有者为root用户
[root@cdh1 mysql]# mysqld --initialize --user=root
## 查看密码
[root@cdh1 mysql]# cat /var/log/mysqld.log
## 启动
[root@cdh1 mysql]#  systemctl start mysqld.service
## 开机自启
[root@cdh1 mysql]#  systemctl enable mysqld
## 登录
[root@cdh1 mysql]# mysql -u root -p
Enter password: 
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 53
Server version: 5.7.26 MySQL Community Server (GPL)

Copyright (c) 2000, 2019, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> use mysql;
ERROR 1820 (HY000): You must reset your password using ALTER USER statement before executing this statement.
mysql> use mysql
ERROR 1820 (HY000): You must reset your password using ALTER USER statement before executing this statement.
mysql> alter user user() identified by "root";
Query OK, 0 rows affected (0.00 sec)

mysql> exit

重新登录（用户名root,密码root），并创建以下数据表

create database cmserver default charset utf8 collate utf8_general_ci;
grant all on cmserver.* to 'cmserveruser'@'%' identified by 'root';

create database metastore default charset utf8 collate utf8_general_ci;
grant all on metastore.* to 'hiveuser'@'%' identified by 'root';

create database amon default charset utf8 collate utf8_general_ci;
grant all on amon.* to 'amonuser'@'%' identified by 'root';

create database rman default charset utf8 collate utf8_general_ci;
grant all on rman.* to 'rmanuser'@'%' identified by 'root';

7.安装CM组件(所有节点)

上传所需安装包（注意保持一直）
##cdh1

[root@cdh1 ~]# ll
总用量 1350216
-rw-------. 1 root root       1259 4月  25 05:49 anaconda-ks.cfg
-rw-r--r--  1 root root   10215488 10月 15 15:06 cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
-rw-r--r--  1 root root 1187380436 10月 15 15:07 cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm
-rw-r--r--  1 root root       9984 10月 15 15:06 cloudera-manager-server-6.2.0-968826.el7.x86_64.rpm

###cdh2

[root@cdh2 ~]# ll
总用量 1350192
-rw-------. 1 root root       1259 4月  25 05:49 anaconda-ks.cfg
-rw-r--r--  1 root root   10215488 10月 15 14:34 cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
-rw-r--r--  1 root root 1187380436 10月 15 14:35 cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm

###cdh3

[root@cdh3 ~]# ll
总用量 1350192
-rw-------. 1 root root       1259 4月  25 05:49 anaconda-ks.cfg
-rw-r--r--  1 root root   10215488 10月 15 14:34 cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
-rw-r--r--  1 root root 1187380436 10月 15 14:35 cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm

安装（cdh1 安装三个，cdh2和cdh3 安装两个）

  yum localinstall -y cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm 
  yum localinstall -y cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
  yum localinstall -y cloudera-manager-server-6.2.0-968826.el7.x86_64.rpm

7.CDH6.2.0 (cdh1)

检查jar目录

在这里插入图片描述
上传安装包

[root@cdh1 ~ ]#  cd /opt/cloudera/parcel-repo
[root@cdh1 parcel-repo]# ll
总用量 4476024
-rw-r--r-- 1 cloudera-scm cloudera-scm 2087665645 10月 15 13:47 CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel
-rw-r--r-- 1 cloudera-scm cloudera-scm         41 10月 15 15:28 CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel.sha
-rw-r--r-- 1 cloudera-scm cloudera-scm      33725 10月 15 13:46 manifest.json
-rw-r--r-- 1 cloudera-scm cloudera-scm  402216960 10月 15 14:23 PHOENIX-5.0.0-cdh6.2.0.p0.1308267-el7.parcel
-rw-r--r-- 1 cloudera-scm cloudera-scm         41 10月 15 14:23 PHOENIX-5.0.0-cdh6.2.0.p0.1308267-el7.parcel.sha
[root@cdh1 ~ ]#  cd /opt/cloudera/csd/
[root@cdh1 csd]# ll
总用量 8
-rw-r--r-- 1 cloudera-scm cloudera-scm 5306 10月 15 14:23 PHOENIX-1.0.jar

修改配置
###cdh1

[root@cdh1 ~ ]#  vi /etc/cloudera-scm-server/db.properties

# Auto-generated by scm_prepare_database.sh on 2020年 10月 16日 星期五 14:26:26 CST
#
# For information describing how to configure the Cloudera Manager Server
# to connect to databases, see the "Cloudera Manager Installation Guide."
#
com.cloudera.cmf.db.type=mysql
com.cloudera.cmf.db.host=localhost
com.cloudera.cmf.db.name=cmserver
com.cloudera.cmf.db.user=root
com.cloudera.cmf.db.setupType=EXTERNAL
com.cloudera.cmf.db.password=root

###cdh1、cdh2、cdh3
修改server_host=cdh1

[root@cdh1 csd]#  vi /etc/cloudera-scm-agent/config.ini

# Configuration file for cloudera-scm-agent.
# Please note that this file supports multi-line values.  Multi-line
# values are indicated by indenting following lines with a space.
#
# If you have whitespace in front of a parameter name, it will be
# read as a continuation of the previous parameter value.  Please
# be careful not to leave spaces in front of parameter names.
#
# To check if this file has spaces in front of parameters names
# you can do a grep like this:
#  grep '^[[:blank:]]' /etc/cloudera-scm-agent/config.ini

[General]
# Hostname of the CM server.
server_host=cdh1
...
...
...

8.启动CM和CDH集群

启动server (cdh1)

[root@cdh1 ~ ]#  systemctl start cloudera-scm-server
[root@cdh1 csd]# systemctl status cloudera-scm-server
● cloudera-scm-server.service - Cloudera CM Server Service
   Loaded: loaded (/usr/lib/systemd/system/cloudera-scm-server.service; enabled; vendor preset: disabled)
   Active: active (running) since 日 2020-10-18 12:47:56 CST; 50min ago
 Main PID: 939 (java)
   CGroup: /system.slice/cloudera-scm-server.service
           └─939 /usr/java/jdk1.8.0_181-cloudera/bin/java -cp .:/usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/java/postgresql-connect...

10月 18 12:48:22 cdh1 cm-server[939]: Sun Oct 18 12:48:22 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
10月 18 12:48:22 cdh1 cm-server[939]: Sun Oct 18 12:48:22 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
10月 18 12:48:22 cdh1 cm-server[939]: Sun Oct 18 12:48:22 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
10月 18 12:48:22 cdh1 cm-server[939]: Sun Oct 18 12:48:22 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
10月 18 12:49:04 cdh1 cm-server[939]: Sun Oct 18 12:49:04 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
10月 18 12:49:04 cdh1 cm-server[939]: Sun Oct 18 12:49:04 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
10月 18 12:49:04 cdh1 cm-server[939]: Sun Oct 18 12:49:04 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
10月 18 12:49:06 cdh1 cm-server[939]: Sun Oct 18 12:49:06 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
10月 18 12:49:06 cdh1 cm-server[939]: Sun Oct 18 12:49:06 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
10月 18 12:49:06 cdh1 cm-server[939]: Sun Oct 18 12:49:06 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic
Hint: Some lines were ellipsized, use -l to show in full.

启动agent（所有节点）

[root@cdh1 ~ ]#  systemctl start cloudera-scm-agent
[root@cdh1 ~]# systemctl status cloudera-scm-agent
● cloudera-scm-agent.service - Cloudera Manager Agent Service
   Loaded: loaded (/usr/lib/systemd/system/cloudera-scm-agent.service; enabled; vendor preset: disabled)
   Active: active (running) since 日 2020-10-18 12:47:56 CST; 52min ago
 Main PID: 938 (cmagent)
   CGroup: /system.slice/cloudera-scm-agent.service
           └─938 /usr/bin/python2 /opt/cloudera/cm-agent/bin/cm agent

10月 18 12:53:31 cdh1 cm[938]: ++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/hadoop-kms
10月 18 12:53:31 cdh1 cm[938]: ++ export CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/parquet
10月 18 12:53:31 cdh1 cm[938]: ++ CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/parquet
10月 18 12:53:31 cdh1 cm[938]: ++ export CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/avro
10月 18 12:53:31 cdh1 cm[938]: ++ CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/avro
10月 18 12:53:31 cdh1 cm[938]: ++ export CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/kafka
10月 18 12:53:31 cdh1 cm[938]: ++ CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/kafka
10月 18 12:53:31 cdh1 cm[938]: ++ export CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/kudu
10月 18 12:53:31 cdh1 cm[938]: ++ CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/kudu
10月 18 12:53:31 cdh1 cm[938]: + env

8.登录Web界面安装

登录
打开浏览器：http://cdh1:7180/cmf/login
登录名/密码：admin / admin
在这里插入图片描述
勾选我同意

选择免费版

进入安装界面

输入集群名

添加集群机器

默认选择

安装完成
在这里插入图片描述

9.安装大数据组件

选择自定义安装
在这里插入图片描述
勾选组件

默认安装

进入管理界面

至此，安装完成！
本次安装有很多步骤图，在安装时并未截图保存（或者忘记~）。所以不是实时连贯，如有不懂，欢迎评论私信。

注意

安装中可能出现问题：
1. hostname中指定的集群名，不能有下划线！！！！
2.防火墙请关闭，这样你可少很多烦恼？？？
3.执行systemctl start cloudera-scm-agent 和 systemctl start cloudera-scm-server启动失败
请使用：journalctl -xe指令仔细查看错误信息。
然后百度解决！
4. jdk别用自己的，要用官网提供的。
5. 保证集群机器的内存足够！！！
6. 第一次安装完成进入，可能很多都没启动成功爆红。根据提示错误信息，修正配置，重启即可！！

【参考资料】
https://www.cnblogs.com/swordfall/p/10816797.html#auto_id_12
https://blog.csdn.net/weixin_38201936/article/details/106006335

笑里笑外~

关注

8
点赞
踩
25

收藏

觉得还不错? 一键收藏
3
评论
非常详细的CDH6环境安装（离线版）

大数据学习总结系列——CDH6环境安装（离线版）CDH6环境安装（离线版）一、预备阶段1. 集群机器2. 准备安装包二、环境安装（关闭防火墙~）1.修改hostname和hosts(所有节点)2.SSH免密登录（所有节点）3.配置NTP服务（所有节点）4.安装JDK（所有节点）5.安装Mysql5.安装CM组件(所有节点)总结CDH6环境安装（离线版）官网介绍:         CDH是Cloudera的100％开源平台发行版
复制链接

扫一扫