大数据之路：CDH管理CentOS7配置（4.安装CDH）

最新推荐文章于 2023-02-09 11:52:42 发布

Terminal丶句点

最新推荐文章于 2023-02-09 11:52:42 发布

阅读量462

点赞数

分类专栏：大数据

本文链接：https://blog.csdn.net/qq_40026668/article/details/79220161

版权

大数据专栏收录该内容

3 篇文章 0 订阅

订阅专栏

资源下载地址：
http://archive-primary.cloudera.com/cm5/cm/5/cloudera-manager-centos7-cm5.13.1_x86_64.tar.gz

http://archive.cloudera.com/cdh5/parcels/5.13.1/CDH-5.13.1-1.cdh5.13.1.p0.2-el7.parcel
http://archive.cloudera.com/cdh5/parcels/5.13.1/CDH-5.13.1-1.cdh5.13.1.p0.2-el7.parcel.sha1
http://archive.cloudera.com/cdh5/parcels/5.13.1/manifest.json

https://pan.baidu.com/s/1dINqV0

关闭selinux

vim /etc/sysconfig/selinux 
SELINUX=disabled

重启生效

安装第三方依赖包（所有节点）

首先下载一个rpm包
http://www.percona.com/redir/downloads/Percona-XtraDB-Cluster/5.5.37-25.10/RPM/rhel6/x86_64/Percona-XtraDB-Cluster-shared-55-5.5.37-25.10.756.el6.x86_64.rpm
执行此包

rpm -ivh Percona-XtraDB-Cluster-shared-55-5.5.37-25.10.756.el6.x86_64.rpm

安装第三方依赖

yum install chkconfig python bind-utils psmisc libxslt zlib sqlite fuse fuse-libs redhat-lsb cyrus-sasl-plain cyrus-sasl-gssapi

配置CM

1.解压相关cm tar包到指定目录（所有节点）

mkdir /opt/cloudera-manager
tar -axvf cloudera-manager-centos7-cm5.13.1_x86_64.tar.gz -C /opt/cloudera-manager

2.创建cloudera-scm用户（所有节点）

useradd -r -d /opt/cloudera-manager/cm-5.13.1/run/cloudera-scm-server -M -c "Cloudera SCM User" cloudera-scm

3.配置从节点cloudera-manger-agent指向主节点服务器（根据集群的分配这里面应当全部节点都需要）

vim /opt/cloudera-manager/cm-5.13.1/etc/cloudera-scm-agent/config.ini
server_host=master //主节点名

4.创建parcel-repo仓库目录（主节点）
把xx.sha1改为xx.sha，并把.json文件里的hash值复制到xx.sha里边

mkdir -p /opt/cloudera/parcel-repo
chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo
cp CDH-5.13.1-1.cdh5.13.1.p0.2-el7.parcelparcel CDH-5.13.1-1.cdh5.13.1.p0.2-el7.parcel.parcel.sha manifest.json /opt/cloudera/parcel-repo

5.创建parcels目录（所有节点）

mkdir -p /opt/cloudera/parcels
chown cloudera-scm:cloudera-scm /opt/cloudera/parcels

6.初始脚本配置数据库scm_prepare_database.sh

mkdir -p /usr/share/java
mv mysql-connector-java-xxx-bin.jar /usr/share/java/mysql-connector-java.jar

/opt/cloudera-manager/cm-5.13.1/share/cmf/schema/scm_prepare_database.sh mysql -hmaster -uroot -psww@12138QAz --scm-host master scm scm scm

这一步如果出现如下错误：

ERROR com.cloudera.enterprise.dbutil.DbProvisioner  - Exception when creating/dropping database with user 'root' and jdbc url 'jdbc:mysql://master/?useUnicode=true&characterEncoding=UTF-8'
java.sql.SQLException: Access denied for user 'root'@'master' (using password: YES)

检查mysql的user表Grant_priv=’Y’, Super_priv=’Y’两个字段的值是否为’Y’
7.启动CDH

/opt/cloudera-manager/cm-5.13.1/etc/init.d/cloudera-scm-server start //主节点
/opt/cloudera-manager/cm-5.13.1/etc/init.d/cloudera-scm-agent start  //所有子节点