CDH6.2 版本安装过程

1、修改主机名

hostnamectl set-hostname hdp-223

hostnamectl set-hostname hdp-224

hostnamectl set-hostname hdp-225

 2、关闭防火墙

systemctl stop firewalld

systemctl disable firewalld

 3、关闭selinux

vim /etc/selinux/config SELINUX=disabled

 4、root用户免密码登录

ssh-keygen -t dsa -P '' -f /root/.ssh/id_dsa

cat /root/.ssh/id_dsa.pub >> /root/.ssh/authorized_keys

然后将id_dsa.pub复制到其他节点，追加到 /root/.ssh/authorized_keys文件末尾，即可实现免密码登录

5、ntp时钟同步

6、修改Linux swappiness参数

cd /usr/lib/tuned/

grep "vm.swappiness" * -R

latency-performance/tuned.conf:vm.swappiness=10

throughput-performance/tuned.conf:vm.swappiness=10

virtual-guest/tuned.conf:vm.swappiness = 30

上述文件中的值都修改为0

7、禁用透明页

echo never > /sys/kernel/mm/transparent_hugepage/defrag

echo never > /sys/kernel/mm/transparent_hugepage/enabled

8、安装jdk

rpm -ivh oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm

################################config

jdk####################################################

export JAVA_HOME=/usr/java/jdk1.8.0_181-cloudera

export

CLASSPATH=.:$JAVA_HOME/jre/lib/rt.jar:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

export PATH=$JAVA_HOME/bin:$PATH

################################config

jdk####################################################

10、安装cloudera-scm-agent依赖服务

yum install bind-utils libxslt cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs httpd mod_ssl

python-psycopg2 MySQL-python libpq.so.5

11、安装配置mysql

create database hue default character set utf8 default collate utf8_general_ci;

create database hive default character set utf8 default collate utf8_general_ci;

create database oozie default character set utf8 default collate utf8_general_ci;

create database sentry default character set utf8 default collate utf8_general_ci;

create database cmserver default character set utf8 default collate utf8_general_ci;

grant all on cmserver.* to 'cmserver'@'%' identified by 'cmserver';

grant all on hue.* to 'hue'@'%' identified by 'hue';

grant all on hive.* to 'hive'@'%' identified by 'hive';

grant all on oozie.* to 'oozie'@'%' identified by 'oozie';

grant all on sentry.* to 'sentry'@'%' identified by 'sentry';

update mysql.user set authentication_string=password('密码') where user='root';

flush privileges;

grant all privileges on *.* to root@'%' identified by '密码';

flush privileges;

update user set authentication_string = password('密码'), password_expired = 'N',

password_last_changed = now() where user = 'root';

update mysql.user set authentication_string=password('密码') where user='root';

flush privileges;

12 安装顺序

依次安装：

rpm -ivh cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm

rpm -ivh cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm

rpm -ivh cloudera-manager-server-6.2.0-968826.el7.x86_64.rpm

sha1sum CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel | awk '{ print $1 }' > CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel.sha

13、初始化cmserve数据库

/opt/cloudera/cm/schema/scm_prepare_database.sh mysql cmserver cmserver root/1qaz1QAZ,./

---------- CDH6.2 ----------

systemctl restart cloudera-scm-server

systemctl restart cloudera-scm-agent

在da-master01上执行：

/opt/cloudera-manager/cm-6.2.0/etc/init.d/cloudera-scm-server start

/opt/cloudera-manager/cm-6.2.0/etc/init.d/cloudera-scm-agent start

在其它节点上执行：

/opt/cloudera-manager/etc/init.d/cloudera-scm-server start

/opt/cloudera-manager/etc/init.d/cloudera-scm-agent start