cloudera-manager 5.4.10的安装

[root@DEV-RHEL66-055 appuser]# cat /etc/redhat-release
Red Hat Enterprise Linux Server release 6.6 (Santiago)
[root@DEV-RHEL66-055 appuser]# more /proc/version
Linux version 2.6.32-504.el6.x86_64 (mockbuild@x86-023.build.eng.bos.redhat.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-11) (GCC) ) #1 SMP Tue S
ep 16 01:56:35 EDT 2014

一、安装jdk（jdk-7u80-linux-x64.rpm）

1.下载地址：
http://download.oracle.com/otn/java/jdk/7u80-b15/jdk-7u80-linux-x64.rpm?AuthParam=1468991175_e4aced7d33cc4a38c5dc961fc39c1535
2.检查已经安装版本（如果有高于1.8的版本需要卸载）：
[root@DEV-RHEL66-055 appuser]# rpm -qa |grep java
[root@DEV-RHEL66-055 appuser]# yum info installed | grep java
3.RPM方式安装jdk：
rpm -ivh jdk-7u80-linux-x64.rpm

4. 添加节点名称：
[root@DEV-RHEL66-055 ~]# vi /etc/hosts （添加节点名称）

5. 添加无密码登录：

如果需要root无密码SSH登录，需要检查 /etc/ssh/sshd_config ，确保 PermitRootLogin yes
6. 拷贝安装介质到各节点
[appuser@DEV-RHEL66-055 ~]$ scp * DEV-RHEL66-056:~/

7.在各节点安装JDK（方法重复步骤3）

---

修改java启动的最大最小内存

---

8.关闭所有节点防火墙
chkconfig iptables off
vi /etc/selinux/config （设置SELINUX=disabled）

二、在主节点安装mysql

1. 准备mysql安装介质：
http://120.52.72.22/cdn.mysql.com/c3pr90ntc0td//Downloads/MySQL-5.7/mysql-5.7.13-1.el6.x86_64.rpm-bundle.tar

2. 安装mysql
删除旧版本mysql、解压 mysql-5.7.13-1.el6.x86_64.rpm-bundle.tar

[root@DEV-RHEL66-055 mysql_rpms]$ rpm -qa | grep mysql
mysql-libs-5.1.73-3.el6_5.x86_64
[root@DEV-RHEL66-055 ~]$ rpm -e --nodeps mysql-libs-5.1.73-3.el6_5.x86_64
[root@DEV-RHEL66-055 ~]$ rpm -qa | grep mysql
[root@DEV-RHEL66-055 ~]$ mkdir mysql_rpms
[root@DEV-RHEL66-055 ~]$ tar xvf mysql-5.7.13-1.el6.x86_64.rpm-bundle.tar -C mysql_rpms
[root@DEV-RHEL66-055 ~]$ cd mysql_rpms/

依次安装mysql的rpm文件

[root@DEV-RHEL66-055 mysql_rpms]# rpm -ivh mysql-community-common-5.7.13-1.el6.x86_64.rpm 
[root@DEV-RHEL66-055 mysql_rpms]# rpm -ivh mysql-community-libs-5.7.13-1.el6.x86_64.rpm 
[root@DEV-RHEL66-055 mysql_rpms]# rpm -ivh mysql-community-client-5.7.13-1.el6.x86_64.rpm
[root@DEV-RHEL66-055 mysql_rpms]# rpm -ivh mysql-community-server-5.7.13-1.el6.x86_64.rpm 

3.初始化、配置、测试mysql
初始化、密码修改：
可参考 http://jingyan.baidu.com/album/93f9803f010d8fe0e56f555e.html

[root@DEV-RHEL66-055 mysql_rpms]# /usr/sbin/mysqld --initialize --user=mysql
[root@DEV-RHEL66-055 mysql_rpms]# /usr/sbin/mysqld --initialize-insecure --user=mysql
[root@DEV-RHEL66-055 mysql_rpms]# mysql
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)
[root@DEV-RHEL66-055 mysql_rpms]# tail /var/log/mysqld.log | grep password
2016-07-25T07:26:44.443853Z 1 [Note] A temporary password is generated for root@localhost: r,W2qQTSdjhA
[root@DEV-RHEL66-055 mysql_rpms]# chown mysql:mysql /var/lib/mysql -R
[root@DEV-RHEL66-055 mysql_rpms]# /etc/init.d/mysqld start
Starting mysqld:                                           [  OK  ]
[root@DEV-RHEL66-055 mysql_rpms]# mysql -uroot -p
Enter password: 
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 3
Server version: 5.7.13

Copyright (c) 2000, 2016, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> 

alter user 'root'@'localhost' identified by 'password';
=======================================================

Query OK, 0 rows affected (0.00 sec)

mysql> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| mysql              |
| performance_schema |
| sys                |
+--------------------+
4 rows in set (0.00 sec)

mysql> exit
Bye
#将mysql设置为开机启动
[root@DEV-RHEL66-055 mysql_rpms]# chkconfig mysqld on

测试连接mysql

[root@DEV-RHEL66-055 mysql_rpms]# mysql -uroot -ppasswd
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 6
Server version: 5.7.13 MySQL Community Server (GPL)

Copyright (c) 2000, 2016, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
--hive数据库
mysql> create database hive DEFAULT CHARSET utf8 COLLATE utf8_general_ci ;
========================================================================

Query OK, 1 row affected (0.01 sec)
--集群监控数据库

mysql> create database amon DEFAULT CHARSET utf8 COLLATE utf8_general_ci ;
========================================================================

Query OK, 1 row affected (0.00 sec)
--hue数据库

mysql> create database hue DEFAULT CHARSET utf8 COLLATE utf8_general_ci ;
========================================================================

Query OK, 1 row affected (0.00 sec)

mysql> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| amon               |
| hive               |
| hue                |
| mysql              |
| performance_schema |
| sys                |
+--------------------+
7 rows in set (0.01 sec)
--所有IP地址可以root用户连接mysql
mysql> 

grant all on *.* to root@"%" Identified by "passwd";
====================================================

Query OK, 0 rows affected, 1 warning (0.00 sec)

关于mysql驱动的安装
根据安装文档的说明（http://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_mysql.html#cmig_topic_5_5_2），由于hive外部数据类型和版本可自行选择配置，所以默认情况下，cloudera不提供mysql驱动库的jar，需要自行安装，建议从mysql网站下载5.1.3x版本进行安装。mysql的连接驱动（mysql-connector-java-5.1.39-bin.jar）需要放置在各类应用角色的服务器上，比如hue在node1，Activity Monitor在node2，那么mysql驱动需要在node1，node2分别部署，简单来说，所有节点都部署数据库（mysql）驱动，官网推荐的方法如下：

[root@DEV-RHEL66-064 ~]# mkdir -p /usr/share/java/
[root@DEV-RHEL66-064 ~]# cp -v /home/appuser/mysql-connector-java-5.1.7-bin.jar  /usr/share/java/mysql-connector-java.jar
`/home/appuser/mysql-connector-java-5.1.39-bin.jar' -> `/usr/share/java/mysql-connector-java.jar'
[root@DEV-RHEL66-064 ~]# 

![可以看到cloudera的java进程启动后加载/user/share/java下名为mysql-connector-java.jar（名字不能错）]

三、安装 Cloudera Manager 5

参考
http://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_install_path_c.html#cmig_topic_6_7_2

1.安装介质准备：
http://archive-primary.cloudera.com/cm5/cm/5/cloudera-manager-el6-cm5.4.10_x86_64.tar.gz
2.解压CM5

[root@DEV-RHEL66-055 appuser]# mkdir /opt/cloudera-manager
[root@DEV-RHEL66-055 appuser]# tar xzf cloudera-manager-el6-cm5.4.10_x86_64.tar.gz -C /opt/cloudera-manager/

3.添加cloudera-scm用户（需要在所有节点上添加用户cloudera-scm）

[root@DEV-RHEL66-055 appuser]# useradd --system --home=/opt/cloudera-manager/cm-5.4.10/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm

4.配置 Cloudera Manager Server 数据库

[root@DEV-RHEL66-055 appuser]# sh /opt/cloudera-manager/cm-5.4.10/share/cmf/schema/scm_prepare_database.sh mysql cm -uroot -ppasswd -hlocalhost --scm-host localhost scm scm scm
JAVA_HOME=/usr/java/jdk1.7.0_80
Verifying that we can write to /opt/cloudera-manager/cm-5.4.10/etc/cloudera-scm-server
Creating SCM configuration file in /opt/cloudera-manager/cm-5.4.10/etc/cloudera-scm-server
Executing:  /usr/java/jdk1.7.0_80/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/opt/cloudera-manager/cm-5.4.10/share/cmf/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /opt/cloudera-manager/cm-5.4.10/etc/cloudera-scm-server/db.properties com.cloudera.cmf.db.
2016-07-25 17:37:44,864 [main] INFO  com.cloudera.enterprise.dbutil.DbCommandExecutor  - Successfully connected to database.
All done, your SCM database is configured correctly!

5.创建Parcel目录

[root@DEV-RHEL66-055 appuser]#  mkdir -p /opt/cloudera/parcel-repo
[root@DEV-RHEL66-055 appuser]# chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo
# 需要在所有节点创建此目录
# 为了方便，可以创建root用户的无密码登录（方法参看"一.5"）
[root@DEV-RHEL66-055 appuser]#  mkdir -p /opt/cloudera/parcels

四、安装CDH5

1. 下载CDH5.4.10介质

http://archive-primary.cloudera.com/cdh5/parcels/5.4.10/CDH-5.4.10-1.cdh5.4.10.p0.16-el6.parcel （Red Hat 6 ）

http://archive-primary.cloudera.com/cdh5/parcels/5.4.10/CDH-5.4.10-1.cdh5.4.10.p0.16-el6.parcel.sha1 （Red Hat 6 ）

http://archive-primary.cloudera.com/cdh5/parcels/5.4.10/manifest.json （操作系统与各类分布式应用列表）

1. 拷贝CDH5.4.10文件到主节点

[root@DEV-RHEL66-055 ~]# ll /opt/cloudera/parcel-repo/
total 1233984
-rw-r--r--. 1 root root 1263545730 Jul 25 18:05 CDH-5.4.10-1.cdh5.4.10.p0.16-el6.parcel
-rw-r--r--  1 root root         41 Jul 26 15:24 CDH-5.4.10-1.cdh5.4.10.p0.16-el6.parcel.sha
-rw-r--r--. 1 root root      43171 Jul 25 18:06 manifest.json

五、在Linux安装Cloudera所依赖的工具

1.根据官方安装指导，Cloudera的运行还依赖以下工具软件，如果操作系统没有安装需要重新安装一下：
chkconfig
python (2.6 required for CDH 5)
bind-utils
psmisc
libxslt
zlib
sqlite
cyrus-sasl-plain
cyrus-sasl-gssapi
fuse
portmap
fuse-libs
redhat-lsb

2.参考以下方式实时安装过程

# 检查已经安装的工具：
[root@DEV-RHEL66-055 ~]# yum info installed | grep cyrus-sasl-gssapi

# 安装需要的工具：
[root@DEV-RHEL66-055 ~]# yum -y install cyrus-sasl-gssapi.x86_64 
Installed:
  cyrus-sasl-gssapi.x86_64 0:2.1.23-15.el6 
Complete!

六、启动 Cloudera Manager Server

1. 启动CM server：
/opt/cloudera-manager/cm-5.4.10/etc/init.d/cloudera-scm-server start

[root@DEV-RHEL66-055 ~]# /opt/cloudera-manager/cm-5.4.10/etc/init.d/cloudera-scm-server start
Starting cloudera-scm-server:  
[root@DEV-RHEL66-055 ~]# more /opt/cloudera-manager/cm-5.4.10/log/cloudera-scm-server/cloudera-scm-server.out 
JAVA_HOME=/usr/java/jdk1.7.0_80
[root@DEV-RHEL66-055 ~]# 

2. 添加Cloudera Manager Server 开机自动启动

[root@DEV-RHEL66-055 ~]# cp /opt/cloudera-manager/cm-5.4.10/etc/init.d/cloudera-scm-server /etc/init.d/cloudera-scm-server
[root@DEV-RHEL66-055 ~]# chkconfig cloudera-scm-server on
[root@DEV-RHEL66-055 ~]# 

七、启动 Cloudera Manager Agents

1.在所有节点上启动 Cloudera Manager Agent

[root@DEV-RHEL66-056 opt]# /opt/cloudera-manager/cm-5.4.10/etc/init.d/cloudera-scm-agent start

2.添加 Cloudera Manager Agents 重启自动启动

[root@DEV-RHEL66-056 opt]# cp /opt/cloudera-manager/cm-5.4.10/etc/init.d/cloudera-scm-agent /etc/init.d/cloudera-scm-agent
[root@DEV-RHEL66-056 opt]# chkconfig cloudera-scm-agent on
[root@DEV-RHEL66-056 opt]# 

八、群集安装—检查主机正确性时的问题

1.所有节点设置 /proc/sys/vm/swappiness 内容为0

# 设置所【有节点】 /proc/sys/vm/swappiness 的值为0（原值60）
[appuser@DEV-RHEL66-055 ~]$ more /proc/sys/vm/swappiness  
60
[root@DEV-RHEL66-055 parcel-repo]# echo 0 > /proc/sys/vm/swappiness  
[root@DEV-RHEL66-055 parcel-repo]# more /proc/sys/vm/swappiness  
0
[root@DEV-RHEL66-055 parcel-repo]# 

2.所有节点禁用“透明大页面”

# 禁用 "透明大页面"
[root@DEV-RHEL66-055 parcel-repo]# more /sys/kernel/mm/redhat_transparent_hugepage/defrag 
[always] madvise never
[root@DEV-RHEL66-055 parcel-repo]# echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
[root@DEV-RHEL66-055 parcel-repo]# more /sys/kernel/mm/redhat_transparent_hugepage/defrag 
always madvise [never]
[root@DEV-RHEL66-055 parcel-repo]# 


# 将禁用语句加入 /etc/rc.local
[root@DEV-RHEL66-055 parcel-repo]# vi /etc/rc.local 
#!/bin/sh
#
# This script will be executed *after* all the other init scripts.
# You can put your own initialization stuff in here if you don't
# want to do the full Sys V style init stuff.

touch /var/lock/subsys/local
/usr/local/nagios/bin/nrpe -c /usr/local/nagios/etc/nrpe.cfg -d
echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
~
~

九、完成页面

完成后又添加了节点dev-rhel66-055，启动055上的agent即可，删除已有的集群，重新扫描可以进行SSH（端口22）的服务器，出现10台服务器，配置集群

1、安装cloudera集群后发现，最好使用独立的物理机，HDFS的性能源自其各节点的计算单元与本地存储单元的结合，虚拟机并不划算。
2、主机的内存至少在32G，推荐64G内存
3、在开是的测试过程中，删除了cluster1，然后重建一个新的cluster，在此之前需要在所有节点上做如下工作：

#如果需要重建集群
#需要删除zookeeper目录下的内容，因为hbase和solr在其上注册了服务
#需要删除/dfs/nn/current、/dfs/snn/current、/dfs/dn/current 内容否则HDFS无法建立
#需要删除/var/lib/oozie目录，否则oozie无法建立
rm -fr  /var/lib/zookeeper/*
rm -fr /dfs/nn/current
rm -fr /dfs/snn/current
rm -fr /dfs/dn/current 
rm -fr /var/lib/oozie

#需要删除oozie数据库，否则oozie服务器无法继续

mysql> drop database oozie ;
Query OK, 12 rows affected (0.25 sec)

mysql> create database oozie ;
Query OK, 1 row affected (0.00 sec)

十一、关于服务器的添加

检查了一下网络上的关于kafka服务器的安装，得出如下安装顺序：
1、下载Kafka安装介质：
http://archive.cloudera.com/kafka/parcels/2.0.2/KAFKA-2.0.2-1.2.0.2.p0.5-el6.parcel
http://archive.cloudera.com/kafka/parcels/2.0.2/KAFKA-2.0.2-1.2.0.2.p0.5-el6.parcel.sha1（.sha1要改成.sha）
2、拷贝安装介质到Cloudera
其中kafka的manifest.json不需要拷贝

[root@DEV-RHEL66-055 parcel-repo]# cp /home/appuser/kafka/KAFKA-2.0.2-1.2.0.2.p0.5-el6.parcel* .
[root@DEV-RHEL66-055 parcel-repo]# ll
total 1265660
-rw-r--r--. 1 root root 1263545730 Jul 25 18:05 CDH-5.4.10-1.cdh5.4.10.p0.16-el6.parcel
-rw-r--r--  1 root root         41 Jul 26 15:24 CDH-5.4.10-1.cdh5.4.10.p0.16-el6.parcel.sha
-rw-r--r--. 1 root root      43171 Jul 25 18:06 CDH_manifest.json
-rw-r--r--  1 root root   32378038 Jul 28 16:28 KAFKA-2.0.2-1.2.0.2.p0.5-el6.parcel
-rw-r--r--  1 root root         41 Jul 28 16:28 KAFKA-2.0.2-1.2.0.2.p0.5-el6.parcel.sha1
-rw-r--r--  1 root root       4180 Jul 28 15:52 KAFKA_manifest.json
-rw-r--r--  1 root root      43171 Jul 28 16:23 manifest.json