cloudera manager5.11.0离线安装详细步骤

第一步： （下载安装包）

• cm5.11.0 bin包
  http://archive.cloudera.com/cm5/installer/5.11.0/
• cm5.11.0 依赖的rpm包
  http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.11/RPMS/x86_64/
• cm5.11.0 依赖的parcels包，也就是cdh包
  http://archive.cloudera.com/cdh5/parcels/5.11.0/

第二步： （使用本地CentOS镜像源）

[root@hadoop06 ~]# cd /etc/yum.repos.d/
[root@hadoop06 yum.repos.d]# ls
backup  CentOS-Base.repo  epel.repo
[root@hadoop06 yum.repos.d]# mv epel.repo epel.repo.bak
[root@hadoop06 yum.repos.d]# yum clean all（清理缓存）
[root@hadoop06 yum.repos.d]# yum list

第三步： （下载Cloudera Agent所依赖的包）

yum install -y cyrus-sasl-plain cyrus-sasl-gssapi  portmap  
yum install -y fuse-libs bind-utils libxslt 
yum install -y /lib/lsb/init-functions
yum install -y mod_ssl openssl-devel python-psycopg2  MySQL-python

第四步： （安装Httpd服务）

[root@hadoop06 ~]# yum install httpd -y
[root@hadoop06 ~]# service httpd start
[root@hadoop06 ~]# chkconfig httpd on
[root@hadoop06 ~]# chkconfig httpd on
[root@hadoop06 ~]# cd /var/www/html
[root@hadoop06 html]# mkdir -p cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/

第五步： （配置repodata目录）

[root@hadoop06 cm] yum install -y createrepo deltarpm python-deltarpm
[root@hadoop06 cm] cd /var/www/html/cm5/redhat/6/x86_64/cm/5/
[root@hadoop06 cm] createrepo .
Spawning worker 0 with 7 pkgs
Workers Finished
Gathering worker results
Saving Primary metadata
Saving file lists metadata
Saving other metadata
Generating sqlite DBs
Sqlite DBs complete

第六步： （配置Httpd本地服务源）

[root@hadoop06 software]# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.111.128 hadoop06 archive.cloudera.com
192.168.111.129 hadoop07
[root@hadoop06 html]# cd /etc/yum.repos.d
[root@hadoop06 yum.repos.d]# touch cloudera-manager.repo
[root@hadoop06 yum.repos.d]# cat cloudera-manager.repo 
[cloudera-manager]
name=Cloudera Manager
baseurl=http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5/
enabled=1

注意：
archive.cloudera.com是本地yum源的host

[root@hadoop06 yum.repos.d]# yum list

访问：http://hadoop06/cm5/redhat/6/x86_64/cm/5/

第七步： （安装postgresql服务）

[root@hadoop06 postgresql]# ls
总用量 6564
postgresql-8.4.18-1.el6_4.x86_64.rpm
postgresql-libs-8.4.18-1.el6_4.x86_64.rpm
postgresql-server-8.4.18-1.el6_4.x86_64.rpm
[root@hadoop06 postgresql]# rpm -ivh postgresql-libs-8.4.18-1.el6_4.x86_64.rpm
[root@hadoop06 postgresql]# rpm -ivh postgresql-8.4.18-1.el6_4.x86_64.rpm
[root@hadoop06 postgresql]# rpm -ivh postgresql-server-8.4.18-1.el6_4.x86_64.rpm

第八步： （配置Server服务）

[root@hadoop06 software]# chmod 777 cloudera-manager-installer.bin 
[root@hadoop06 software]# ./cloudera-manager-installer.bin 
注意：
    如果使用该命令进行包安装的情况下，报错，出现异常，手动进行安装配置的yum源

第九步： （关闭防火墙和Selinux服务）

[root@hadoop06 ~]# /etc/init.d/iptables stop
[root@hadoop06 ~]# chkconfig iptables off
[root@hadoop06 cdh5.11.0]# setenforce 0
修改/etc/selinux/config 文件
将SELINUX=enforcing改为SELINUX=disabled

第十步： （启动server服务进程）

[root@hadoop06 yum.repos.d]# /etc/init.d/cloudera-scm-server-db start
pg_ctl: server is running (PID: 1891)
/usr/bin/postgres "-D" "/var/lib/cloudera-scm-server-db/data"
[root@hadoop06 yum.repos.d]# /etc/init.d/cloudera-scm-server start
Starting cloudera-scm-server:                              [  OK  ]
[root@hadoop06 software]# /etc/init.d/postgresql start
启动 postgresql 服务：                                          [确定]
<br>
等待大概两分钟，访问 http://hadoop06:7180/ 进入管理端 (登陆名:admin 密码:admin)

第十一步： 将cdh的parcel包放置到parcel-repo中

[root@hadoop1 parcel-repo]# pwd
/opt/cloudera/parcel-repo
[root@hadoop1 parcel-repo]# ll
total 1485360
-rw-r--r-- 1 root root 1520997979 Jun 13  2017 CDH-5.11.0-1.cdh5.11.0.p0.34-el6.parcel
-rw-r--r-- 1 root root         41 Jun 13  2017 CDH-5.11.0-1.cdh5.11.0.p0.34-el6.parcel.sha1
[root@hadoop1 parcel-repo]# mv CDH-5.11.0-1.cdh5.11.0.p0.34-el6.parcel.sha1 CDH-5.11.0-1.cdh5.11.0.p0.34-el6.parcel.sha

设置parcel包更新频率


出现以torrent结尾的说明parcel包分配成功

[root@hadoop1 parcel-repo]# ll
total 1485420
-rw-r--r-- 1 root         root         1520997979 Jun 13  2017 CDH-5.11.0-1.cdh5.11.0.p0.34-el6.parcel
-rw-r--r-- 1 root         root                 41 Jun 13  2017 CDH-5.11.0-1.cdh5.11.0.p0.34-el6.parcel.sha
-rw-r----- 1 cloudera-scm cloudera-scm      58207 Feb  6 15:50 CDH-5.11.0-1.cdh5.11.0.p0.34-el6.parcel.torrent

第十二步： （部署服务）

注意：
1、出现CDH-5.11.0-1.cdh5.11.0.p0.34说明成功
2、parcel包放到必须在postgresql初始化完成后才能放入，否则不会显示


注意：
1、必须是http服务
2、自定义的yum仓库
3、清除缓存

[root@hadoop2 yum.repos.d]# yum clean all

4、查看repo文件

[root@hadoop2 yum.repos.d]# ll
total 12
-rw-r--r-- 1 root root 675 Feb  6 10:51 CentOS-Base.repo
-rw-r--r-- 1 root root 129 Feb  6 16:05 cloudera-manager.repo
-rw-r--r-- 1 root root 230 Feb  6 10:51 epel.repo
[cloudera-manager]
name = Cloudera Manager, Version 5.11.0
baseurl = http://172.16.29.195/cm5/redhat/6/x86_64/cm/5/
gpgcheck = 0
#### 查看是否能ping通
[root@hadoop2 yum.repos.d]# ping 172.16.29.195
PING 47.97.113.34 (47.97.113.34) 56(84) bytes of data.
^C
--- 47.97.113.34 ping statistics ---
2 packets transmitted, 0 received, 100% packet loss, time 1058ms

5、报错

Dependencies Resolved

=====================================================================================================================================
 Package                              Arch               Version                                  Repository                    Size
=====================================================================================================================================
Installing:
 cloudera-manager-agent               x86_64             5.11.0-1.cm5110.p0.101.el6               cloudera-manager             9.1 M
Installing for dependencies:
 cloudera-manager-daemons             x86_64             5.11.0-1.cm5110.p0.101.el6               cloudera-manager             635 M

Transaction Summary
=====================================================================================================================================
Install       2 Package(s)

Total download size: 644 M
Installed size: 859 M
Downloading Packages:
(1/2): cloudera-manager-agent-5.11.0-1.cm5110.p0.101.el6.x86_64.rpm                                           | 9.1 MB     00:00     
(2/2): cloudera-manager-daemons-5.11.0-1.cm5110.p0.101.el6.x86_64.rpm                                         | 635 MB     00:15     
-------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                 42 MB/s | 644 MB     00:15     
warning: rpmts_HdrFromFdno: Header V4 DSA/SHA1 Signature, key ID e8f86acd: NOKEY


Public key for cloudera-manager-daemons-5.11.0-1.cm5110.p0.101.el6.x86_64.rpm is not installed

解决方案：
1、手动安装agent和daemon服务
2、开启gpgcheck=0

[root@hadoop2 yum.repos.d]# cat cloudera-manager.repo 
[cloudera-manager]
name = Cloudera Manager, Version 5.11.0
baseurl = http://hadoop1/cm5/redhat/6/x86_64/cm/5/
enabled = 1
gpgcheck = 0

3、手动启动agent服务

[root@hadoop2 yum.repos.d]# /etc/init.d/cloudera-scm-agent start
Starting cloudera-scm-agent:                               [  OK  ]