大数据集群CDH5.7安装部署之三

1.安装http 和启动http服务
[root@hadoop-01 ~]# rpm -qa|grep httpd
[root@hadoop-01 ~]# yum install -y httpd

[root@hadoop-01 ~]# chkconfig --list|grep httpd
httpd 0:off 1:off 2:off 3:off 4:off 5:off 6:off

[root@hadoop-01 ~]# chkconfig httpd on
[root@hadoop-01 ~]# chkconfig --list|grep httpd
httpd 0:off 1:off 2:on 3:on 4:on 5:on 6:off
[root@hadoop-01 ~]# service httpd start

[root@hadoop001 ~]# systemctl list-unit-files |grep httpd
httpd.service disabled
[root@hadoop001 ~]#

2.创建 parcels文件
[root@hadoop-01 rpminstall]# cd /var/www/html
[root@hadoop-01 html]# mkdir parcels
[root@hadoop-01 html]# cd parcels

3.在http://archive.cloudera.com/cdh5/parcels/5.7.0/,
将
CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel
CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.sha1
manifest.json
这三个文件下载到window桌面上(在网络比较通畅情况下,可以直接wget),
然后通过rz命令上传到 /var/www/html/parcels/目录中,
然后将CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.sha1重命名
(去掉名称结尾"1",不然cdh在装的时候,会一直认为在下载,是未完成的)

[root@hadoop-01 parcels]# wget http://archive.cloudera.com/cdh5/parcels/5.7.0/CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel
[root@hadoop-01 parcels]# wget http://archive.cloudera.com/cdh5/parcels/5.7.0/CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.sha1
[root@hadoop-01 parcels]# wget http://archive.cloudera.com/cdh5/parcels/5.7.0/manifest.json

[root@hadoop-01 parcels]# ll
total 1230064
-rw-r–r-- 1 root root 1445356350 Nov 16 21:14 CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel
-rw-r–r-- 1 root root 41 Sep 22 04:25 CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.sha1
-rw-r–r-- 1 root root 56892 Sep 22 04:27 manifest.json
[root@hadoop-01 parcels]# mv CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.sha1 CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.sha

校验文件下载未损坏:
[root@sht-sgmhadoopcm-01 parcels]# sha1sum CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel
b6d4bafacd1cfad6a9e1c8f951929c616ca02d8f CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel
[root@sht-sgmhadoopcm-01 parcels]#
[root@sht-sgmhadoopcm-01 parcels]# cat CDH-5.7.0-1.cdh5.7.0.p0.45-el6.parcel.sha
b6d4bafacd1cfad6a9e1c8f951929c616ca02d8f
[root@sht-sgmhadoopcm-01 parcels]#

4.在http://archive.cloudera.com/cm5/repo-as-tarball/5.7.0/,下载cm5.7.0-centos6.tar.gz包
[root@hadoop-01 ~]$ cd /opt/rpminstall
[root@hadoop-01 rpminstall]$ wget http://archive.cloudera.com/cm5/repo-as-tarball/5.7.0/cm5.7.0-centos6.tar.gz
[root@hadoop-01 rpminstall]$ ll
total 1523552
-rw-r–r-- 1 root root 815597424 Sep 22 02:00 cm5.7.0-centos6.tar.gz

5.解压cm5.7.0-centos6.tar.gz包,必须要和官网的下载包的路径地址一致
[root@hadoop-01 rpminstall]$ tar -zxf cm5.7.0-centos6.tar.gz -C /var/www/html/
[root@hadoop-01 rpminstall]$ cd /var/www/html/
[root@hadoop-01 html]$ ll
total 8
drwxrwxr-x 3 1106 592 4096 Oct 27 10:09 cm
drwxr-xr-x 2 root root 4096 Apr 2 15:55 parcels

6.创建和官网一样的目录路径,然后mv
[root@hadoop-01 html]$ mkdir -p cm5/redhat/6/x86_64/
[root@hadoop-01 html]$ mv cm cm5/redhat/6/x86_64/
[root@hadoop-01 html]$

7.配置本地的yum源,cdh集群在安装时会就从本地down包,不会从官网了
[root@hadoop-01 html]$ vi /etc/yum.repos.d/cloudera-manager.repo
[cloudera-manager]
name = Cloudera Manager, Version 5.7.0
baseurl = http://172.16.101.54/cm5/redhat/6/x86_64/cm/5/
gpgcheck = 0

###提醒: 每个机器都要配置cloudera-manager.repo文件

8.浏览器查看下面两个网址是否出来,假如有，就配置成功
http://172.16.101.54/parcels/
http://172.16.101.54/cm5/redhat/6/x86_64/cm/5/

parcel: 后缀为parcel，
是将Apache hadoop zk hbase hue oozie 等等，打包一个文件，
后缀取名为包裹 英文parcel

cm: deamons+server+agent 闭源

重点: 9.在什么时候用这两个地址？？？
参考CDH5.7.0 Installation.docx 文档的第二.05选择存储库的界面时:

a.单击"更多选项",弹出界面中,在"远程Parcel存储库URL"的右侧地址,
b.删除url,只保留一个,然后替换为 http://172.16.101.54/parcels/
c.然后单击"save changes",稍微等一下,页面会自动刷新一下,
d.然后在"选择CDH的版本",选择cdh

f.“其他Parcels”,全部选择"无"

g.选择"自定义存储库",将 http://172.16.101.54/cm5/redhat/6/x86_64/cm/5/ 粘贴上去

【官网参考链接】
http://archive.cloudera.com/cdh5/parcels/5.8.2/
http://archive.cloudera.com/cm5/repo-as-tarball/5.8.2/
http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.8.2/