操作系统:Centos6.X
HDP版本:HDP-2.5.3
AMBARI 版本:AMBARI-2.4.2
HDB版本:HDB-2.2.0
1,配置集群/etc/hosts
2,配置免密登录
ssh-copy-id node01
i.# 分别在四台机器上生成密钥对:
cd ~
ssh-keygen -t rsa
# 然后一路回车
# 在node01上执行:
cd ~/.ssh/
ssh-copy-id node01
scp /root/.ssh/authorized_keys node02:/root/.ssh/
scp /root/.ssh/authorized_keys node03:/root/.ssh/
# 在slaver2上执行:
cd ~/.ssh/
ssh-copy-id node02
scp /root/.ssh/authorized_keys node03:/root/.ssh/
scp /root/.ssh/authorized_keys node01:/root/.ssh/
#在slaver3上执行:
cd ~/.ssh/
ssh-copy-id node03
scp /root/.ssh/authorized_keys node01:/root/.ssh/
scp /root/.ssh/authorized_keys node02:/root/.ssh/
3,安装需要的yum源
yum install ntp -y
yum install httpd
yum install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse portmap fuse-libs redhat-lsb ntp httpd -y
4,安装JDK
5,修改配置文件
- 配置及修改关键服务
- hugepage关闭:
- vi /etc/grub.conf
- 在kenel最后加上transparent_hugepage=never
- 开启ntpd:
- service ntpd stop
- chkconfig ntpd on
- 关闭selinux:
- cd /etc/selinux
- vi config
- SELINUX=disabled
- 开启http:
- service httpd start
- chkconfig httpd on
- 关闭防火墙:
- service iptables stop
- chkconfig iptables off
- 重启机器
- hugepage关闭:
6,配置HDP+AMBARI本地源
cd /var/www/html/
配置本地源
参考文档
确认在浏览器中输入http://<web.server>/AMBARI-2.4.2.0 可见目录,http://<web.server>/hdp 可见目录
解压HDP-2.5.3.0-centos6-rpm.tar.gz、HDP-UTILS-1.1.0.21-centos6.tar.gz 于/var/www/html/hdp
解压ambari-2.4.2.0-centos6.tar.gz 于/var/www/html/
https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-installation/content/setting_up_a_local_repository_with_no_internet_access.html
7,配置yum
1)Log in to your host as root.
2)wget -nv http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.4.2.0/ambari.repo -O /etc/yum.repos.d/ambari.repo
http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.4.2.0/hdp.repo
wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.4.2.0/hdp.repo -O /etc/yum.repos.d/hdp.repo
8,修改repo配置文件
cd /etc/yum.repos.d 修改ambari.repo及hdp.repo,替换baseurl如下表:
Repository Base URL
Ambari Base URL http://<web.server>/Ambari-2.4.2.0/<OS>
HDP Base URL http://<web.server>/hdp/HDP/<OS>/2.x/updates/<latest.version>
HDP-UTILS Base URL http://<web.server>/hdp/HDP-UTILS-<version>/repos/<OS>
9,安装ambari
yum repolist确定源正常
yum install ambari-server
ambari-server start(start 之前需要先 ambari-server setup )
ambari-server status
ambari-server stop
10,打开http://<your.ambari.server>:8080,admin,admin
11,安装,注意版本选择正确,namenode和nodemanager全部勾选
12,扩展集群:
- 扩展集群
扩展节点的物理配置需和原集群的配置相同
-
- 新增机器重复(一)的设置
其中对(3)配置各服务器免登陆SSH如下:
# 新增节点配置:
#在slaver4上执行:
scp /root/.ssh/authorized_keys slaverX:/home/grid/.ssh/
#在slaverX(新增节点)上执行:
cd ~
ssh-keygen -t r
# 然后一路回车
cd ~/.ssh/
ssh-copy-id slaverX
scp /root/.ssh/authorized_keys slaver1:/root/.ssh/
scp /root/.ssh/authorized_keys slaver2:/root/.ssh/
scp /root/.ssh/authorized_keys slaver3:/root/.ssh/
scp /root/.ssh/authorized_keys slaver4:/root/.ssh/
- 登录ambari服务器,选择【hosts】栏->【Action】->点击【Add New Hosts】