hdp3.1.0.0安装教程

资源下载

链接: https://pan.baidu.com/s/1w5SzdQAvC3Bbh2FJzPEntw 提取码: fwmk

里面的HDF可以不下载

环境准备

配置ssh 免密登录

配置host文件

关闭防火墙，关闭selinux

配置aliyun 的yum源

安装时钟同步
yum install -y ntp
systemctl enable ntpd

设置umask
echo umask 0022 >> /etc/profile

安装http服务(hdp离线安装会用)
yum install yum-utils createrepo
yum install httpd
service httpd start

下载完云盘文件，放到下面目录，解压

[root@node-1 html]# pwd
/var/www/html
[root@node-1 html]# ll
total 0
drwxr-xr-x 3 root root  93 Apr 18 17:08 ambari
drwxr-xr-x 3 roo  users 21 Dec 11  2018 HDP
drwxr-xr-x 3 roo  users 21 Dec 11  2018 HDP-GPL
drwxr-xr-x 3 roo  users 21 Aug 13  2018 HDP-UTILS

开始安装

安装mysql

解压

tar -zxvf mysql-5.7.28-1.el7.x86_64.rpm-bundle.tar

[root@node-1 mysql]# ll
total 595272
-rw-r--r-- 1 7155 31415  45109364 Sep 30  2019 mysql-community-client-5.7.28-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415    318768 Sep 30  2019 mysql-community-common-5.7.28-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415   7037096 Sep 30  2019 mysql-community-devel-5.7.28-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415  49329100 Sep 30  2019 mysql-community-embedded-5.7.28-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415  23354908 Sep 30  2019 mysql-community-embedded-compat-5.7.28-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415 136837816 Sep 30  2019 mysql-community-embedded-devel-5.7.28-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415   4374364 Sep 30  2019 mysql-community-libs-5.7.28-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415   1353312 Sep 30  2019 mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415 208694824 Sep 30  2019 mysql-community-server-5.7.28-1.el7.x86_64.rpm
-rw-r--r-- 1 7155 31415 133129992 Sep 30  2019 mysql-community-test-5.7.28-1.el7.x86_64.rpm

删除Centos 自带的数据库
yum remove mysql-libs

因为mysql的依赖关系，依次按顺序解压

#rpm -ivh mysql-community-common-5.7.28-1.el7.x86_64.rpm 
#rpm -ivh mysql-community-libs-5.7.28-1.el7.x86_64.rpm 
#rpm -ivh mysql-community-client-5.7.28-1.el7.x86_64.rpm
#rpm -ivh mysql-community-server-5.7.28-1.el7.x86_64.rpm

启动
systemctl start mysqld.service

获取mysql自动生成的密码：
命令：cat /var/log/mysqld.log |grep password

登录
mysql -uroot -p
enter password:  

设置新密码：
set password=password('123456');

启动http服务

service httpd start

浏览器访问

依次测试/var/www/html目录下的其他链接

http://node-1/HDP/ 等等

配置yum源

把hdp\repo文件夹下的yum源更新到主机上

注意修改文件中的配置为本地配置

比如node-1是笔者的host

#VERSION_NUMBER=2.7.3.0-139
[ambari-2.7.3.0]
#json.url = http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json
name=ambari Version - ambari-2.7.3.0
baseurl=http://node-1/ambari/centos7/2.7.3.0-139
gpgcheck=0
gpgkey=http://node-1/ambari/centos7/2.7.3.0-139/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

然后 yum makecache

安装ambari

yum install ambari-server

配置ambari server

ambari-server setup

然后重启 ambari-server restart

http://node-1:8080/#/login

账号密码: admin/admin

mysql库

这是笔者mysql安装集群服务需要的库

| ambari             |
| hive               |
| oozie              |
| ranger             |
| rangerkms

create database ambari;
use ambari;
grant all privileges on ambari.* to ambari@"%" identified by "123456";

每个库都这么执行一遍。

grant all privileges on rangerkms.* to rangerkms@"%" identified by "123456";

......

省略

.....

开始安装集群

按照提示一步一步安装

配置本地目录

http://node-1/HDP/centos7/3.1.0.0-78
http://node-1/HDP-GPL/centos7/3.1.0.0-78
http://node-1/HDP-UTILS/centos7/1.1.0.22

注意配置数据库前执行

ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar

安装完毕后就如下图（我的集群资源很少，服务都没有启动）