HDP2.6.3.0+Ambari2.6.1大数据平台

一、配置流程

http://www.cnblogs.com/zhang-ke/p/8944240.html
https://www.it610.com/article/1170280322634420224.htm
https://blog.csdn.net/weixin_34005042/article/details/92335346

四个包下载链接地址：
http://59.80.44.47/public-repo-1.hortonworks.com/HDP-GPL/centos7/2.x/updates/2.6.4.0/HDP-GPL-2.6.4.0-centos7-rpm.tar.gz
http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0/HDP-2.6.3.0-centos7-rpm.tar.gz
http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.1.0/ambari-2.6.1.0-centos7.tar.gz
http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7/HDP-UTILS-1.1.0.22-centos7.tar.gz

参照此博主的博客搭建，本人是3台虚拟机，按要求配置好hostname以及hosts，ssh等基础工作。1、虚拟机配置为：4核8G（定义为低配，有条件的多加还是比较好）
2、在主服务器上配置HDP的压缩包，从服务器上部署Mysql或者Maria数据库，也可以不配置，默认选择HDP的PostgreSQL数据库（生产环境不推荐）。
3、尽量选择离线安装，HDP压缩包太大。下载的包放到/var/www/html中。
4、选择了MySQL数据库就要在里面创建表，hive/Oz/superset等在后续安装中需要database。
5、如果是因为MySQL的原因，参照此博主博客输入安装mysql驱动的命令解决。
6、在安装过程中出现SSL问题，参考此刘大神博客解决，或次博主https://blog.csdn.net/qq_41805514/article/details/88871477，本人在前两步完成后解决ssl问题。如果主机安装还是出现问题，报错节点找/usr/lib64/python2.7/ssl.py，deafult改成这个PROTOCOL_TLSv1_

二、成功图片

![在这里插入图片描述](https://img-blog.csdnimg.cn/20190509140106193.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzMTQ3MTM2,size_16,color_FFFFFF,t_70

报错解决

问题：

DB configs consistency check: no errors and warnings were found.
ERROR: Exiting with exit code 1. 
REASON: Server not yet listening on http port 8080 after 50 seconds. Exiting.

方法：

vim  /etc/ambari-server/conf/ambari.properties
将以下属性值增加到120或150秒
server.startup.web.timeout = 120

问题：

部分：
Metastore on vmocdp124.test.com failed (Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py", line 183, in execute
timeout=int(check_command_timeout) )
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 158, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 121, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 238, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
标准错误输出: /var/lib/ambari-agent/data/errors-1312.txt

方法：

Metastore connection URL: jdbc:mysql://hdp001/hive?createDatabaseIfNotExist=true

问题出在URL,hive用户通过hdp001这台机器连接mysql需要设置密码，

前面已经执行过：GRANT ALL PRIVILEGES ON hive.* TO 'hive'@'localhost' IDENTIFIED BY 'hive'; (创建hive用户)
GRANT ALL PRIVILEGES ON hive.* TO 'hive'@'%' IDENTIFIED BY 'hive';
FLUSH PRIVILEGES; （刷新权限）

已经设置过hive用户连接的密码，没想到还会连接不上

最后执行GRANT ALL PRIVILEGES ON hive.* TO 'hive'@'hdp001' IDENTIFIED BY 'hive',问题解决

问题：Hbase在Ambari中启动后随即自动关闭
方法：

ntpd时间，几台机器date验证时间是否一致。

问题：

NameNode Last Checkpoint script alert definition does not trigger based on uncommitted transactions。
报错误[Checkpoint Critical]

方法：

sudo su hdfs -l -c 'hdfs dfsadmin -safemode enter'

sudo su hdfs -l -c 'hdfs dfsadmin -saveNamespace'
After that restarting both NameNodes cleared the Alerts.

问题：

Ambari2.4.2 Hbase启动失败
HBase Master Process
Connection failed: [Errno 111] Connection refused to bi.corp.mama.cn2:16000

启动过程是没有报错的，都是Success，但是alter提示这个，过一会儿本来Start的HBase Master就自动Stop

办法：

yum -y install ntp（安装过的可以直接下一步）
cd /usr/share/zoneinfo/Asia/
ntpdate pool.ntp.org
systemctl start ntpd && systemctl enable ntpd

**SSH上的问题解决办法要想到各节点之间的免密配置，以及自身0.0.0.0的免密配置。**
**端口上的问题，自建虚拟机不存在，若是阿里云服务器要在其安全组里添加端口**

如何在CDH中安装CFM
https://cloud.tencent.com/developer/article/1426077