麒麟系统安装HDP，报错处理

李钟意i

已于 2024-02-01 10:06:40 修改

阅读量532

点赞数 8

文章标签： kylin linux hadoop hive 大数据

于 2024-02-01 10:05:02 首次发布

本文链接：https://blog.csdn.net/LIZhonYi/article/details/135967329

版权

1、软件版本介绍

操作系统：Kylin-Server-10-SP2-x86_64
HDP版本： 3.1.5.0-152

2、配置修改

修改oc_check.py伪装麒麟系统成centos8

/var/lib/ambari-agent/tmp/ambari_commons/os_check.py
/usr/lib/ambari-server/lib/ambari_commons/os_check.py
/usr/lib/ambari-agent/lib/ambari_commons/os_check.py
/usr/lib/ambari-server/lib/ambari_commons/repo_manager/yum_manager.py

以os_check.py为例，基本就是把kylin伪装成centos
----ps:这里开始伪装成了7，后面的其他操作也报错了，改成了8
----麒麟v10与centos8类似

vim /var/lib/ambari-agent/tmp/ambari_commons/os_check.py
80 _IS_KYLIN_LINUX = os.path.exists('/etc/kylin-release')
88 def _is_kylin_linux():
89   return _IS_KYLIN_LINUX
205       elif _is_kylin_linux():
206         distribution =("centos","7","core")

vim /usr/lib/ambari-agent/lib/ambari_commons/repo_manager/yum_manager.py
208     name = name.replace("${stack_version}", "3_1_0_0_78")
277    # if os.geteuid() == 0:
278    #   return self.yum_check_package_available(name)
279    # else:
280    #   return self.rpm_check_package_available(name)

vim /usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py
89 STACK_VERSION_PLACEHOLDER ="3_1_0_0_78"

3 、报错解决

3.1 解决redhat-lsb报错（所有机器）

redhat-lsb依赖错误，麒麟仓库该依赖不支持下载centos8强制安装解决
安装
wget https://update.cs2c.com.cn/NS/V10/V10SP2/os/adv/lic/base/x86_64/Packages/kylin-lsb-5.0-1.p01.ky10.x86_64.rpm 保证依赖可用
验证：lsb_release
LSB Version: :core-4.1-amd64:core-4.1-ia32:…（省略后面）

强制安装以下el8.x86_64.rpm结尾的依赖
http://mirrors.aliyun.com/centos/8.5.2111/AppStream/x86_64/os/Packages/?spm=a2c6h.25603864.0.0.50f21a7abxdrEu/

3.2 解决No package hadoop_${stack_version}

resource_management.core.exceptions.Fail: No package found for -yarn(expected name: hadoop_3_1-yarn)

直接写死stack_version的版本

vim /usr/lib/ambari-agent/lib/ambari_commons/repo_manager/yum_manager.py
208     name = name.replace("${stack_version}", "3_1_0_0_78")

3.3 解决hive无法连接数据库

Mysql的hive库权限要给对应的机器
主要执行GRANT

CREATE USER 'hive'@'vm1213' IDENTIFIED BY 'bigdata'; 
GRANT ALL PRIVILEGES ON *.* TO 'hive'@'vm1213'; 
CREATE USER 'hive'@'vm1214' IDENTIFIED BY 'bigdata'; 
GRANT ALL PRIVILEGES ON *.* TO 'hive'@'vm1214';

3.4 报错ambari-server setup

主要是伪装成centos

如果还报错把ambari.properties替换成本文中的ambari.properties
vim /etc/ambari-server/conf/ambari.properties

3.5 /site-packages/rpm/ _rpm. so: undefined symbol: rpmdsNotify

主要因为依赖冲突

wget https://update.cs2c.com.cn/NS/V10/V10SP2/os/adv/lic/base/x86_64/Packages/python2-rpm-4.15.1-17.ky10.x86_64.rpm                                                     rpm -ivh --replacepkgs  /udata/dam/python2-rpm-4.15.1-17.ky10.x86_64.rpm  --nodeps --force