利用Ambari进行hdp小版本升级

HDP2.2 升级手册

* 注意事项:

  • 升级描述:当前HDP版本2.2.0.0,升级版本2.2.6.0;
  • 手动升级(命令行)方式官方文档:http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.2.6/bk_upgrading_hdp_manually/content/ch_upgrade_2_1.html
1. 升级前准备工作

1.1 重启服务* 注:因为上次升级Ambari metrics没有重启服务,所以这次重启所有服务以应用上一次的配置更新;

1.2 备份所有服务的配置文件:

mkdir /root/backup
tar -cvf /root/backup/hdp_config_backup.tar /etc/

1.3 检查 Hive Server 节点端口使用情况,如果端口被占用,需要手动修改;

netstat -anp | grep 1001[01]

1.4 备份 Hive 元数据库

备份
mysqldump hive > /root/backup/backup_hive.sql

还原
mysql hive < /root/backup/backup_hive.sql

1.5 关闭正在运行的 Mapreducecrontab 定时任务、Kill掉所有已经发布的 Storm topology

1.6 将升级安装包解压到YUM主机。

tar -xzvf HDP-2.2.6.0-centos6-rpm.tar.gz
mv HDP /var/www/html/HDP2.2.6
2. 升级

2.1 登录到 Ambari,添加新的HDP版本;

UpgradeSetp_img

http://public-repo-1.hortonworks.com/HDP2.2.6/centos6/2.x/updates/2.2.6.0/
http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6


UpgradeSetp_img

 

2.2 保存后,点击安装,Ambari 将为所有节点安装新的HDP组件;

UpgradeSetp_img
UpgradeSetp_img

2.3 等待安装后,点击更新,Ambari 将为所有节点更新HDP组件;

UpgradeSetp_img

2.4 更新过程中,Ambari 将提示6次需要干预的操作,因为升级前已经准备好了,所以当遇到提示时直接确认即可,整个升级过程将持续1小时左右;

UpgradeSetp_img

升级完成

UpgradeSetp_img

3. 恢复应用服务

3.1 升级完成后,Hive server thrift 端口将改为 10010,所以需要检查相关应用的配置,修改对应的端口参数值;

4. 其他

HDP 升级过程中的提示

    1. Before continuing, please backup the Hive Metastore database located on the following host(s): hadoop002.icccuat.com.

    2. The initial batch of DataNode, RegionServer and NodeManager hosts have been upgraded. You are advised to check the hosts and perform cluster/workload-specific tests against your cluster to ensure proper operation before proceeding with upgrade of the remaining services.

    3. Please note that the HiveServer port will now change to 10010 if hive is using a binary transfer mode or 10011 if hive is using an http transport mode. You can use “netstat -anp | grep 1001[01]” to determine if the port is available on each of following HiveServer host(s): hadoop002.icccuat.com. If the port is not available, the process using it must be terminated.
      Updated ‘hive-site’ with ‘hive.server2.thrift.port=10010’

    4. Before continuing, please deactivate and kill any currently running topologies.

    5. Please rebuild your topology using the new Storm version dependencies and resubmit it using the newly created jar.

    6. Your cluster version has been upgraded. Click on Finalize when you are ready to finalize the upgrade and commit to the new version. You are strongly encouraged to run tests on your cluster to ensure it is fully operational before finalizing. You cannot go back to the original version once the upgrade is finalized.

转载于:https://www.cnblogs.com/riyueyuzhuzhu/p/5584756.html

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值