Install Hadoop and related components automatically

VIP文章 Bourne-Wang

已于 2022-05-03 15:49:23 修改

阅读量1.6k

点赞数

文章标签： hadoop 大数据 big data

于 2022-05-03 15:45:38 首次发布

本文链接：https://blog.csdn.net/weixin_39952986/article/details/124556284

版权

Install and configure hadoop is tedious, so I build a script to do this process automatically.

The git project can be found here install hadoop.

Let’s assume you have 3 hosts hadoop001/hadoop002/hadoop003, and configured access each other with ssh key(withput entering password).

If not, do as following steps.

Make sure you can access them with your private key(you can login to them directly with command “ssh root@hadoop001”), then execute

./config-hosts-access.sh "hadoop001 hadoop002 hadoop003"

or use the IP instead:

./config-hosts-access.sh "10.10.10.1 10.10.10.2 10.10.10.3"

this script will generate ssh key in each host, and append all the public keys in “/root/.ssh/authorized_keys” for each hosts.

Verify

[root@hadoop001 opt]# ssh hadoop002
Last login: Mon May  2 12:40:55 2022 from 183.194.183.43

Welcome to Alibaba C

关注