spark:Standalone模式
测试能否连接到本地localhost: ssh localhost
1.master:安装ssh
sudo apt-get install openssh-server
2.生成秘钥,执行命令ssh-keygen -t rsa,然后一直按回车键即可
ssh-keygen -t rsa
3.在保证了电脑都能连接到本地localhost后,还需要让master主机免密码登录slave01和slave02主机。在master执行如下命令,将master的id_rsa.pub传送给两台slave主机。复制spark-master结点的id_rsa.pub文件到另外结点:
scp ~/.ssh/id_rsa.pub spark@slave01:~/.ssh
scp ~/.ssh/id_rsa.pub spark@slave02:~/.ssh
4.在slave01、slave02主机上将master的公钥加入各自的节点上,在slave01和slave02执行如下命令:
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
将主机设置免密登录:
首先ssh-keygen 生成秘钥,然后ssh-copy-id localhost 加到本地.
5.登陆spark-master,在终端输入:ssh node02/slave02