Heron集群从零加入新节点（Slave）操作

配置主机和安装相关工具

准备步骤：

• Ubuntu16.04 配置集群SSH无密码登录
• Ubuntu16.04常用操作和命令
• VMware Workstation install VMware Tools

安装JDK：见Heron单节点环境搭建中安装JDK部分。

配置集群主机IP和SSH免密登录

新加入节点IP：192.168.201.133

1. 修改配置文件

修改现有主机的/etc/hosts文件，添加：

192.168.201.132 heron03

修改新增主机的/etc/hosts文件：

192.168.201.136 heron01
192.168.201.135 heron02
192.168.201.133 heron03

修改新增主机的/etc/hostname文件，修改主机名：

heron03

2. 设置集群中主机间免密登录和允许root登录

• 设置主机间免密登录：Ubuntu16.04 配置集群SSH无密码登录
• 允许root用户登录：Heron集群中编译方式安装配置Mesos集群中，常见问题5的解决方法部分

安装配置Mesos

• 使用编译的方式安装配置Mesos：Heron集群中编译方式安装配置Mesos集群
• 使用apt-get命令方式安装Mesos：（集群配置未采用）

1. 修改原有节点的配置文件

配置文件yitian@ubuntu:~/mesosinstall/etc/mesos/slaves：

heron02
heron03 # 新增主机

2. 配置新增主机的Mesos

复制其他主机:~/mesosinstall/etc/mesos/路径下的如下配置文件：

• masters
• slaves
• mesos-master-env.sh
• mesos-slave-env.sh
• mesos-agent-env.sh
• mesos-deploy-env.sh（无修改）
• 以及：/home/yitian/mesosinstall/sbin/mesos-daemon.sh

注：mesos和zookeeper配置文件在本地中已经保存，复制到新增主机相应的目录即可使用。

3. 添加Mesos的环境变量

# Mesos configuration
export MESOS_HOME=/home/yitian/mesosinstall
export PATH=${MESOS_HOME}/sbin:${MESOS_HOME}/bin:$PATH

4. 启动Mesos集群

在Master（heron01）主机中使用root用户启动Mesos集群：

yitian@heron01:~$ su root
Password: 
root@heron01:/home/yitian# ./mesosinstall/sbin/mesos-start-cluster.sh
Starting mesos-master on heron01
ssh -o StrictHostKeyChecking=no -o ConnectTimeout=2 heron01 /home/yitian/mesosinstall/sbin/mesos-daemon.sh mesos-master </dev/null >/dev/null
Starting mesos-agent on heron02
ssh -o StrictHostKeyChecking=no -o ConnectTimeout=2 heron02 /home/yitian/mesosinstall/sbin/mesos-daemon.sh mesos-agent </dev/null >/dev/null
Starting mesos-agent on heron03
ssh -o StrictHostKeyChecking=no -o ConnectTimeout=2 heron03 /home/yitian/mesosinstall/sbin/mesos-daemon.sh mesos-agent </dev/null >/dev/null
Everything's started!

5. 验证mesos运行状况

注：首先yitian@ubuntu:~$ ./zookeepermine/zookeeper-3.4.10/bin/zkServer.sh start启动zookeeper，新增节点中安装配置Zookeeper见：Ubuntu16.04安装配置使用Zookeeper集群（其中heron03看作新增节点）

安装Aurora Observer和Executor

1. 为新增主机安装Aurora Observer和Executor组件：

yitian@heron03:~$ sudo apt-get install -y python2.7 wget
[sudo] password for yitian:
Reading package lists... Done
Building dependency tree      
Reading state information... Done
python2.7 is already the newest version (2.7.12-1ubuntu0~16.04.3).
wget is already the newest version (1.17.1-1ubuntu1.3).
0 upgraded, 0 newly installed, 0 to remove and 162 not upgraded.
yitian@heron03:~$ sudo apt-get -y install libcurl4-nss-dev
Reading package lists... Done
Building dependency tree      
Reading state information... Done
libcurl4-nss-dev is already the newest version (7.47.0-1ubuntu2.6).
0 upgraded, 0 newly installed, 0 to remove and 162 not upgraded.
yitian@heron03:~$ sudo dpkg -i aurora-executor_0.17.0_amd64.deb
dpkg: error processing archive aurora-executor_0.17.0_amd64.deb (--install):
  cannot access archive: No such file or directory
Errors were encountered while processing:
  aurora-executor_0.17.0_amd64.deb
yitian@heron03:~$ wget -c https://apache.bintray.com/aurora/ubuntu-trusty/aurora-executor_0.17.0_amd64.deb
yitian@heron03:~$ sudo dpkg -i aurora-executor_0.17.0_amd64.deb
Selecting previously unselected package aurora-executor.
(Reading database ... 222011 files and directories currently installed.)
Preparing to unpack aurora-executor_0.17.0_amd64.deb ...
Unpacking aurora-executor (0.17.0) ...
Setting up aurora-executor (0.17.0) ...
Processing triggers for systemd (229-4ubuntu21.1) ...
Processing triggers for ureadahead (0.100.0-19) ...

2. 配置slave主机中的Thremos

• Aurora Scheduler and Thermos的安装和配置

安装配置Hadoop HDFS

将集群中原有主机配置好的Hadoop目录文件（/home/yitian/hadoop）打包并复制到新增主机/home/yitian目录下.

1. 解压后修改如下配置文件(/home/yitian/hadoop/hadoop-2.7.4/etc/hadoop)：

yitian@heron03:~/hadoop/hadoop-2.7.4/etc/hadoop$ cat slaves
heron02
heron03

2. 配置环境变量

# Hadoop configuration
export HADOOP_HOME=/home/yitian/hadoop/hadoop-2.7.4
export PATH=${HADOOP_HOME}/bin:$PATH

3. 初始化HDFS

yitian@heorn03:~/.heron/conf/aurora$ cd /home/yitian/hadoop/hadoop-2.7.4/
yitian@heorn03:~/hadoop/hadoop-2.7.4$ bin/hdfs namenode -format

4. 在heorn01中启动HDFS：

yitian@heron01:~$ ./hadoop/hadoop-2.7.4/sbin/start-dfs.sh
Starting namenodes on [heron01]
heron01: starting namenode, logging to /home/yitian/hadoop/hadoop-2.7.4/logs/hadoop-yitian-namenode-heron01.out
heron03: starting datanode, logging to /home/yitian/hadoop/hadoop-2.7.4/logs/hadoop-yitian-datanode-heron03.out
heron02: starting datanode, logging to /home/yitian/hadoop/hadoop-2.7.4/logs/hadoop-yitian-datanode-heron02.out
Starting secondary namenodes [heron01]
heron01: starting secondarynamenode, logging to /home/yitian/hadoop/hadoop-2.7.4/logs/hadoop-yitian-secondarynamenode-heron01.out

5. 验证启动状态：