Ubuntu16.04环境下基于Hadoop分布式集群YARN模式下的TensorFlowOnSpark平台搭建

本次实验环境是基于Ubuntu16.04的一台服务器，在上面创建3个Docker容器，容器的系统也是Ubuntu16.04，并以此搭建TensorFlowOnSpark深度学习分布式平台。

一 Ubuntu基本配置

1.1 安装ssh

打开终端或者服务器版命令行。

查看是否安装（ssh）openssh-server，否则无法远程连接。

sshd
sudo apt install openssh-server

docker镜像中启动ssh

/usr/sbin/sshd -D &

1.2 Ubuntu更换国内源

1) 编辑source.list文件

sudo vim /etc/apt/source.list

2) 替换为国内源（此处为阿里源）

deb-src http://archive.ubuntu.com/ubuntu xenial main restricted #Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial main restricted multiverse universe #Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted multiverse universe #Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates universe
deb http://mirrors.aliyun.com/ubuntu/ xenial multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse #Added by software-properties
deb http://archive.canonical.com/ubuntu xenial partner
deb-src http://archive.canonical.com/ubuntu xenial partner
deb http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted multiverse universe #Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial-security universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-security multiverse

3) 使修改生效

sudo apt-get update

1.3 修改Ubuntu服务器hostname主机名

vincent@ubuntu:~$ sudo hostname hadoop1

vincent@ubuntu:~$ sudo hostname hadoop2

vincent@ubuntu:~$ sudo hostname hadoop3

#断开远程连接，重新连接即可看到已经改变了主机名。

1.4 增加hosts文件中ip和主机名对应字段

在hadoop1,2,3中，修改/etc/hosts文件

sudo vim /etc/hosts

增加以下对应关系

<