接上一篇博客
两个node节点都要装docker
vim docker.sh
#!/bin/bash
yum -y install yum-utils device-mapper-persistent-data lvm2
yum-config-manager --add-repo https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo
yum -y install docker-ce
systemctl start docker.service
systemctl enable docker.service
tee /etc/docker/daemon.json <<-'EOF'
{
"registry-mirrors": ["https://7lkj2y.mirror.aliyuncs.com"]
}
EOF
echo "net.ipv4.ip_forward=1" >> /etc/sysctl.conf
sysctl -p
systemctl restart network
systemctl reload network
systemctl restart docker
一、部署flannel网络组件
1、建立ETCD集群与外部的通信 在master节点上进行操作
1、健康检查
/opt/etcd/bin/etcdctl --ca-file=ca.pem --cert-file=server.pem --key-file=server-key.pem --endpoints="https://20.0.0.10:2379,https://20.0.0.11:2379,https://20.0.0.12:2379" cluster-health
2、在master节点上,将分配的子网段写入到ETCD中,供flannel使用--------注意:必须在证书存放的路径/root/k8s/etcd-cert下执行此命令。
/opt/etcd/bin/etcdctl --ca-file=ca.pem --cert-file=server.pem --key-file=server-key.pem --endpoints="https://20.0.0.10:2379,https://20.0.0.11:2379,https://20.0.0.12:2379" set /coreos.com/network/config '{ "network": "172.17.0.0/16", "Backend": {"Type":"vxlan"}}'
{ "network": "172.17.0.0/16", "Backend": {"Type":"vxlan"}} ##说明正常
3、查看写入的信息get后面跟的是键名
/opt/etcd/bin/etcdctl --ca-file=ca.pem --cert-file=server.pem --key-file=server-key.pem --endpoints="https://20.0.0.10:2379,https://20.0.0.11:2379,https://20.0.0.12:2379" get /coreos.com/network/config
{ "network": "172.17.0.0/16", "Backend": {"Type":"vxlan"}} ##说明正常
4、将flannel压缩包传到各节点
scp flannel-v0.10.0-linux-amd64.tar.gz root@20.0.0.11:/root
scp flannel-v0.10.0-linux-amd64.tar.gz root@20.0.0.12:/root
5、解压-------两个node节点:上传软件包flannel并解压到宿主目录下 。
tar zxf flannel-v0.10.0-linux-amd64.tar.gz
ls ##能看到下面的两个文件
#flanneld
#mk-docker-opts.sh
2、在node节点上进行操作
1、首先建个kubernetes的工作目录(在两个node节点上创建k8s工作目录)
mkdir /opt/kubernetes/{cfg,bin,ssl} -p
2、解压flannel包,并将解压出的两个文件放在/opt/kubernetes/bin目录下(这个地方可能会报没有那个目录你可以去看看有没有移动过去)
tar zxf flannel-v0.10.0-linux-amd64.tar.gz
mv flanneld mk-docker-opts.sh /opt/kubernetes/bin/ ##需要这两个可执行文件
ls /opt/kubernetes/bin/
flanneld mk-docker-opts.sh ##说明已经传过去了
3、创建flannel的启动脚本(上传可以生成配置文件和启动文件的脚本flannel.sh。)
[root@localhost ~]# vi flannel.sh
#!/bin/bash
ETCD_ENDPOINTS=${1:-"http://127.0.0.1:2379"}
cat <<EOF >/opt/kubernetes/cfg/flanneld
FLANNEL_OPTIONS="--etcd-endpoints=${ETCD_ENDPOINTS} \
-etcd-cafile=/opt/etcd/ssl/ca.pem \
-etcd-certfile=/opt/etcd/ssl/server.pem \
-etcd-keyfile=/opt/etcd/ssl/server-key.pem"
EOF
cat <<EOF >/usr/lib/systemd/system/flanneld.service
[Unit]
Description=Flanneld overlay address etcd agent
After=network-online.target network.target
Before=docker.service
[Service]
Type=notify
EnvironmentFile=/opt/kubernetes/cfg/flanneld
ExecStart=/opt/kubernetes/bin/flanneld --ip-masq \$FLANNEL_OPTIONS
ExecStartPost=/opt/kubernetes/bin/mk-docker-opts.sh -k DOCKER_NETWORK_OPTIONS -d /run/flannel/subnet.env
Restart=on-failure
[Install]
WantedBy=multi-user.target
EOF
systemctl daemon-reload
systemctl enable flanneld
systemctl restart flanneld
4、启动该脚本(两个node节点开启flannel网络功能)
bash flannel.sh https://20.0.0.10:2379,https:20.0.0.11:2379,https://20.0.0.12:2379
5、改docker的配置文件
vim /usr/lib/systemd/system/docker.service
13 # for containers run by docker
14 EnvironmentFile=/run/flannel/subnet.env ##新增
15 ExecStart=/usr/bin/dockerd $DOCKER_NETWORK_OPTIONS -H fd:// --containerd=/run/containerd/containerd.sock ##添加部分内容
6、查看获得的IP地址范围(查看 flanne网络分配的子网段)
cat /run/flannel/subnet.env
DOCKER_OPT_BIP="--bip=172.17.54.1/24"
DOCKER_OPT_IPMASQ="--ip-masq=false"
DOCKER_OPT_MTU="--mtu=1450"
DOCKER_NETWORK_OPTIONS=" --bip=172.17.54.1/24 --ip-masq=false --mtu=1450"
[root@node1 ~]# systemctl daemon-reload
[root@node1 ~]# systemctl restart docker
7、下载一个镜像进程测试
7、1进入容器后直接看有没有IP地址
yum -y install net-tools
ifconfig ##这个时候会随机出现ip地址给你如
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450
inet 172.17.54.2 netmask 255.255.255.0 broadcast 172.17.54.255
ether 02:42:ac:11:36:02 txqueuelen 0 (Ethernet)
RX packets 13840 bytes 11482584 (10.9 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 7536 bytes 411117 (401.4 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
loop txqueuelen 1 (Local Loopback)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
8、到另外一个node2节点上和node1上做同样的操作后
直到进入容器后出现一个ip地址然后测试互相能不能ping通
两个node节点分别创建并自动进入centos:7容器。
如我的node2上生成的IP地址为
[root@7137b1c77437 /]# ifconfig
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450
inet 172.17.39.2 netmask 255.255.255.0 broadcast 172.17.39.255
ether 02:42:ac:11:27:02 txqueuelen 0 (Ethernet)
RX packets 13959 bytes 11485573 (10.9 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 7330 bytes 400095 (390.7 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
9、对他们另个地址进行互ping的超作-----通说明搭建成功
[root@7137b1c77437 /]# ping 172.17.54.2
PING 172.17.54.2 (172.17.54.2) 56(84) bytes of data.
64 bytes from 172.17.54.2: icmp_seq=1 ttl=62 time=0.426 ms
64 bytes from 172.17.54.2: icmp_seq=2 ttl=62 time=0.459 ms
flannel网络组件安装部署成功