本帖最后由 0opi 于 2016-1-27 08:45 编辑
本文紧跟上节所讲的手动部署Kubernetes管理Docker篇所写，本篇主要内容利用Shell脚本完成快速部署Kubernetes集群。上节博文看过的朋友也能感觉到部署过程相对比较简单，那么，出于简化工作流程，推进运维自动化角度来说，于是花了2/3天时间写这个部署Kubernetes脚本。运维工作中，常常会遇到部署各种各样的服务，建议：常规部署都应该尽量使用脚本完成，一方面提高自身脚本编写能力，另一方面推进运维自动化。
详细部署说明文档：http://www.iyunv.com/thread-169986-1-1.html
提醒：即使按照本篇文章一步一步做，也不一定部署成功。原因你懂得！如果失败，也建议你仔细看看脚本内容，从中寻找解决办法。同时，相信你也会从脚本中获取到其他有价值的信息。
实验环境：
操作系统：Ubuntu14.04_x64
master：192.168.1.150
minion01 : 192.168.1.151 容器网段：172.17.1.0/24
minion02 : 192.168.1.152 容器网段：172.17.2.0/24
安装包下载：
脚本说明：config_ssh_root_remote.sh #配置root SSH登录(默认ubuntu系统禁止root SSH登录)
ssh_keypair_auth.sh #配置master主机与minion主机SSH免交互认证
kubernetes-install.sh #安装kubernetes的master端与minion端
config_gre_channel.sh #配置两台Docker主机容器实现跨主机访问(OVS)
安装步骤(请按照步骤做)：
1)在minion主机root权限开启root允许SSH远程登录
操作命令：$ sudo bash config_ssh_root_remote.sh
脚本内容：$ cat config_ssh_root_remote.sh
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56#!/bin/bash
# Description: configuration root account ssh remote login
if [ $USER != "root" ]; then
echo "Please use root account operation or sudo!"
exit 1
fi
function color_echo() {
if [ $1 == "green" ]; then
echo -e "\033[32;40m$2\033[0m"
elif [ $1 == "red" ]; then
echo -e "\033[31;40m$2\033[0m"
fi
}
function check_pkg() {
if ! $(dpkg -l $PKG_NAME >/dev/null 2>&1); then
echo no
else
echo yes
fi
}
function install_pkg() {
local PKG_NAME=$1
if [ $(check_pkg $PKG_NAME) == "no" ]; then
apt-get install $PKG_NAME -y
if [ $(check_pkg $PKG_NAME) == "no" ]; then
color_echo green "$PKG_NAME installation failure! Try to install again."
apt-get autoremove && apt-get update
apt-get install $PKG_NAME --force-yes -y
[ $(check_pkg $PKG_NAME) == "no" ] && color_echo red "The $PKG_NAME installation failure!" && exit 1
fi
fi
}
install_pkg expect
# modify ssh config file
sed -r -i 's/(PermitRootLogin).*/\1 yes/' /etc/ssh/sshd_config
service ssh restart >/dev/null
# set root account password
echo "------------------------------------------------------>"
while true; do
read -p "Please enter you want to set the root account password: " ROOT_PASS
if [ -n "$ROOT_PASS" ]; then
break
else
color_echo red "Password cannot be empty!"
continue
fi
done
expect -c "
spawn passwd root
expect {
\"Enter new UNIX password:\" {send \"$ROOT_PASS\r\"; exp_continue}
\"Retype new UNIX password:\" {send \"$ROOT_PASS\r\"}
}
expect eof
" >/dev/null
color_echo green "The root account password is: $ROOT_PASS"
2)在master主机切换到root用户执行脚本与minion主机root用户建立SSH免交互登录
操作命令：# bash ssh_keypair_auth.sh root@192.168.1.151-152@123
脚本内容：# cat ssh_keypair_auth.sh
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126#!/bin/bash
# Description: configuration local host and remote host ssh keypair authentication, Support Ubuntu and CentOS operation system.
function color_echo() {
if [ $1 == "green" ]; then
echo -e "\033[32;40m$2\033[0m"
elif [ $1 == "red" ]; then
echo -e "\033[31;40m$2\033[0m"
fi
}
function os_version() {
local OS_V=$(cat /etc/issue |awk 'NR==1{print $1}')
if [ $OS_V == "\S" -o $OS_V == "CentOS" ]; then
echo "CentOS"
elif [ $OS_V == "Ubuntu" ]; then
echo "Ubuntu"
fi
}
function check_ssh_auth() {
if $(grep "Permission denied" $EXP_TMP_FILE >/dev/null); then
color_echo red "Host $IP SSH authentication failure! Login password error."
exit 1
elif $(ssh $INFO 'echo yes >/dev/null'); then
color_echo green "Host $IP SSH authentication successfully."
fi
rm $EXP_TMP_FILE >/dev/null
}
function check_pkg() {
local PKG_NAME=$1
if [ $(os_version) == "CentOS" ]; then
if ! $(rpm -ql $PKG_NAME >/dev/null 2>&1); then
echo no
else
echo yes
fi
elif [ $(os_version) == "Ubuntu" ]; then
if ! $(dpkg -l $PKG_NAME >/dev/null 2>&1); then
echo no
else
echo yes
fi
fi
}
function install_pkg() {
local PKG_NAME=$1
if [ $(os_version) == "CentOS" ]; then
if [ $(check_pkg $PKG_NAME) == "no" ]; then
yum install $PKG_NAME -y
if [ $(check_pkg $PKG_NAME) == "no" ]; then
color_echo green "The $PKG_NAME installation failure! Try to install again."
yum makecache
yum install $PKG_NAME -y
[ $(check_pkg $PKG_NAME) == "no" ] && color_echo red "The $PKG_NAME installation failure!" && exit 1
fi
fi
elif [ $(os_version) == "Ubuntu" ]; then
if [ $(check_pkg $PKG_NAME) == "no" ]; then
apt-get install $PKG_NAME -y
if [ $(check_pkg $PKG_NAME) == "no" ]; then
color_echo green "$PKG_NAME installation failure! Try to install again."
apt-get autoremove && apt-get update
apt-get install $PKG_NAME --force-yes -y
[ $(check_pkg $PKG_NAME) == "no" ] && color_echo red "The $PKG_NAME installation failure!" && exit 1
fi
fi
fi
}
function generate_keypair() {
if [ ! -e ~/.ssh/id_rsa.pub ]; then
color_echo green "The public/private rsa key pair not exist, start Generating..."
expect -c "
spawn ssh-keygen
expect {
\"ssh/id_rsa):\" {send \"\r\";exp_continue}
\"passphrase):\" {send \"\r\";exp_continue}
\"again:\" {send \"\r\";exp_continue}
}
" >/dev/null 2>&1
if [ -e ~/.ssh/id_rsa.pub ]; then
color_echo green "Generating public/private rsa key pair successfully."
else
color_echo red "Generating public/private rsa key pair failure!"
exit 1
fi
fi
}
EXP_TMP_FILE=/tmp/expect_ssh.tmp
if [[ $1 =~ ^[a-z]+@[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}@.* ]]; then
install_pkg expect ; generate_keypair
for i in $@; do
USER=$(echo $i|cut -d@ -f1)
IP=$(echo $i|cut -d@ -f2)
PASS=$(echo $i|cut -d@ -f3)
INFO=$USER@$IP
expect -c "
spawn ssh-copy-id $INFO
expect {
\"(yes/no)?\" {send \"yes\r\";exp_continue}
\"password:\" {send \"$PASS\r\";exp_continue}
}
" > $EXP_TMP_FILE # if login failed, login error info append temp file
check_ssh_auth
done
elif [[ $1 =~ ^[a-z]+@[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}-[0-9]{1,3}@.* ]]; then
install_pkg expect ; generate_keypair
START_IP_NUM=$(echo $1|sed -r 's/.*\.(.*)-(.*)@.*/\1/')
END_IP_NUM=$(echo $1|sed -r 's/.*\.(.*)-(.*)@.*/\2/')
for ((i=$START_IP_NUM;i<=$END_IP_NUM;i++)); do
USER=$(echo $1|cut -d@ -f1)
PASS=$(echo $1|cut -d@ -f3)
IP_RANGE=$(echo $1|sed -r 's/.*@(.*\.).*/\1/')
IP=$IP_RANGE$i
INFO=$USER@$IP_RANGE$i
expect -c "
spawn ssh-copy-id $INFO
expect {
\"(yes/no)?\" {send \"yes\r\";exp_continue}
\"password:\" {send \"$PASS\r\";exp_continue}
}
" > $EXP_TMP_FILE
check_ssh_auth
done
else
echo "Example1: $0 "
echo "Example2: $0 "
echo "Example3: $0 [root@192.168.1.10@password root@192.168.1.11@password root@192.168.1.12@password ...]"
fi
3)在master主机root权限执行脚本安装master端服务
操作命令：$ sudo bash kubernetes-install.sh master
脚本内容：$ cat kubernetes-install.sh
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284#!/bin/bash
# Description: Installation Kubernetes1.1.3
# Etcd Download: https://github.com/coreos/etcd/r ... -linux-amd64.tar.gz
# K8S Download: https://storage.googleapis.com/k ... 3/kubernetes.tar.gz
. /lib/lsb/init-functions
if [ $(cat /etc/issue |awk '{print $1}') != "Ubuntu" ]; then
echo "Only support ubuntu operating system!"
exit 1
fi
if [ $USER != "root" ]; then
echo "Please use root account operation!"
exit 1
fi
function color_echo() {
if [ $1 == "green" ]; then
echo -e "\033[32;40m$2\033[0m"
elif [ $1 == "red" ]; then
echo -e "\033[31;40m$2\033[0m"
fi
}
function check_install_pkg() {
if [ ! -e $ETCD_FILE -a ! -e $K8S_FILE ]; then
color_echo red "$ETCD_FILE and $K8S_FILE file not exist!"
exit 1
elif [ ! -e $ETCD_FILE ]; then
color_echo red "$ETCD_FILE file not exist!"
exit 1
elif [ ! -e $K8S_FILE ]; then
color_echo red "$K8S_FILE file not exist!"
exit 1
fi
}
function local_ip() {
local NUM ARRAY_LENGTH
NUM=0
for NIC_NAME in $(ls /sys/class/net|grep -vE "lo|docker0"); do
NIC_IP=$(ifconfig $NIC_NAME |awk -F'[: ]+' '/inet addr/{print $4}')
if [ -n "$NIC_IP" ]; then
NIC_IP_ARRAY[$NUM]="$NIC_NAME:$NIC_IP"
let NUM++
fi
done
ARRAY_LENGTH=${#NIC_IP_ARRAY}
if [ $ARRAY_LENGTH -eq 1 ]; then
LOCAL_IP=${NIC_IP_ARRAY[0]#*:}
return 0
elif [ $ARRAY_LENGTH -eq 0 ]; then
color_echo red "No available network card!"
exit 1
else
# multi network card select
for NIC in ${NIC_IP_ARRAY}; do
echo $NIC
done
while true; do
read -p "Please enter local use to network card name: " INPUT_NIC_NAME
for NIC in ${NIC_IP_ARRAY}; do
NIC_NAME=${NIC%:*}
if [ $NIC_NAME == "$INPUT_NIC_NAME" ]; then
LOCAL_IP=${NIC_IP_ARRAY[0]#*:}
return 0
fi
done
echo "Not match! Please input again."
done
fi
}
function check_ip() {
local IP=$1
VALID_CHECK=$(echo $IP|awk -F. '$1<=255&&$2<=255&&$3<=255&&$4<=255{print "yes"}')
if echo $IP|grep -E "^[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}$" >/dev/null; then
if [ ${VALID_CHECK:-no} == "yes" ]; then
return 0
else
echo "IP $IP not available!"
return 1
fi
else
echo "IP format error!"
return 1
fi
}
function cluster_ip() {
if [ $1 == "master" ]; then
while true; do
read -p "Please enter master IP: " MASTER_IP
check_ip $MASTER_IP
[ $? -eq 0 ] && break
done
elif [ $1 == "minion" ]; then
while true; do
local MINION_NUM
read -p "Please enter cluster minion node number: " MINION_NUM
if [[ $MINION_NUM =~ ^[0-9]+$ ]]; then
break
else
color_echo red "Format error!"
fi
done
NUM=1
while [ $NUM -le $MINION_NUM ]; do
local MINION_IP
read -p "Please enter minion host $NUM IP: " MINION_IP
check_ip $MINION_IP
if [ $? -eq 0 ]; then
let NUM++
MINION_IP_ARRAY+=($MINION_IP)
fi
done
fi
}
function modify_init_script() {
if [ $1 == "master" ]; then
cd $MASTER_MODULE_INIT_SCRIPT_DIR
elif [ $1 == "minion" ]; then
cd $MINION_MODULE_INIT_SCRIPT_DIR
fi
for MODULE_INIT_SCRIPT in $(ls|grep -v etcd); do
if [ -x $MODULE_INIT_SCRIPT ]; then
sed -r -i '/\/sbin\/initctl/{s/(if)(.*)/\1 false \&\&\2/}' $MODULE_INIT_SCRIPT
fi
done
}
function check_service_status() {
sleep 1
if [ $(ps -ef |grep -v grep|grep -c "$BIN_DIR/$MODULE_INIT_SCRIPT") -eq 1 ]; then
log_begin_msg "Starting $MODULE_INIT_SCRIPT"
log_end_msg 0 # 0 is the right command execution status
else
log_failure_msg "$(color_echo red "Starting $MODULE_INIT_SCRIPT")"
log_end_msg 1 # 1 is the wrong command execution status
fi
}
function check_exec_status() {
if [ $? -ne 0 ]; then
color_echo green "Please try to run the script!"
exit 1
fi
}
BASE_DIR=$PWD
ETCD_FILE=$BASE_DIR/etcd-v2.2.2-linux-amd64.tar.gz
K8S_FILE=$BASE_DIR/kubernetes.tar.gz
BIN_DIR=/opt/bin
INIT_SCRIPT_DIR=/etc/init.d
OPTS_FILE_DIR=/etc/default
MODULE_BIN_DIR=$BASE_DIR/kubernetes/server/bin
MASTER_MODULE_INIT_SCRIPT_DIR=$BASE_DIR/kubernetes/cluster/ubuntu/master/init_scripts
MINION_MODULE_INIT_SCRIPT_DIR=$BASE_DIR/kubernetes/cluster/ubuntu/minion/init_scripts
case $1 in
master)
check_install_pkg
pkill etcd ; pkill kube
cluster_ip minion
# Create binary file directory
[ ! -d $BIN_DIR ] && mkdir $BIN_DIR
# Installation storage system etcd
log_action_msg "Unzip the $ETCD_FILE"
tar zxf $ETCD_FILE ; check_exec_status
cp $BASE_DIR/etcd-v2.2.2-linux-amd64/etc* $BIN_DIR ; check_exec_status
echo "
ETCD_OPTS=\"\
--listen-client-urls http://0.0.0.0:4001 \
--advertise-client-urls http://0.0.0.0:4001 \
--data-dir /var/lib/etcd/default.etcd\"
" > $OPTS_FILE_DIR/etcd
# Installation module kube-apiserver kube-scheduler and kube-controller-manager
log_action_msg "Unzip the $K8S_FILE"
tar zxf $BASE_DIR/kubernetes.tar.gz ; check_exec_status
tar zxf $BASE_DIR/kubernetes/server/kubernetes-server-linux-amd64.tar.gz ; check_exec_status
cd $MODULE_BIN_DIR && cp -a kubectl kube-apiserver kube-scheduler kube-controller-manager $BIN_DIR ; check_exec_status
# Configure init scripts
modify_init_script master
cp -a etcd kube-* $INIT_SCRIPT_DIR ; check_exec_status
sed -i '63s/.*/"/' $INIT_SCRIPT_DIR/etcd #Remove the append log file,Otherwise etcd may cannot be started
# Module Configure option
log_action_msg "Create $OPTS_FILE_DIR/kube-apiserver startup options file ..."
echo "
KUBE_APISERVER_OPTS=\"\
--insecure-bind-address=0.0.0.0 \
--insecure-port=8080 \
--service-cluster-ip-range=10.0.0.0/16 \
--etcd_servers=http://127.0.0.1:4001 \
--logtostderr=true\"
" > $OPTS_FILE_DIR/kube-apiserver
check_exec_status
log_action_msg "Create $OPTS_FILE_DIR/kube-controller-manager startup options file ..."
echo "
KUBE_CONTROLLER_MANAGER_OPTS=\"\
--master=127.0.0.1:8080 \
--logtostderr=true\"
" > $OPTS_FILE_DIR/kube-controller-manager
log_action_msg "Create $OPTS_FILE_DIR/kube-scheduler startup options file ..."
echo "
KUBE_SCHEDULER_OPTS=\"\
--master=127.0.0.1:8080 \
--logtostderr=true\"
" > $OPTS_FILE_DIR/kube-scheduler
# Starting module
for MODULE_INIT_SCRIPT in $(ls $INIT_SCRIPT_DIR|grep -E "(etcd|kube.*)"); do
service $MODULE_INIT_SCRIPT start >/dev/null
check_service_status
done
# set variable
echo "export PATH=$PATH:$BIN_DIR" >> /etc/profile
. /etc/profile
# Copy module kubelet and kube-proxy to minion
SSH_OPTS="-o ConnectTimeout=1 -o ConnectionAttempts=3"
cd $MODULE_BIN_DIR
for MINION_IP in ${MINION_IP_ARRAY}; do
log_action_msg "Copy module to $MINION_IP:$BIN_DIR ..."
ssh $SSH_OPTS root@$MINION_IP "[ ! -d $BIN_DIR ] && mkdir $BIN_DIR" ; check_exec_status
scp $SSH_OPTS kubelet kube-proxy root@$MINION_IP:$BIN_DIR
done
# Copy module init scripts to minion
modify_init_script minion
cd $MINION_MODULE_INIT_SCRIPT_DIR
for MINION_IP in ${MINION_IP_ARRAY}; do
log_action_msg "Copy module init scripts to $MINION_IP:$INIT_SCRIPT_DIR ..."
scp $SSH_OPTS kubelet kube-proxy root@$MINION_IP:$INIT_SCRIPT_DIR ; check_exec_status
done
color_echo green "Kubernetes master installation complete."
;;
minion)
cluster_ip master # Notice input master ip
local_ip
pkill kube
# Install Docker
if ! $(dpkg -l docker-engine >/dev/null 2>&1) && ! $(docker info >/dev/null 2>&1); then
log_action_msg "Start the installation Docker ..."
apt-key adv --keyserver hkp://p80.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D >/dev/null 2>&1
[ $? -ne 0 ] && echo "Docker source secret key register failure!"
DOCKER_U_SOURCE=/tmp/docker_source.tmp
echo "
deb https://apt.dockerproject.org/repo ubuntu-precise main
deb https://apt.dockerproject.org/repo ubuntu-trusty main
deb https://apt.dockerproject.org/repo ubuntu-vivid main
deb https://apt.dockerproject.org/repo ubuntu-wily main
" > $DOCKER_U_SOURCE
OS_CODE_V=$(lsb_release -cs)
DOKER_SOURCE=$(grep $OS_CODE_V $DOCKER_U_SOURCE)
echo "$DOKER_SOURCE" > /etc/apt/sources.list.d/docker.list
rm $DOCKER_U_SOURCE
apt-get update
apt-get install docker-engine -y
if $(dpkg -l docker-engine >/dev/null) && $(docker info >/dev/null); then
color_echo green "Docker installation successfully."
else
apt-get remove ; apt-get install docker-engine --force-yes -y
if ! $(dpkg -l docker-engine >/dev/null) && ! $(docker info >/dev/null); then
color_echo red "Docker installation failure!"
exit 1
fi
fi
fi
# Module Configure option
log_action_msg "Create $OPTS_FILE_DIR/kubelet startup options file ..."
echo "
KUBELET_OPTS=\"\
--address=0.0.0.0 \
--port=10250 \
--hostname_override=$LOCAL_IP \
--api_servers=http://$MASTER_IP:8080 \
--pod-infra-container-image=docker.io/kubernetes/pause:latest \
--logtostderr=true\"
" > $OPTS_FILE_DIR/kubelet
log_action_msg "Create $OPTS_FILE_DIR/kube-proxy startup options file ..."
echo "
KUBE_PROXY_OPTS=\"\
--master=http://$MASTER_IP:8080 \
--proxy-mode=iptables \
--logtostderr=true\"
" > $OPTS_FILE_DIR/kube-proxy
# Starting module
for MODULE_INIT_SCRIPT in $(ls $INIT_SCRIPT_DIR|grep kube.*); do
service $MODULE_INIT_SCRIPT start >/dev/null
check_service_status
done
color_echo green "Kubernetes minion installation complete."
;;
*)
echo "Usage: $0 {master|minion}"
exit 1
;;
esac
4)在minion主机root权限执行脚本安装minion端服务
操作命令：$ sudo bash kubernetes-install.sh minion
脚本内容：同上
5)在minion主机root权限执行脚本创建GRE通道
操作命令：$ sudo bash config_gre_channel.sh
脚本内容：$ cat config_gre_channel.sh
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155#!/bin/bash
# Description: configuration docker host between GRE Channel
if [ $(cat /etc/issue |awk '{print $1}') != "Ubuntu" ]; then
echo "Only support ubuntu operating system!"
exit 1
fi
if [ $USER != "root" ]; then
echo "Please use root account operation!"
exit 1
fi
function color_echo() {
if [ $1 == "green" ]; then
echo -e "\033[32;40m$2\033[0m"
elif [ $1 == "red" ]; then
echo -e "\033[31;40m$2\033[0m"
fi
}
function check_ip() {
local IP=$1
local VALID_CHECK=$(echo $IP|awk -F. '$1<=255&&$2<=255&&$3<=255&&$4<=255{print "yes"}')
if echo $IP|grep -E "^[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}$" >/dev/null; then
if [ ${VALID_CHECK:-no} == "yes" ]; then
return 0
else
echo "IP $IP not available!"
return 1
fi
else
echo "IP format error!"
return 1
fi
}
function docker_host_ip() {
color_echo green "Notice: Only support two Docker host configuration GRE Channel!"
NUM=1
while [ $NUM -le 2 ]; do
local DOCKER_IP
read -p "Please enter Docker host $NUM IP: " DOCKER_HOST_IP
check_ip $DOCKER_HOST_IP
if [ $? -eq 0 ]; then
let NUM++
DOCKER_HOST_IP_ARRAY+=($DOCKER_HOST_IP)
fi
done
}
function local_nic_info() {
local NUM ARRAY_LENGTH
NUM=0
for NIC_NAME in $(ls /sys/class/net|grep -vE "lo|docker0"); do
NIC_IP=$(ifconfig $NIC_NAME |awk -F'[: ]+' '/inet addr/{print $4}')
if [ -n "$NIC_IP" ]; then
NIC_IP_ARRAY[$NUM]="$NIC_NAME:$NIC_IP"
let NUM++
fi
done
ARRAY_LENGTH=${#NIC_IP_ARRAY}
if [ $ARRAY_LENGTH -eq 1 ]; then
LOCAL_NIC=${NIC_IP_ARRAY[0]%:*}
LOCAL_IP=${NIC_IP_ARRAY[0]#*:}
return 0
elif [ $ARRAY_LENGTH -eq 0 ]; then
color_echo red "No available network card!"
exit 1
else
# multi network card select
for NIC in ${NIC_IP_ARRAY}; do
echo $NIC
done
while true; do
read -p "Please enter local use to network card name: " INPUT_NIC_NAME
for NIC in ${NIC_IP_ARRAY}; do
NIC_NAME=${NIC%:*}
if [ $NIC_NAME == "$INPUT_NIC_NAME" ]; then
LOCAL_NIC=${NIC_IP_ARRAY[0]%:*}
LOCAL_IP=${NIC_IP_ARRAY[0]#*:}
return 0
fi
done
echo "Not match! Please input again."
done
fi
}
function check_pkg() {
if ! $(dpkg -l $PKG_NAME >/dev/null 2>&1); then
echo no
else
echo yes
fi
}
function install_pkg() {
local PKG_NAME=$1
if [ $(check_pkg $PKG_NAME) == "no" ]; then
apt-get install $PKG_NAME -y
if [ $(check_pkg $PKG_NAME) == "no" ]; then
color_echo green "The $PKG_NAME installation failure! Try to install again."
apt-get autoremove && apt-get update
apt-get install $PKG_NAME --force-yes -y
[ $(check_pkg $PKG_NAME) == "no" ] && color_echo red "The $PKG_NAME installation failure!" && exit 1
fi
fi
}
function config_gre_channel() {
install_pkg openvswitch-switch
install_pkg bridge-utils
if [ ${DOCKER_HOST_IP_ARRAY[0]} == "$LOCAL_IP" ]; then
REMOTE_HOST_IP=${DOCKER_HOST_IP_ARRAY[1]} # remote host ip
REMOTE_DOCKER_IP="172.17.2.0/24" # remote docker host default container ip range
LOCAL_DOCKER_IP="172.17.1.0" # kbr0 gateway
elif [ ${DOCKER_HOST_IP_ARRAY[1]} == "$LOCAL_IP" ]; then
REMOTE_HOST_IP=${DOCKER_HOST_IP_ARRAY[0]}
REMOTE_DOCKER_IP="172.17.1.0/24"
LOCAL_DOCKER_IP="172.17.2.0"
else
echo "IP not match! Please input again."
exit 1
fi
ovs-vsctl add-br obr0 2>/dev/null
ovs-vsctl add-port obr0 gre0 -- set Interface gre0 type=gre options:remote_ip=$REMOTE_HOST_IP 2>/dev/null
brctl addbr kbr0 2>/dev/null
brctl addif kbr0 obr0 2>/dev/null
ip link set dev kbr0 up
if [ $(grep -cE "kbr0" /etc/network/interfaces) -ne 2 ]; then
echo "
auto kbr0
iface kbr0 inet static
address $(echo $LOCAL_DOCKER_IP|sed 's/0$/1/')
netmask 255.255.255.0
gateway $LOCAL_DOCKER_IP
bridge_ports obr0
" >> /etc/network/interfaces
fi
if $(ls /sys/class/net|grep docker0 >/dev/null); then
service docker stop >/dev/null
ip link set dev docker0 down
ip link delete dev docker0
echo "DOCKER_OPTS=\"-b=kbr0\"" > /etc/default/docker
service docker start >/dev/null
fi
ifdown kbr0 >/dev/null 2>&1;ifup kbr0 >/dev/null 2>&1
# reboot invalid
# ip route add $REMOTE_DOCKER_IP via $REMOTE_HOST_IP dev $LOCAL_NIC 2>/dev/null
# permanent valid
if ! $(grep "$REMOTE_DOCKER_IP via $REMOTE_HOST_IP" /etc/rc.local >/dev/null); then
sed -i "$i\ip route add $REMOTE_DOCKER_IP via $REMOTE_HOST_IP dev $LOCAL_NIC" /etc/rc.local
fi
}
# main
docker_host_ip
echo "--------------------------------------------"
local_nic_info
config_gre_channel
color_echo green "GRE Channel configuration complete."
brctl show
echo "-------------------------------------------------"
ovs-vsctl show
1、配置minion主机root SSH登录
先将config_gre_channel.sh、config_ssh_root_remote.sh和kubernetes-install.sh这三个文件上传各自的minion主机，以备后用。
QQ截图20160127083003.jpg (164.38 KB, 下载次数: 2)
2016-1-27 08:35 上传
QQ截图20160127083014.jpg (163.32 KB, 下载次数: 2)
2016-1-27 08:35 上传
说明：操作成功，root密码为123
2、配置master主机与minion主机SSH免交互认证
将kubernetes-install.sh、ssh_keypair_auth.sh和etcd-v2.2.2-linux-amd64.tar.gz、kubernetes.tar.gz安装包上传到master主机
QQ截图20160127083024.jpg (160.51 KB, 下载次数: 1)
2016-1-27 08:35 上传
3、安装master端
QQ截图20160127083032.jpg (130.48 KB, 下载次数: 1)
2016-1-27 08:35 上传
QQ截图20160127084236.jpg (66.28 KB, 下载次数: 1)
2016-1-27 08:42 上传
说明：先解压文件，在创建启动选项文件，再启动服务，最后将minion相关包通过scp工具拷贝过去。通过ps工具看到服务进程已经启动。
4、安装minion端
QQ截图20160127083051.jpg (112.05 KB, 下载次数: 3)
2016-1-27 08:35 上传
QQ截图20160127083041.jpg (4.42 KB, 下载次数: 2)
2016-1-27 08:35 上传
QQ截图20160127083101.jpg (61.63 KB, 下载次数: 2)
2016-1-27 08:35 上传
QQ截图20160127083108.jpg (118.28 KB, 下载次数: 3)
2016-1-27 08:35 上传
QQ截图20160127083118.jpg (65.26 KB, 下载次数: 1)
2016-1-27 08:35 上传
说明：Docker源秘钥注册失败，没关系，一般不会影响安装。当提示安装docker成功后才能继续，否则报错退出。通过ps 工具看到服务进程都已经启动。
5、配置GRE通道
QQ截图20160127083126.jpg (120.16 KB, 下载次数: 3)
2016-1-27 08:35 上传
QQ截图20160127083134.jpg (53.76 KB, 下载次数: 1)
2016-1-27 08:35 上传
QQ截图20160127083142.jpg (122.05 KB, 下载次数: 4)
2016-1-27 08:35 上传
QQ截图20160127083148.jpg (53.64 KB, 下载次数: 2)
2016-1-27 08:35 上传
说明：目前配置GRE通道脚本只支持两台Docker主机
6、查看集群是否配置成功
# 通过kubectl命令创建一个pod
QQ截图20160127083204.jpg (59.9 KB, 下载次数: 3)
2016-1-27 08:35 上传
QQ截图20160127083224.jpg (58.55 KB, 下载次数: 1)
2016-1-27 08:35 上传
说明：在master端可以看到两台minion端状态是Ready，并且创建的Pod已经成功运行。
注意：如果没有kubectl命令，先尝试执行source /etc/profile下看看，如果还没有，直接使用/opt/bin/kubectl
1612
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
