k8s单节点部署——-部署master组件
实验
环境配置
名称 | IP |
---|---|
主master | 192.168.28.10 |
备master | 192.168.28.40 |
load balancer01 | 192.168.28.50 |
load balancer02 | 192.168.28.60 |
vip | 192.168.28.70 |
这里的备master\load balancer01\load balancer02\vip
为以后多节点部署做准备,本文是做单节点!
部署master组件
1、api-server生成证书
在master上操作,api-server生成证书
[root@localhost k8s]# unzip master.zip
[root@localhost k8s]# mkdir /opt/kubernetes/{cfg,bin,ssl} -p
[root@localhost k8s]# mkdir k8s-cert
[root@localhost k8s]# cd k8s-cert/
2、编辑k8s-cert.sh脚本
vim k8s-cert.sh
cat > ca-config.json <<EOF
{
"signing": {
"default": {
"expiry": "87600h"
},
"profiles": {
"kubernetes": {
"expiry": "87600h",
"usages": [
"signing",
"key encipherment",
"server auth",
"client auth"
]
}
}
}
}
EOF
cat > ca-csr.json <<EOF
{
"CN": "kubernetes",
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "Beijing",
"ST": "Beijing",
"O": "k8s",
"OU": "System"
}
]
}
EOF
cfssl gencert -initca ca-csr.json | cfssljson -bare ca -
#-----------------------
cat > server-csr.json <<EOF
{
"CN": "kubernetes",
"hosts": [
"10.0.0.1",
"127.0.0.1",
"192.168.28.10", //master1
"192.168.28.40", //master2
"192.168.28.50", //lb (master)
"192.168.28.60", //lb (backup)
"192.168.28.70", //vip
"kubernetes",
"kubernetes.default",
"kubernetes.default.svc",
"kubernetes.default.svc.cluster",
"kubernetes.default.svc.cluster.local"
],
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "BeiJing",
"ST": "BeiJing",
"O": "k8s",
"OU": "System"
}
]
}
EOF
cfssl gencert -ca=ca.pem -ca-key=ca-key.pem -config=ca-config.json -profile=kubernetes server-csr.json | cfssljson -bare server
#-----------------------
cat > admin-csr.json <<EOF
{
"CN": "admin",
"hosts": [],
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "BeiJing",
"ST": "BeiJing",
"O": "system:masters",
"OU": "System"
}
]
}
EOF
cfssl gencert -ca=ca.pem -ca-key=ca-key.pem -config=ca-config.json -profile=kubernetes admin-csr.json | cfssljson -bare admin
#-----------------------
cat > kube-proxy-csr.json <<EOF
{
"CN": "system:kube-proxy",
"hosts": [],
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "BeiJing",
"ST": "BeiJing",
"O": "k8s",
"OU": "System"
}
]
}
EOF
cfssl gencert -ca=ca.pem -ca-key=ca-key.pem -config=ca-config.json -profile=kubernetes kube-proxy-csr.json | cfssljson -bare kube-proxy
3、生成k8s证书
[root@localhost k8s-cert]# bash k8s-cert.sh
2021/04/13 15:03:31 [INFO] generating a new CA key and certificate from CSR
2021/04/13 15:03:31 [INFO] generate received request
2021/04/13 15:03:31 [INFO] received CSR
2021/04/13 15:03:31 [INFO] generating key: rsa-2048
2021/04/13 15:03:31 [INFO] encoded CSR
2021/04/13 15:03:31 [INFO] signed certificate with serial number 289944029067505238073598846609627353772210720197
2021/04/13 15:03:31 [INFO] generate received request
2021/04/13 15:03:31 [INFO] received CSR
2021/04/13 15:03:31 [INFO] generating key: rsa-2048
2021/04/13 15:03:31 [INFO] encoded CSR
2021/04/13 15:03:31 [INFO] signed certificate with serial number 83720806861980654725646900734618586086757943382
2021/04/13 15:03:31 [WARNING] This certificate lacks a "hosts" field. This makes it unsuitable for
websites. For more information see the Baseline Requirements for the Issuance and Management
of Publicly-Trusted Certificates, v.1.1.6, from the CA/Browser Forum (https://cabforum.org);
specifically, section 10.2.3 ("Information Requirements").
2021/04/13 15:03:31 [INFO] generate received request
2021/04/13 15:03:31 [INFO] received CSR
2021/04/13 15:03:31 [INFO] generating key: rsa-2048
2021/04/13 15:03:31 [INFO] encoded CSR
2021/04/13 15:03:31 [INFO] signed certificate with serial number 708087106402565513741516777753951633811018836031
2021/04/13 15:03:31 [WARNING] This certificate lacks a "hosts" field. This makes it unsuitable for
websites. For more information see the Baseline Requirements for the Issuance and Management
of Publicly-Trusted Certificates, v.1.1.6, from the CA/Browser Forum (https://cabforum.org);
specifically, section 10.2.3 ("Information Requirements").
2021/04/13 15:03:31 [INFO] generate received request
2021/04/13 15:03:31 [INFO] received CSR
2021/04/13 15:03:31 [INFO] generating key: rsa-2048
2021/04/13 15:03:32 [INFO] encoded CSR
2021/04/13 15:03:32 [INFO] signed certificate with serial number 532303409635063109933985612956617418151832825827
2021/04/13 15:03:32 [WARNING] This certificate lacks a "hosts" field. This makes it unsuitable for
websites. For more information see the Baseline Requirements for the Issuance and Management
of Publicly-Trusted Certificates, v.1.1.6, from the CA/Browser Forum (https://cabforum.org);
specifically, section 10.2.3 ("Information Requirements").
//查看生成的证书
[root@localhost k8s-cert]# ls *pem
admin-key.pem ca-key.pem kube-proxy-key.pem server-key.pem
admin.pem ca.pem kube-proxy.pem server.pem
//把证书复制到/opt/kubernetes/ssl/中
[root@localhost k8s-cert]# cp ca*pem server*pem /opt/kubernetes/ssl/
4、准备二进制文件,token,证书
[root@localhost k8s-cert]# cd /root/k8s
//解压kubernetes压缩包,此前要把kubernetes-server-linux-amd64.tar.gz包下载好,再官网上下载
[root@localhost k8s]# tar zxvf kubernetes-server-linux-amd64.tar.gz
[root@localhost k8s]# cd /root/k8s/kubernetes/server/bin
//复制关键命令文件
[root@localhost bin]# cp kube-apiserver kubectl kube-controller-manager kube-scheduler /opt/kubernetes/bin/
[root@localhost k8s]# cd /root/k8s
//使用 head -c 16 /dev/urandom | od -An -t x | tr -d ' ' 可以随机生成序列号
[root@master bin]# head -c 16 /dev/urandom | od -An -t x | tr -d ' '
0ca8f98a9c22ff88805119f3210ede92
[root@localhost k8s]# vim /opt/kubernetes/cfg/token.csv
0ca8f98a9c22ff88805119f3210ede92,kubelet-bootstrap,10001,"system:kubelet-bootstrap"
序列号,用户名,id,角色
5、开启apiserver
[root@localhost k8s]# bash apiserver.sh 192.168.28.10 https://192.168.28.10:2379,https://192.168.28.20:2379,https://192.168.28.30:2379
Created symlink from /etc/systemd/system/multi-user.target.wants/kube-apiserver.service to /usr/lib/systemd/system/kube-apiserver.service.
//检查进程是否启动成功
[root@localhost k8s]# ps aux | grep kube
root 10984 49.7 8.5 415448 328772 ? Ssl 15:14 0:07 /opt/kubernetes/bin/kube-apiserver --logtostderr=true --v=4 --etcd-servers=https://192.168.28.10:2379,https://192.168.28.20:2379,https://192.168.28.30:2379 --bind-address=192.168.28.10 --secure-port=6443 --advertise-address=192.168.28.10 --allow-privileged=true --service-cluster-ip-range=10.0.0.0/24 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,ResourceQuota,NodeRestriction --authorization-mode=RBAC,Node --kubelet-https=true --enable-bootstrap-token-auth --token-auth-file=/opt/kubernetes/cfg/token.csv --service-node-port-range=30000-50000 --tls-cert-file=/opt/kubernetes/ssl/server.pem --tls-private-key-file=/opt/kubernetes/ssl/server-key.pem --client-ca-file=/opt/kubernetes/ssl/ca.pem --service-account-key-file=/opt/kubernetes/ssl/ca-key.pem --etcd-cafile=/opt/etcd/ssl/ca.pem --etcd-certfile=/opt/etcd/ssl/server.pem --etcd-keyfile=/opt/etcd/ssl/server-key.pem
root 10999 0.0 0.0 112676 984 pts/1 S+ 15:14 0:00 grep --color=auto kube
//查看配置文件
[root@localhost k8s]# cat /opt/kubernetes/cfg/kube-apiserver
KUBE_APISERVER_OPTS="--logtostderr=true \
--v=4 \
--etcd-servers=https://192.168.28.10:2379,https://192.168.28.20:2379,https://192.168.28.30:2379 \
--bind-address=192.168.28.10\
--secure-port=6443 \
--advertise-address=192.168.28.10\
--allow-privileged=true \
--service-cluster-ip-range=10.0.0.0/24 \
--enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,ResourceQuota,NodeRestriction \
--authorization-mode=RBAC,Node \
--kubelet-https=true \
--enable-bootstrap-token-auth \
--token-auth-file=/opt/kubernetes/cfg/token.csv \
--service-node-port-range=30000-50000 \
--tls-cert-file=/opt/kubernetes/ssl/server.pem \
--tls-private-key-file=/opt/kubernetes/ssl/server-key.pem \
--client-ca-file=/opt/kubernetes/ssl/ca.pem \
--service-account-key-file=/opt/kubernetes/ssl/ca-key.pem \
--etcd-cafile=/opt/etcd/ssl/ca.pem \
--etcd-certfile=/opt/etcd/ssl/server.pem \
--etcd-keyfile=/opt/etcd/ssl/server-key.pem"
//监听的https端口
[root@master k8s]# netstat -natp | grep 6443
tcp 0 0 192.168.28.10:6443 0.0.0.0:* LISTEN 10984/kube-apiserve
tcp 0 0 192.168.28.10:6443 192.168.28.10:58936 ESTABLISHED 10984/kube-apiserve
tcp 0 0 192.168.28.10:58936 192.168.28.10:6443 ESTABLISHED 10984/kube-apiserve
[root@master k8s]# netstat -natp | grep 8080
tcp 0 0 127.0.0.1:8080 0.0.0.0:* LISTEN 10984/kube-apiserve
6、启动scheduler服务
[root@localhost k8s]# ./scheduler.sh 127.0.0.1
Created symlink from /etc/systemd/system/multi-user.target.wants/kube-scheduler.service to /usr/lib/systemd/system/kube-scheduler.service.
[root@master k8s]# ps aux | grep kube
postfix 10404 0.0 0.1 91732 4008 ? S 14:40 0:00 pickup -l -t unix -u
root 10984 5.5 8.5 415448 329008 ? Ssl 15:14 0:10 /opt/kubernetes/bin/kube-apiserver --logtostderr=true --v=4 --etcd-servers=https://192.168.28.10:2379,https://192.168.28.20:2379,https://192.168.28.30:2379 --bind-address=192.168.28.10 --secure-port=6443 --advertise-address=192.168.28.10 --allow-privileged=true --service-cluster-ip-range=10.0.0.0/24 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,ResourceQuota,NodeRestriction --authorization-mode=RBAC,Node --kubelet-https=true --enable-bootstrap-token-auth --token-auth-file=/opt/kubernetes/cfg/token.csv --service-node-port-range=30000-50000 --tls-cert-file=/opt/kubernetes/ssl/server.pem --tls-private-key-file=/opt/kubernetes/ssl/server-key.pem --client-ca-file=/opt/kubernetes/ssl/ca.pem --service-account-key-file=/opt/kubernetes/ssl/ca-key.pem --etcd-cafile=/opt/etcd/ssl/ca.pem --etcd-certfile=/opt/etcd/ssl/server.pem --etcd-keyfile=/opt/etcd/ssl/server-key.pem
root 11099 1.6 0.5 46128 19632 ? Ssl 15:17 0:00 /opt/kubernetes/bin/kube-scheduler --logtostderr=true --v=4 --master=127.0.0.1:8080 --leader-elect
root 11113 0.0 0.0 112680 976 pts/1 S+ 15:18 0:00 grep --color=auto ku
7、启动controller-manager
[root@localhost k8s]# chmod +x controller-manager.sh
[root@localhost k8s]# ./controller-manager.sh 127.0.0.1
Created symlink from /etc/systemd/system/multi-user.target.wants/kube-controller-manager.service to /usr/lib/systemd/system/kube-controller-manager.service.
[root@master k8s]# ps aux | grep kube
root 10984 3.6 8.5 415448 329516 ? Ssl 15:14 0:14 /opt/kubernetes/bin/kube-apiserver --logtostderr=true --v=4 --etcd-servers=https://192.168.28.10:2379,https://192.168.28.20:2379,https://192.168.28.30:2379 --bind-address=192.168.28.10 --secure-port=6443 --advertise-address=192.168.28.10 --allow-privileged=true --service-cluster-ip-range=10.0.0.0/24 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,ResourceQuota,NodeRestriction --authorization-mode=RBAC,Node --kubelet-https=true --enable-bootstrap-token-auth --token-auth-file=/opt/kubernetes/cfg/token.csv --service-node-port-range=30000-50000 --tls-cert-file=/opt/kubernetes/ssl/server.pem --tls-private-key-file=/opt/kubernetes/ssl/server-key.pem --client-ca-file=/opt/kubernetes/ssl/ca.pem --service-account-key-file=/opt/kubernetes/ssl/ca-key.pem --etcd-cafile=/opt/etcd/ssl/ca.pem --etcd-certfile=/opt/etcd/ssl/server.pem --etcd-keyfile=/opt/etcd/ssl/server-key.pem
root 11099 1.2 0.5 47184 20552 ? Ssl 15:17 0:02 /opt/kubernetes/bin/kube-scheduler --logtostderr=true --v=4 --master=127.0.0.1:8080 --leader-elect
root 11173 2.8 1.7 146400 67836 ? Ssl 15:18 0:04 /opt/kubernetes/bin/kube-controller-manager --logtostderr=true --v=4 --master=127.0.0.1:8080 --leader-elect=true --address=127.0.0.1 --service-cluster-ip-range=10.0.0.0/24 --cluster-name=kubernetes --cluster-signing-cert-file=/opt/kubernetes/ssl/ca.pem --cluster-signing-key-file=/opt/kubernetes/ssl/ca-key.pem --root-ca-file=/opt/kubernetes/ssl/ca.pem --service-account-private-key-file=/opt/kubernetes/ssl/ca-key.pem --experimental-cluster-signing-duration=87600h0m0s
root 11235 0.0 0.0 112676 980 pts/1 S+ 15:21 0:00 grep --color=auto kube
8、查看master 节点状态
[root@localhost k8s]# /opt/kubernetes/bin/kubectl get cs
NAME STATUS MESSAGE ERROR
scheduler Healthy ok
controller-manager Healthy ok
etcd-2 Healthy {"health":"true"}
etcd-1 Healthy {"health":"true"}
etcd-0 Healthy {"health":"true"}
若是查询出现上面的的信息,则说明部署成功!!!