K8S集群搭建

身体好饿

已于 2024-04-01 15:17:50 修改

阅读量375

点赞数

分类专栏：云原生文章标签： kubernetes docker

于 2023-01-18 15:50:02 首次发布

本文链接：https://blog.csdn.net/weixin_37375983/article/details/128724583

版权

云原生专栏收录该内容

7 篇文章 0 订阅

订阅专栏

1.版本统一

Docker 18.09.0
---
kubeadm-1.14.0-0
kubelet-1.14.0-0
kubectl-1.14.0-0
---
k8s.gcr.io/kube-apiserver:v1.14.0
k8s.gcr.io/kube-controller-manager:v1.14.0
k8s.gcr.io/kube-scheduler:v1.14.0
k8s.gcr.io/kube-proxy:v1.14.0
k8s.gcr.io/pause:3.1
k8s.gcr.io/etcd:3.3.10
k8s.gcr.io/coredns:1.3.1
---
calico:v3.9

2.准备3台centos

参考

VisualBox+Vagrant搭建Linux虚拟机_visualbox 安装_身体好饿的博客-CSDN博客

创建一台后，复制2台然后修改ip（vim /etc/sysconfig/network-scripts/ifcfg-eth1）

3.更新依赖

3台服务器都执行

yum -y update
yum install -y conntrack ipvsadm ipset jq sysstat curl iptables libseccomp

4 .安装Docker

推荐使用xshell操作3台服务器，工具->发送键输入到所有会话。这样3台服务器就会通知执行输入

在每一台机器上都安装好Docker，版本为18.09.0

01 安装必要的依赖
   sudo yum install -y yum-utils \
device-mapper-persistent-data \
lvm2

02 设置docker仓库
【设置要设置一下阿里云镜像加速器】
sudo mkdir -p /etc/docker
sudo tee /etc/docker/daemon.json <<-'EOF'
{
"registry-mirrors": ["https://ez6psnmf.mirror.aliyuncs.com"]
}
EOF

sudo systemctl daemon-reload
   sudo yum-config-manager --add-repo http://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo


03 安装docker

yum install -y docker-ce-18.09.0 docker-ce-cli-18.09.0 containerd.io

04 启动docker
   sudo systemctl start docker && sudo systemctl enable docker

5 .修改hosts文件

(1)master

# 设置master的hostname，并且修改hosts文件
sudo hostnamectl set-hostname m

vi /etc/hosts
192.168.56.101 m
192.168.56.102 w1
192.168.56.103 w2

(2)两个worker

# 分别设置worker01/02的hostname，并且修改hosts文件
sudo hostnamectl set-hostname w1
sudo hostnamectl set-hostname w2

vi /etc/hosts
192.168.8.51 m
192.168.8.61 w1
192.168.8.62 w2

(3)使用ping测试一下

6.系统基础前提配置

(1)配置yum源

cat <<EOF > /etc/yum.repos.d/kubernetes.repo
[kubernetes]
name=Kubernetes
baseurl=http://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-x86_64
enabled=1
gpgcheck=0
repo_gpgcheck=0
gpgkey=http://mirrors.aliyun.com/kubernetes/yum/doc/yum-key.gpg
http://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpg
EOF

(2)安装kubeadm&kubelet&kubectl

yum -y install kubelet-1.14.0 --disableexcludes=kubernetes
yum -y install kubeadm-1.14.0 --disableexcludes=kubernetes
yum -y install kubectl-1.14.0 --disableexcludes=kubernetes

(3)docker和k8s设置同一个cgroup

# docker
vi /etc/docker/daemon.json
"exec-opts": ["native.cgroupdriver=systemd"],

systemctl restart docker

# kubelet，这边如果发现输出directory not exist，也说明是没问题的，大家继续往下进行即可
sed -i "s/cgroup-driver=systemd/cgroup-driver=cgroupfs/g" /etc/systemd/system/kubelet.service.d/10-kubeadm.conf

systemctl enable kubelet && systemctl start kubelet

（4）验证是否安装成功

kubeadm config images list

7.proxy/pause/scheduler等国内镜像

(1)查看kubeadm使用的镜像

kubeadm config images list

可以发现这里都是国外的镜像

k8s.gcr.io/kube-apiserver:v1.14.0
k8s.gcr.io/kube-controller-manager:v1.14.0
k8s.gcr.io/kube-scheduler:v1.14.0
k8s.gcr.io/kube-proxy:v1.14.0
k8s.gcr.io/pause:3.1
k8s.gcr.io/etcd:3.3.10
k8s.gcr.io/coredns:1.3.1

(2)解决国外镜像不能访问的问题

创建kubeadm.sh脚本，用于拉取镜像/打tag/删除原有镜像

#!/bin/bash

set -e

KUBE_VERSION=v1.14.0
KUBE_PAUSE_VERSION=3.1
ETCD_VERSION=3.3.10
CORE_DNS_VERSION=1.3.1

GCR_URL=k8s.gcr.io
ALIYUN_URL=registry.cn-hangzhou.aliyuncs.com/google_containers

images=(kube-proxy:${KUBE_VERSION}
kube-scheduler:${KUBE_VERSION}
kube-controller-manager:${KUBE_VERSION}
kube-apiserver:${KUBE_VERSION}
pause:${KUBE_PAUSE_VERSION}
etcd:${ETCD_VERSION}
coredns:${CORE_DNS_VERSION})

for imageName in ${images[@]} ; do
docker pull $ALIYUN_URL/$imageName
docker tag $ALIYUN_URL/$imageName $GCR_URL/$imageName
docker rmi $ALIYUN_URL/$imageName
done

运行脚本和查看镜像

# 运行脚本
sh ./kubeadm.sh

# 查看镜像
docker images

8.kube init初始化master

(1)初始化master节点

# 本地有镜像
kubeadm init --kubernetes-version=1.14.0 --apiserver-advertise-address=192.168.56.101 --pod-network-cidr=10.244.0.0/16
【若要重新初始化集群状态：kubeadm reset，然后再进行上述操作】

(2)根据日志提示执行

mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config

(3)查看pod验证一下

等待一会儿，同时可以发现像etc，controller，scheduler等组件都以pod的方式安装成功了

注意：coredns没有启动，需要安装网络插件

kubectl get pods -n kube-system

(4)健康检查

curl -k https://localhost:6443/healthz

9.部署calico网络插件

选择网络插件：Installing Addons | Kubernetes

calico网络插件：Kubernetes

calico，同样在master节点上操作

# 在k8s中安装calico
kubectl apply -f https://docs.projectcalico.org/v3.9/manifests/calico.yaml

# 确认一下calico是否安装成功
kubectl get pods --all-namespaces -w

10.kube join

(1)获取token

(1)列出当前的token

cat /etc/kubernetes/pki/ca.crt
kubeadm token list

(2)删除原有的token，因为有时间限制
kubeadm token delete sks6id.zmd12cv1c4h975da

(3)创建生命周期为无限的token

kubeadm token create --ttl=0 --print-join-command

(2)在woker01和worker02上执行命令

kubeadm join 192.168.56.101:6443 --token adhcfd.2gzq8ftcj7jmvoqf \
--discovery-token-ca-cert-hash sha256:e6ad47df52d5806ec4f643b90a991a8b8d2830e194501c52438cd97f3cfb4a08

(3)在master节点上检查集群信息

NAME STATUS ROLES AGE VERSION
m Ready master 21h v1.14.0
w1 Ready <none> 5h5m v1.14.0
w2 Ready <none> 5h5m v1.14.0

11.Pod初体验

(1)创建一个pod的yaml文件，名称为nginx_pod.yaml

apiVersion: v1
kind: Pod
metadata:
name: nginx-pod
labels:
app: nginx
spec:
containers:
- name: nginx-container
image: nginx
ports:
- containerPort: 80

(2)根据该nginx_pod.yaml文件创建pod

kubectl apply -f nginx_pod.yaml

(3)查看pod

01 kubectl get pods

NAME READY STATUS RESTARTS AGE
nginx-pod 1/1 Running 0 33s

02 kubectl get pods -o wide

NAME        READY   STATUS    RESTARTS   AGE   IP               NODE   NOMINATED NODE   READINESS GATES
nginx-pod   1/1     Running   0          49s   192.168.190.67   w1     <none>           <none>

03 kubectl describe pod nginx-pod

Name:             nginx-pod
Namespace:        default
Priority:         0
Service Account:  default
Node:             w1/192.168.56.102
Start Time:       Wed, 18 Jan 2023 07:40:12 +0000
Labels:           app=nginx
Annotations:      cni.projectcalico.org/podIP: 192.168.190.67/32
Status:           Running
IP:               192.168.190.67
IPs:              <none>
Containers:
  nginx-container:
    Container ID:   docker://6893ffb3b8787cfbee4291de44d909bda339efe098c83234fa59be6606bdc8f5
    Image:          nginx
    Image ID:       docker-pullable://nginx@sha256:0d17b565c37bcbd895e9d92315a05c1c3c9a29f762b011a10c54a66cd53c9b31
    Port:           80/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Wed, 18 Jan 2023 07:40:29 +0000
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-mw8h7 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  default-token-mw8h7:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-mw8h7
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason     Age   From               Message
  ----    ------     ----  ----               -------
  Normal  Scheduled  72s   default-scheduler  Successfully assigned default/nginx-pod to w1
  Normal  Pulling    71s   kubelet            Pulling image "nginx"
  Normal  Pulled     55s   kubelet            Successfully pulled image "nginx"
  Normal  Created    55s   kubelet            Created container nginx-container
  Normal  Started    55s   kubelet            Started container nginx-container

04 可以发现该pod运行在w1节点上

于是来到w1节点，docker ps一下

CONTAINER ID        IMAGE                  COMMAND                  CREATED             STATUS              PORTS               NAMES
6893ffb3b878        nginx                  "/docker-entrypoint.…"   2 minutes ago       Up 2 minutes

(4)访问nginx容器