centos8 + kubernetes 1.24 master/node 节点

已于 2023-02-07 10:03:59 修改
阅读量638 收藏
点赞数
分类专栏： kubernetes 文章标签： kubernetes 运维 docker
于 2023-02-06 17:14:11 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/signmem/article/details/128904117
版权

目标

使用 centos8 安装 kubernetes 1.24 版本
注意， kubernetes 1.24 已经不再支持 dockerd

软件版本

名称 版本 作用
containerd.io 1.6.15-3.1 容器
kubectl.x86_64 1.24.8-0 k8s node 服务
kubelet.x86_64 1.24.8-0 kubelet （k8s） 用户交还工具
kubeadm.x86_64 1.24.8-0 集群初始化工具
kubernetes-cni.x86_64 1.1.1-0 cni 接口

所需镜像

所有镜像都需要存放在 k8s.io namespace 中

名称 版本 作用
k8s.gcr.io/coredns/coredns v1.8.6 dns 解析
k8s.gcr.io/etcd 3.5.5-0 etcd 数据存储中心
k8s.gcr.io/kube-apiserver v1.24.8 api server api 接口
k8s.gcr.io/kube-controller-manager v1.24.8 controller manager 控制节点
k8s.gcr.io/kube-proxy v1.24.8 kube-proxy 网络 proxy
k8s.gcr.io/kube-scheduler v1.24.8 kube-scheduler 调度器
k8s.gcr.io/pause 3.7 镜像启动所需软件
registry.k8s.io/pause 3.6 镜像启动所需软件

安装过程

系统包

yum -y install yum-utils device-mapper-persistent-data lvm2 libtool-ltdl libcgroup langpacks-en glibc-all-langpacks tc

contraind

yum install -y containerd.io.x86_64

contrainer 模块

echo -e "overlay\nbr_netfilter" > /etc/modules-load.d/containerd.conf
modprobe overlay
modprobe br_netfilter

修改 contrainer 配置

mkdir -p /etc/containerd
containerd config default | tee /etc/containerd/config.toml
sed -i 's/SystemdCgroup = false/SystemdCgroup = true/g' /etc/containerd/config.toml

如果需要在 contrainerd 中使用到 proxy

vim /usr/lib/systemd/system/containerd.service

[Service]
Environment="HTTP_PROXY=http://proxy_ip:port"
Environment="HTTPS_PROXY=http://proxy_ip:port"
Environment="NO_PROXY=.svr,127.0.0.1,节点1，节点2"

添加内核模块

echo -e  "net.bridge.bridge-nf-call-iptables = 1\nnet.ipv4.ip_forward = 1\nnet.bridge.bridge-nf-call-ip6tables = 1" > /etc/sysctl.d/99-kubernetes-cri.conf
sysctl --system

selinux 关闭

setenforce 0
sed -i 's/^SELINUX=enforcing$/SELINUX=permissive/' /etc/selinux/config

安装 kubelet

yum install -y kubelet kubeadm kubectl

镜像管理工具

https://github.com/kubernetes-sigs/cri-tools/releases/tag/v1.26.0

配置

cat /etc/crictl.yaml
runtime-endpoint: unix:///var/run/containerd/containerd.sock  <- 使用 contrainred 作为 cri 
image-endpoint: unix:///var/run/containerd/containerd.sock    <- 使用 contrainerd 进行惊险管理
timeout: 2
debug: false
pull-image-on-create: false
disable-pull-on-run: false

master 配置

swapoff

sed -i /swap/d  /etc/fstab
swapoff -a

检查需要的镜像版本

# kubeadm config images list
I0206 17:09:57.566434   40157 version.go:255] remote version is much newer: v1.26.1; falling back to: stable-1.24
k8s.gcr.io/kube-apiserver:v1.24.10
k8s.gcr.io/kube-controller-manager:v1.24.10
k8s.gcr.io/kube-scheduler:v1.24.10
k8s.gcr.io/kube-proxy:v1.24.10
k8s.gcr.io/pause:3.7
k8s.gcr.io/etcd:3.5.5-0
k8s.gcr.io/coredns/coredns:v1.8.6

安装详细日志过程

# kubeadm init  --pod-network-cidr=10.244.0.0/16  --v=9
I0207 08:21:56.379975   46264 initconfiguration.go:117] detected and using CRI socket: unix:///var/run/containerd/containerd.sock
I0207 08:21:56.380241   46264 interface.go:432] Looking for default routes with IPv4 addresses
I0207 08:21:56.380274   46264 interface.go:437] Default route transits interface "bond0.20"
I0207 08:21:56.380733   46264 interface.go:209] Interface bond0.20 is up
I0207 08:21:56.380793   46264 interface.go:257] Interface "bond0.20" has 2 addresses :[10.189.20.64/24 fe80::ee38:8fff:fe79:26fe/64].
I0207 08:21:56.380829   46264 interface.go:224] Checking addr  10.189.20.64/24.
I0207 08:21:56.380843   46264 interface.go:231] IP found 10.189.20.64
I0207 08:21:56.380854   46264 interface.go:263] Found valid IPv4 address 10.189.20.64 for interface "bond0.20".
I0207 08:21:56.380865   46264 interface.go:443] Found active IP 10.189.20.64
I0207 08:21:56.380900   46264 kubelet.go:218] the value of KubeletConfiguration.cgroupDriver is empty; setting it to "systemd"
I0207 08:21:56.391103   46264 version.go:186] fetching Kubernetes version from URL: https://dl.k8s.io/release/stable-1.txt
W0207 08:21:56.624125   46264 version.go:103] could not fetch a Kubernetes version from the internet: unable to get URL "https://dl.k8s.io/release/stable-1.txt": Get "https://dl.k8s.io/release/stable-1.txt": x509: certificate signed by unknown authority
W0207 08:21:56.624154   46264 version.go:104] falling back to the local client version: v1.24.8
[init] Using Kubernetes version: v1.24.8
[preflight] Running pre-flight checks
I0207 08:21:56.624441   46264 checks.go:570] validating Kubernetes and kubeadm version
I0207 08:21:56.624468   46264 checks.go:170] validating if the firewall is enabled and active
I0207 08:21:56.645248   46264 checks.go:205] validating availability of port 6443
I0207 08:21:56.645424   46264 checks.go:205] validating availability of port 10259
I0207 08:21:56.645472   46264 checks.go:205] validating availability of port 10257
I0207 08:21:56.645511   46264 checks.go:282] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml
I0207 08:21:56.645539   46264 checks.go:282] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml
I0207 08:21:56.645555   46264 checks.go:282] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml
I0207 08:21:56.645569   46264 checks.go:282] validating the existence of file /etc/kubernetes/manifests/etcd.yaml
I0207 08:21:56.645583   46264 checks.go:432] validating if the connectivity type is via proxy or direct
I0207 08:21:56.645605   46264 checks.go:471] validating http connectivity to first IP address in the CIDR
I0207 08:21:56.645627   46264 checks.go:471] validating http connectivity to first IP address in the CIDR
I0207 08:21:56.645654   46264 checks.go:106] validating the container runtime
I0207 08:21:56.673959   46264 checks.go:331] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
I0207 08:21:56.674021   46264 checks.go:331] validating the contents of file /proc/sys/net/ipv4/ip_forward
I0207 08:21:56.674052   46264 checks.go:646] validating whether swap is enabled or not
I0207 08:21:56.674088   46264 checks.go:372] validating the presence of executable crictl
I0207 08:21:56.674113   46264 checks.go:372] validating the presence of executable conntrack
I0207 08:21:56.674130   46264 checks.go:372] validating the presence of executable ip
I0207 08:21:56.674146   46264 checks.go:372] validating the presence of executable iptables
I0207 08:21:56.674163   46264 checks.go:372] validating the presence of executable mount
I0207 08:21:56.674180   46264 checks.go:372] validating the presence of executable nsenter
I0207 08:21:56.674198   46264 checks.go:372] validating the presence of executable ebtables
I0207 08:21:56.674214   46264 checks.go:372] validating the presence of executable ethtool
I0207 08:21:56.674230   46264 checks.go:372] validating the presence of executable socat
I0207 08:21:56.674247   46264 checks.go:372] validating the presence of executable tc
I0207 08:21:56.674274   46264 checks.go:372] validating the presence of executable touch
I0207 08:21:56.674299   46264 checks.go:518] running all checks
I0207 08:21:56.681808   46264 checks.go:403] checking whether the given node name is valid and reachable using net.LookupHost
I0207 08:21:56.681838   46264 checks.go:612] validating kubelet version
I0207 08:21:56.737501   46264 checks.go:132] validating if the "kubelet" service is enabled and active
I0207 08:21:56.754844   46264 checks.go:205] validating availability of port 10250
I0207 08:21:56.754937   46264 checks.go:205] validating availability of port 2379
I0207 08:21:56.754981   46264 checks.go:205] validating availability of port 2380
I0207 08:21:56.755023   46264 checks.go:245] validating the existence and emptiness of directory /var/lib/etcd
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0207 08:21:56.755130   46264 checks.go:834] using image pull policy: IfNotPresent
I0207 08:21:56.782170   46264 checks.go:843] image exists: k8s.gcr.io/kube-apiserver:v1.24.8
I0207 08:21:56.808358   46264 checks.go:843] image exists: k8s.gcr.io/kube-controller-manager:v1.24.8
I0207 08:21:56.834233   46264 checks.go:843] image exists: k8s.gcr.io/kube-scheduler:v1.24.8
I0207 08:21:56.859979   46264 checks.go:843] image exists: k8s.gcr.io/kube-proxy:v1.24.8
I0207 08:21:56.885745   46264 checks.go:843] image exists: k8s.gcr.io/pause:3.7
I0207 08:21:56.911946   46264 checks.go:843] image exists: k8s.gcr.io/etcd:3.5.5-0
I0207 08:21:56.937651   46264 checks.go:843] image exists: k8s.gcr.io/coredns/coredns:v1.8.6
[certs] Using certificateDir folder "/etc/kubernetes/pki"
I0207 08:21:56.937724   46264 certs.go:112] creating a new certificate authority for ca
[certs] Generating "ca" certificate and key
I0207 08:21:57.071752   46264 certs.go:522] validating certificate period for ca certificate
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local ns-yun-020064.vclound.com] and IPs [10.96.0.1 10.189.20.64]
[certs] Generating "apiserver-kubelet-client" certificate and key
I0207 08:21:57.659884   46264 certs.go:112] creating a new certificate authority for front-proxy-ca
[certs] Generating "front-proxy-ca" certificate and key
I0207 08:21:57.794444   46264 certs.go:522] validating certificate period for front-proxy-ca certificate
[certs] Generating "front-proxy-client" certificate and key
I0207 08:21:57.965192   46264 certs.go:112] creating a new certificate authority for etcd-ca
[certs] Generating "etcd/ca" certificate and key
I0207 08:21:58.086396   46264 certs.go:522] validating certificate period for etcd/ca certificate
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost ns-yun-020064.vclound.com] and IPs [10.189.20.64 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost ns-yun-020064.vclound.com] and IPs [10.189.20.64 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
I0207 08:21:59.067506   46264 certs.go:78] creating new public/private key files for signing service account users
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0207 08:21:59.328104   46264 kubeconfig.go:103] creating kubeconfig file for admin.conf
[kubeconfig] Writing "admin.conf" kubeconfig file
I0207 08:21:59.455912   46264 kubeconfig.go:103] creating kubeconfig file for kubelet.conf
[kubeconfig] Writing "kubelet.conf" kubeconfig file
I0207 08:21:59.992365   46264 kubeconfig.go:103] creating kubeconfig file for controller-manager.conf
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0207 08:22:00.424942   46264 kubeconfig.go:103] creating kubeconfig file for scheduler.conf
[kubeconfig] Writing "scheduler.conf" kubeconfig file
I0207 08:22:00.646836   46264 kubelet.go:65] Stopping the kubelet
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
I0207 08:22:00.859398   46264 manifests.go:99] [control-plane] getting StaticPodSpecs
I0207 08:22:00.859759   46264 certs.go:522] validating certificate period for CA certificate
I0207 08:22:00.859872   46264 manifests.go:125] [control-plane] adding volume "ca-certs" for component "kube-apiserver"
I0207 08:22:00.859889   46264 manifests.go:125] [control-plane] adding volume "etc-pki" for component "kube-apiserver"
I0207 08:22:00.859903   46264 manifests.go:125] [control-plane] adding volume "k8s-certs" for component "kube-apiserver"
I0207 08:22:00.863969   46264 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
I0207 08:22:00.863995   46264 manifests.go:99] [control-plane] getting StaticPodSpecs
I0207 08:22:00.864249   46264 manifests.go:125] [control-plane] adding volume "ca-certs" for component "kube-controller-manager"
I0207 08:22:00.864275   46264 manifests.go:125] [control-plane] adding volume "etc-pki" for component "kube-controller-manager"
I0207 08:22:00.864286   46264 manifests.go:125] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager"
I0207 08:22:00.864295   46264 manifests.go:125] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager"
I0207 08:22:00.864305   46264 manifests.go:125] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager"
I0207 08:22:00.865129   46264 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
[control-plane] Creating static Pod manifest for "kube-scheduler"
I0207 08:22:00.865149   46264 manifests.go:99] [control-plane] getting StaticPodSpecs
I0207 08:22:00.865393   46264 manifests.go:125] [control-plane] adding volume "kubeconfig" for component "kube-scheduler"
I0207 08:22:00.865952   46264 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0207 08:22:00.866794   46264 local.go:65] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml"
I0207 08:22:00.866811   46264 waitcontrolplane.go:83] [wait-control-plane] Waiting for the API server to be healthy
I0207 08:22:00.867582   46264 loader.go:372] Config loaded from file:  /etc/kubernetes/admin.conf
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0207 08:22:00.868334   46264 round_trippers.go:466] curl -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/healthz?timeout=10s'
I0207 08:22:00.868540   46264 round_trippers.go:508] HTTP Trace: Dial to tcp:10.189.20.64:6443 failed: dial tcp 10.189.20.64:6443: connect: connection refused
I0207 08:22:00.868568   46264 round_trippers.go:553] GET https://10.189.20.64:6443/healthz?timeout=10s  in 0 milliseconds
I0207 08:22:00.868582   46264 round_trippers.go:570] HTTP Statistics: DNSLookup 0 ms Dial 0 ms TLSHandshake 0 ms Duration 0 ms
I0207 08:22:00.868594   46264 round_trippers.go:577] Response Headers:
I0207 08:22:01.369456   46264 round_trippers.go:466] curl -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/healthz?timeout=10s'
I0207 08:22:01.369753   46264 round_trippers.go:508] HTTP Trace: Dial to tcp:10.189.20.64:6443 failed: dial tcp 10.189.20.64:6443: connect: connection refused
I0207 08:22:01.369794   46264 round_trippers.go:553] GET https://10.189.20.64:6443/healthz?timeout=10s  in 0 milliseconds
I0207 08:22:01.369813   46264 round_trippers.go:570] HTTP Statistics: DNSLookup 0 ms Dial 0 ms TLSHandshake 0 ms Duration 0 ms
I0207 08:22:01.369834   46264 round_trippers.go:577] Response Headers:
I0207 08:22:01.869586   46264 round_trippers.go:466] curl -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/healthz?timeout=10s'
I0207 08:22:01.869932   46264 round_trippers.go:508] HTTP Trace: Dial to tcp:10.189.20.64:6443 failed: dial tcp 10.189.20.64:6443: connect: connection refused
I0207 08:22:01.869970   46264 round_trippers.go:553] GET https://10.189.20.64:6443/healthz?timeout=10s  in 0 milliseconds
I0207 08:22:01.869994   46264 round_trippers.go:570] HTTP Statistics: DNSLookup 0 ms Dial 0 ms TLSHandshake 0 ms Duration 0 ms
I0207 08:22:01.870010   46264 round_trippers.go:577] Response Headers:
I0207 08:22:02.369678   46264 round_trippers.go:466] curl -v -XGET  -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" -H "Accept: application/json, */*" 'https://10.189.20.64:6443/healthz?timeout=10s'
I0207 08:22:02.370100   46264 round_trippers.go:508] HTTP Trace: Dial to tcp:10.189.20.64:6443 failed: dial tcp 10.189.20.64:6443: connect: connection refused
I0207 08:22:02.370142   46264 round_trippers.go:553] GET https://10.189.20.64:6443/healthz?timeout=10s  in 0 milliseconds
I0207 08:22:02.370168   46264 round_trippers.go:570] HTTP Statistics: DNSLookup 0 ms Dial 0 ms TLSHandshake 0 ms Duration 0 ms
I0207 08:22:02.370188   46264 round_trippers.go:577] Response Headers:
I0207 08:22:02.869837   46264 round_trippers.go:466] curl -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/healthz?timeout=10s'
I0207 08:22:02.870127   46264 round_trippers.go:510] HTTP Trace: Dial to tcp:10.189.20.64:6443 succeed
I0207 08:22:06.099994   46264 round_trippers.go:553] GET https://10.189.20.64:6443/healthz?timeout=10s 500 Internal Server Error in 3230 milliseconds
I0207 08:22:06.100044   46264 round_trippers.go:570] HTTP Statistics: DNSLookup 0 ms Dial 0 ms TLSHandshake 3225 ms ServerProcessing 3 ms Duration 3230 ms
I0207 08:22:06.100062   46264 round_trippers.go:577] Response Headers:
I0207 08:22:06.100080   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid:
I0207 08:22:06.100096   46264 round_trippers.go:580]     Content-Length: 1263
I0207 08:22:06.100112   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:06 GMT
I0207 08:22:06.100127   46264 round_trippers.go:580]     Audit-Id: 70822272-9f2a-4c44-97c9-6b816800ee08
I0207 08:22:06.100143   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:06.100159   46264 round_trippers.go:580]     Content-Type: text/plain; charset=utf-8
I0207 08:22:06.100174   46264 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0207 08:22:06.100189   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid:
I0207 08:22:06.100255   46264 request.go:1154] Response Body: [+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/bootstrap-controller failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[-]autoregister-completion failed: reason withheld
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0207 08:22:06.368953   46264 round_trippers.go:466] curl -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/healthz?timeout=10s'
I0207 08:22:06.370374   46264 round_trippers.go:553] GET https://10.189.20.64:6443/healthz?timeout=10s 500 Internal Server Error in 1 milliseconds
I0207 08:22:06.370396   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 1 ms
I0207 08:22:06.370414   46264 round_trippers.go:577] Response Headers:
I0207 08:22:06.370427   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:06.370440   46264 round_trippers.go:580]     Content-Type: text/plain; charset=utf-8
I0207 08:22:06.370450   46264 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0207 08:22:06.370461   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7bb-e70e6593b237
I0207 08:22:06.370471   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d78a58a3-d939-453f-9c68-45c1e01ca56a
I0207 08:22:06.370483   46264 round_trippers.go:580]     Content-Length: 1137
I0207 08:22:06.370493   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:06 GMT
I0207 08:22:06.370504   46264 round_trippers.go:580]     Audit-Id: c360ea9a-d67c-4017-8327-f1951446880b
I0207 08:22:06.370542   46264 request.go:1154] Response Body: [+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0207 08:22:06.869063   46264 round_trippers.go:466] curl -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/healthz?timeout=10s'
I0207 08:22:06.870317   46264 round_trippers.go:553] GET https://10.189.20.64:6443/healthz?timeout=10s 500 Internal Server Error in 1 milliseconds
I0207 08:22:06.870339   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 1 ms
I0207 08:22:06.870352   46264 round_trippers.go:577] Response Headers:
I0207 08:22:06.870364   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7bb-e70e6593b237
I0207 08:22:06.870376   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d78a58a3-d939-453f-9c68-45c1e01ca56a
I0207 08:22:06.870387   46264 round_trippers.go:580]     Content-Length: 1137
I0207 08:22:06.870397   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:06 GMT
I0207 08:22:06.870408   46264 round_trippers.go:580]     Audit-Id: 8b0409a8-1fd4-4247-ad17-a8ee0b50828c
I0207 08:22:06.870419   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:06.870429   46264 round_trippers.go:580]     Content-Type: text/plain; charset=utf-8
I0207 08:22:06.870440   46264 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0207 08:22:06.870468   46264 request.go:1154] Response Body: [+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0207 08:22:07.369063   46264 round_trippers.go:466] curl -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/healthz?timeout=10s'
I0207 08:22:07.370350   46264 round_trippers.go:553] GET https://10.189.20.64:6443/healthz?timeout=10s 500 Internal Server Error in 1 milliseconds
I0207 08:22:07.370377   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 1 ms
I0207 08:22:07.370389   46264 round_trippers.go:577] Response Headers:
I0207 08:22:07.370402   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:07.370413   46264 round_trippers.go:580]     Content-Type: text/plain; charset=utf-8
I0207 08:22:07.370423   46264 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0207 08:22:07.370434   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7bb-e70e6593b237
I0207 08:22:07.370445   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d78a58a3-d939-453f-9c68-45c1e01ca56a
I0207 08:22:07.370456   46264 round_trippers.go:580]     Content-Length: 1116
I0207 08:22:07.370466   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:07 GMT
I0207 08:22:07.370477   46264 round_trippers.go:580]     Audit-Id: f2718e1e-acd1-4896-8b48-cf23392703e1
I0207 08:22:07.370514   46264 request.go:1154] Response Body: [+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0207 08:22:07.869107   46264 round_trippers.go:466] curl -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/healthz?timeout=10s'
I0207 08:22:07.870718   46264 round_trippers.go:553] GET https://10.189.20.64:6443/healthz?timeout=10s 200 OK in 1 milliseconds
I0207 08:22:07.870740   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 1 ms
I0207 08:22:07.870752   46264 round_trippers.go:577] Response Headers:
I0207 08:22:07.870765   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:07.870776   46264 round_trippers.go:580]     Content-Type: text/plain; charset=utf-8
I0207 08:22:07.870787   46264 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0207 08:22:07.870797   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7bb-e70e6593b237
I0207 08:22:07.870808   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d78a58a3-d939-453f-9c68-45c1e01ca56a
I0207 08:22:07.870818   46264 round_trippers.go:580]     Content-Length: 2
I0207 08:22:07.870829   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:07 GMT
I0207 08:22:07.870840   46264 round_trippers.go:580]     Audit-Id: bc001798-04ca-4a38-8a77-8e36c065f40d
I0207 08:22:07.870885   46264 request.go:1154] Response Body: ok
[apiclient] All control plane components are healthy after 7.002728 seconds
I0207 08:22:07.870954   46264 uploadconfig.go:110] [upload-config] Uploading the kubeadm ClusterConfiguration to a ConfigMap
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0207 08:22:07.871630   46264 request.go:1154] Request Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kubeadm-config","namespace":"kube-system","creationTimestamp":null},"data":{"ClusterConfiguration":"apiServer:\n  extraArgs:\n    authorization-mode: Node,RBAC\n  timeoutForControlPlane: 4m0s\napiVersion: kubeadm.k8s.io/v1beta3\ncertificatesDir: /etc/kubernetes/pki\nclusterName: kubernetes\ncontrollerManager: {}\ndns: {}\netcd:\n  local:\n    dataDir: /var/lib/etcd\nimageRepository: k8s.gcr.io\nkind: ClusterConfiguration\nkubernetesVersion: v1.24.8\nnetworking:\n  dnsDomain: cluster.local\n  podSubnet: 10.244.0.0/16\n  serviceSubnet: 10.96.0.0/12\nscheduler: {}\n"}}
I0207 08:22:07.871703   46264 round_trippers.go:466] curl -v -XPOST  -H "Content-Type: application/json" -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s'
I0207 08:22:07.873785   46264 round_trippers.go:553] POST https://10.189.20.64:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 2 milliseconds
I0207 08:22:07.873807   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 2 ms
I0207 08:22:07.873823   46264 round_trippers.go:577] Response Headers:
I0207 08:22:07.873835   46264 round_trippers.go:580]     Audit-Id: fc5476cb-f980-4faa-bb09-28fd8c5298cd
I0207 08:22:07.873846   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:07.873857   46264 round_trippers.go:580]     Content-Type: application/json
I0207 08:22:07.873867   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7bb-e70e6593b237
I0207 08:22:07.873878   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d78a58a3-d939-453f-9c68-45c1e01ca56a
I0207 08:22:07.873889   46264 round_trippers.go:580]     Content-Length: 910
I0207 08:22:07.873899   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:07 GMT
I0207 08:22:07.873928   46264 request.go:1154] Response Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kubeadm-config","namespace":"kube-system","uid":"ea94739b-1e8c-4a2f-ad2b-0b9c1769816d","resourceVersion":"204","creationTimestamp":"2023-02-07T00:22:07Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2023-02-07T00:22:07Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:ClusterConfiguration":{}}}}]},"data":{"ClusterConfiguration":"apiServer:\n  extraArgs:\n    authorization-mode: Node,RBAC\n  timeoutForControlPlane: 4m0s\napiVersion: kubeadm.k8s.io/v1beta3\ncertificatesDir: /etc/kubernetes/pki\nclusterName: kubernetes\ncontrollerManager: {}\ndns: {}\netcd:\n  local:\n    dataDir: /var/lib/etcd\nimageRepository: k8s.gcr.io\nkind: ClusterConfiguration\nkubernetesVersion: v1.24.8\nnetworking:\n  dnsDomain: cluster.local\n  podSubnet: 10.244.0.0/16\n  serviceSubnet: 10.96.0.0/12\nscheduler: {}\n"}}
I0207 08:22:07.874313   46264 request.go:1154] Request Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:nodes-kubeadm-config","namespace":"kube-system","creationTimestamp":null},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["kubeadm-config"]}]}
I0207 08:22:07.874385   46264 round_trippers.go:466] curl -v -XPOST  -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" -H "Accept: application/json, */*" -H "Content-Type: application/json" 'https://10.189.20.64:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s'
I0207 08:22:07.876285   46264 round_trippers.go:553] POST https://10.189.20.64:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 1 milliseconds
I0207 08:22:07.876305   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 1 ms
I0207 08:22:07.876316   46264 round_trippers.go:577] Response Headers:
I0207 08:22:07.876327   46264 round_trippers.go:580]     Content-Type: application/json
I0207 08:22:07.876338   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7bb-e70e6593b237
I0207 08:22:07.876349   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d78a58a3-d939-453f-9c68-45c1e01ca56a
I0207 08:22:07.876360   46264 round_trippers.go:580]     Content-Length: 541
I0207 08:22:07.876370   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:07 GMT
I0207 08:22:07.876381   46264 round_trippers.go:580]     Audit-Id: 6756eb4f-54d6-4045-8d90-a0611df7d9ad
I0207 08:22:07.876391   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:07.876413   46264 request.go:1154] Response Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:nodes-kubeadm-config","namespace":"kube-system","uid":"0956bc31-f01d-43b1-af7c-0d94e93a6da9","resourceVersion":"205","creationTimestamp":"2023-02-07T00:22:07Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2023-02-07T00:22:07Z","fieldsType":"FieldsV1","fieldsV1":{"f:rules":{}}}]},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["kubeadm-config"]}]}
I0207 08:22:07.876649   46264 request.go:1154] Request Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:nodes-kubeadm-config","namespace":"kube-system","creationTimestamp":null},"subjects":[{"kind":"Group","name":"system:bootstrappers:kubeadm:default-node-token"},{"kind":"Group","name":"system:nodes"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:nodes-kubeadm-config"}}
I0207 08:22:07.876715   46264 round_trippers.go:466] curl -v -XPOST  -H "Accept: application/json, */*" -H "Content-Type: application/json" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s'
I0207 08:22:07.878732   46264 round_trippers.go:553] POST https://10.189.20.64:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 1 milliseconds
I0207 08:22:07.878753   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 1 ms
I0207 08:22:07.878765   46264 round_trippers.go:577] Response Headers:
I0207 08:22:07.878777   46264 round_trippers.go:580]     Audit-Id: 6eeda9a6-693d-45a1-9095-1295d6a2794b
I0207 08:22:07.878788   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:07.878798   46264 round_trippers.go:580]     Content-Type: application/json
I0207 08:22:07.878810   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7bb-e70e6593b237
I0207 08:22:07.878821   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d78a58a3-d939-453f-9c68-45c1e01ca56a
I0207 08:22:07.878832   46264 round_trippers.go:580]     Content-Length: 766
I0207 08:22:07.878843   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:07 GMT
I0207 08:22:07.878869   46264 request.go:1154] Response Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:nodes-kubeadm-config","namespace":"kube-system","uid":"c4cb7f9b-0235-405b-b521-d318a4012638","resourceVersion":"206","creationTimestamp":"2023-02-07T00:22:07Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2023-02-07T00:22:07Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:bootstrappers:kubeadm:default-node-token"},{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:nodes"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:nodes-kubeadm-config"}}
I0207 08:22:07.879035   46264 uploadconfig.go:124] [upload-config] Uploading the kubelet component config to a ConfigMap
[kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0207 08:22:07.879585   46264 request.go:1154] Request Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kubelet-config","namespace":"kube-system","creationTimestamp":null,"annotations":{"kubeadm.kubernetes.io/component-config.hash":"sha256:53821686a8ddaca8403df63803a726d2ab31b145c7da69ed7b78c45d2e223a18"}},"data":{"kubelet":"apiVersion: kubelet.config.k8s.io/v1beta1\nauthentication:\n  anonymous:\n    enabled: false\n  webhook:\n    cacheTTL: 0s\n    enabled: true\n  x509:\n    clientCAFile: /etc/kubernetes/pki/ca.crt\nauthorization:\n  mode: Webhook\n  webhook:\n    cacheAuthorizedTTL: 0s\n    cacheUnauthorizedTTL: 0s\ncgroupDriver: systemd\nclusterDNS:\n- 10.96.0.10\nclusterDomain: cluster.local\ncpuManagerReconcilePeriod: 0s\nevictionPressureTransitionPeriod: 0s\nfileCheckFrequency: 0s\nhealthzBindAddress: 127.0.0.1\nhealthzPort: 10248\nhttpCheckFrequency: 0s\nimageMinimumGCAge: 0s\nkind: KubeletConfiguration\nlogging:\n  flushFrequency: 0\n  options:\n    json:\n      infoBufferSize: \"0\"\n  verbosity: 0\nmemorySwap: {}\nnodeStatusReportFrequency: 0s\nnodeStatusUpdateFrequency: 0s\nrotateCertificates: true\nruntimeRequestTimeout: 0s\nshutdownGracePeriod: 0s\nshutdownGracePeriodCriticalPods: 0s\nstaticPodPath: /etc/kubernetes/manifests\nstreamingConnectionIdleTimeout: 0s\nsyncFrequency: 0s\nvolumeStatsAggPeriod: 0s\n"}}
I0207 08:22:07.879657   46264 round_trippers.go:466] curl -v -XPOST  -H "Accept: application/json, */*" -H "Content-Type: application/json" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s'
I0207 08:22:07.881675   46264 round_trippers.go:553] POST https://10.189.20.64:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 1 milliseconds
I0207 08:22:07.881699   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 1 ms
I0207 08:22:07.881711   46264 round_trippers.go:577] Response Headers:
I0207 08:22:07.881722   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7bb-e70e6593b237
I0207 08:22:07.881734   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d78a58a3-d939-453f-9c68-45c1e01ca56a
I0207 08:22:07.881744   46264 round_trippers.go:580]     Content-Length: 1657
I0207 08:22:07.881755   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:07 GMT
I0207 08:22:07.881765   46264 round_trippers.go:580]     Audit-Id: 96f8fa2c-8899-4cb8-8c27-2719e5f3cc0b
I0207 08:22:07.881776   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:07.881786   46264 round_trippers.go:580]     Content-Type: application/json
I0207 08:22:07.881814   46264 request.go:1154] Response Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kubelet-config","namespace":"kube-system","uid":"c6277399-bbe5-4b2d-ad78-94a120465f7e","resourceVersion":"207","creationTimestamp":"2023-02-07T00:22:07Z","annotations":{"kubeadm.kubernetes.io/component-config.hash":"sha256:53821686a8ddaca8403df63803a726d2ab31b145c7da69ed7b78c45d2e223a18"},"managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2023-02-07T00:22:07Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:kubelet":{}},"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/component-config.hash":{}}}}}]},"data":{"kubelet":"apiVersion: kubelet.config.k8s.io/v1beta1\nauthentication:\n  anonymous:\n    enabled: false\n  webhook:\n    cacheTTL: 0s\n    enabled: true\n  x509:\n    clientCAFile: /etc/kubernetes/pki/ca.crt\nauthorization:\n  mode: Webhook\n  webhook:\n    cacheAuthorizedTTL: 0s\n    cacheUnauthorizedTTL: 0s\ncgroupDriver: systemd\nclusterDNS:\n- 10.96.0.10\nclusterDomain: cluster.local\ncpuManagerReconcilePeriod: 0s\nevictionPressureTransitionPeriod: 0s\nfileCheckFrequency: 0s\nhealthzBindAddress: 127.0.0.1\nhealthzPort: 10248\nhttpCheckFrequency: 0s\nimageMinimumGCAge: 0s\nkind: KubeletConfiguration\nlogging:\n  flushFrequency: 0\n  options:\n    json:\n      infoBufferSize: \"0\"\n  verbosity: 0\nmemorySwap: {}\nnodeStatusReportFrequency: 0s\nnodeStatusUpdateFrequency: 0s\nrotateCertificates: true\nruntimeRequestTimeout: 0s\nshutdownGracePeriod: 0s\nshutdownGracePeriodCriticalPods: 0s\nstaticPodPath: /etc/kubernetes/manifests\nstreamingConnectionIdleTimeout: 0s\nsyncFrequency: 0s\nvolumeStatsAggPeriod: 0s\n"}}
I0207 08:22:07.881985   46264 request.go:1154] Request Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubelet-config","namespace":"kube-system","creationTimestamp":null},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["kubelet-config"]}]}
I0207 08:22:07.882061   46264 round_trippers.go:466] curl -v -XPOST  -H "Content-Type: application/json" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" -H "Accept: application/json, */*" 'https://10.189.20.64:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s'
I0207 08:22:07.883908   46264 round_trippers.go:553] POST https://10.189.20.64:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 1 milliseconds
I0207 08:22:07.883930   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 1 ms
I0207 08:22:07.883941   46264 round_trippers.go:577] Response Headers:
I0207 08:22:07.883953   46264 round_trippers.go:580]     Date: Tue, 07 Feb 2023 00:22:07 GMT
I0207 08:22:07.883964   46264 round_trippers.go:580]     Audit-Id: 29f655fb-97ca-41fa-9987-59bf5f73fc0b
I0207 08:22:07.883974   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:07.883985   46264 round_trippers.go:580]     Content-Type: application/json
I0207 08:22:07.883995   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7bb-e70e6593b237
I0207 08:22:07.884006   46264 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: d78a58a3-d939-453f-9c68-45c1e01ca56a
I0207 08:22:07.884017   46264 round_trippers.go:580]     Content-Length: 535
I0207 08:22:07.884038   46264 request.go:1154] Response Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubelet-config","namespace":"kube-system","uid":"eb145f80-3a93-4f2c-aa45-6824597f4757","resourceVersion":"208","creationTimestamp":"2023-02-07T00:22:07Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2023-02-07T00:22:07Z","fieldsType":"FieldsV1","fieldsV1":{"f:rules":{}}}]},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["kubelet-config"]}]}
I0207 08:22:07.884161   46264 request.go:1154] Request Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubelet-config","namespace":"kube-system","creationTimestamp":null},"subjects":[{"kind":"Group","name":"system:nodes"},{"kind":"Group","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:kubelet-config"}}
I0207 08:22:07.884227   46264 round_trippers.go:466] curl -v -XPOST  -H "Accept: application/json, */*" -H "Content-Type: application/json" -H "User-Agent: kubeadm/v1.24.8 (linux/amd64) kubernetes/fdc7750" 'https://10.189.20.64:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s'
I0207 08:22:07.886011   46264 round_trippers.go:553] POST https://10.189.20.64:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 1 milliseconds
I0207 08:22:07.886032   46264 round_trippers.go:570] HTTP Statistics: GetConnection 0 ms ServerProcessing 1 ms Duration 1 ms
I0207 08:22:07.886044   46264 round_trippers.go:577] Response Headers:
I0207 08:22:07.886056   46264 round_trippers.go:580]     Audit-Id: 81c58bd1-2cc8-4658-bc14-a3f4b1fa2ff2
I0207 08:22:07.886067   46264 round_trippers.go:580]     Cache-Control: no-cache, private
I0207 08:22:07.886077   46264 round_trippers.go:580]     Content-Type: application/json
I0207 08:22:07.886088   46264 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 4525dc3f-8622-4b86-b7b
最低0.47元/天 解锁文章
Terry_Tsang
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论
专栏目录
基于Centos7.x+Kubernetes-1.12.3+Da1.8.3的master，node节点全自动快速一键安装部署文件
10-10
Master节点负责整个集群的控制平面，包括调度、状态监控、API服务等，而Node节点则是运行Pods（Kubernetes的基本执行单元）的工作机器。本部署文件旨在实现Master和Node节点的全自动快速安装，大大减少了手动配置的...
centos 8 安装 kubernetes 1.20 版本 master
Terry Tsang
12-23 1281
目标 在 centos8 上安装 kubenetes-1.20 版本 名称 版本 备注 os centos8 docker docker-ce-19.03.14-3.el8.x86_64docker-ce-cli-19.03.14-3.el8.x86_64containerd.io-1.4.3-3.1 kubelet-1.20 暂时不建议使用 docker-20 版本 kublet cri-tools-1.13.0-0.x86_64kubelet-1.20.1-0.x86_64
【kubeadm初始化报错】kubelet cgroup driver: “systemd“ is different from docker cgroup driver: “cgroupfs“
拾级而上
06-29 2992
复现场景 环境 系统：Centos7 kubernetes：1.18.5 docker：19.03.9 复现步骤 1、通过 yum 或 rpm 安装 kubelet kubectl kubeadm，并 systemctl enable --now kubelet 2、安装 docker 并配置 (kubernetes官方推荐docker等使用systemd作为cgroupdriver...
K8S初始化报错
w849593893的博客
08-23 5450
初始化信息 kubeadm init \ --apiserver-advertise-address=192.168.40.128 \ --image-repository registry.aliyuncs.com/google_containers \ --kubernetes-version v1.22.1 \ --service-cidr=10.2.0.0/16 \ --pod-network-cidr=10.244.0.0/16 报错信息 error execution phase
kubelet启动失败
liangkaiping0525的博客
08-23 9123
原因之一：是kubelet cgroup驱动程序“ cgroupfs”与docker cgroup驱动程序不同 公司的k8s，新增了一个节点，但kubelet启动一直报错，无法启动，网上找了半天，发现是kubelet cgroup驱动程序“ cgroupfs”与docker cgroup驱动程序不同，所导致，原因不详。 cgroups 的全称是 Linux Control Groups，主要作用是限制、记录和隔离进程组（process groups）使用的物理资源（cpu、memory、IO 等）。
k8s使用kubeadm初始化成功后，重启docker出现如下错误的原因是什么：kubelet cgroup driver: “cgroupfs“ is different from docker c
sinat_37163044的博客
06-18 978
请注意，修改kubelet的配置可能需要重启kubelet服务，这可能会中断正在运行的容器和Pod，请谨慎操作，并确保在生产环境中使用适当的测试和备份策略。它使用文件和目录结构表示层次化的cgroup组织，并通过读写文件来配置和监控各个cgroup的资源使用情况。不同的cgroup驱动程序会使用不同的方式来设置和管理cgroup，从而影响容器对其资源的访问和限制。这个错误提示表明在Kubernetes (k8s)环境中，kubelet的cgroup驱动程序与Docker的cgroup驱动程序不匹配。
CentOS7下安装kubernetes实践
01-07
操作环境：CentOS7.4 kubernetes15.1 一、 更改主机配置 更改主机名，主节点改为master，工作节点改为worker vi /etc/hostname 更改hosts文件 vi /etc/hosts 127.0.0.1 localhost.localdomain master //工作节点上...
kubeadm+kubernetes1.23.5+centos7.9安装集群
03-29
kubernete1.23.5系列在网上还没出现，大多数都是1.15.0。建议新手和我一样选择新版本安装，别守旧没意思。
为CentOS / Fedora / Debian / Ubuntu安装LAMP（Linux + Apache + MySQL / MariaDB / Percona Server + PHP）-PHP开发
05-27
为CentOS / Debian / Ubuntu安装LAMP（Linux + Apache + MySQL / MariaDB / Percona Server + PHP）描述LAMP是一个功能强大的bash脚本，用于安装Apache + PHP + MySQL / MariaDB / Percona Server等。 您可以通过...
CentOS7+Kubeadm+K8S集群安装手册
最新发布
02-17
在Centos中利用kubeadm工具安装和部署一个原生的kubernetes集群
Kubeternetes部署时init的时候踩过的坑及解决方案
sinat_29217765的博客
09-15 3590
一、问题描述及相关提示： 在命令行输入# kubeadm init --pod-network-cidr=10.244.0.0/16 --ignore-preflight-errors=NumCPU 后，会提示镜像无法获取 [root@master ~]# kubeadm init --pod-network-cidr=10.244.0.0/16 --ignore-preflight-erro...
Kubeadm 安装中的各种坑
热门推荐
ccy19910925的博客
06-29 1万+
  一、 error: failed to run Kubelet: failed to create kubelet: misconfiguration: kubelet cgroup driver: "systemd" is different from docker cgroup driver: "cgroupfs" 解决： vi /etc/systemd/system/kubel...
kubeadm 部署Kubernetes1.24_cri-docker版本
飞翔沫沫情博客
06-06 2775
2022 年 5 月 3 日，Kubernetes 1.24 正式发布，在新版本中，我们看到 Kubernetes 作为容器编排的事实标准，正愈发变得成熟，有 12 项功能都更新到了稳定版本，同时引入了很多实用的功能，例如 StatefulSets 支持批量滚动更新，NetworkPolicy 新增 NetworkPolicyStatus 字段方便进行故障排查等Kubernetes 正式移除对 Dockershim 的支持，讨论很久的 “弃用 Dockershim” 也终于在这个版本画上了句号。想要清楚的了
Kubernetes安装部署Master1.14.2/及拆除/常用命令
jiangbenchu的博客
12-12 2335
1、修改本地/etc/hosts文件 # 将以下内容追加(>>)到 /etc/hosts文件 [root@k8s-master ~]# cat <<EOF >> /etc/hosts 172.26.48.4 k8s-master 172.26.48.5 k8s-node1 172.26.135.94 k8s-node2 EOF 2、CentOS...
从零开始在ubuntu上安装和使用k8s集群及报错解决
u010724811的博客
08-03 3762
安装docker 安装kubernetes 配置k8s集群 配置虚拟机网络 配置Master节点的k8s，并使用 kubeadm 拉取镜像 配置内部通信 flannel 网络(master和node都要配) 配置 node节点 部署ningx应用，测试集群 通过yaml部署应用 部署 Dashboard 报错解决 node节点一直NotReady，报错 Unable to update cni config: no networks found in /etc/cni/net
Kubernetes为何优先使用Systemd为Cgroup Driver
Free雅轩的博客
08-13 386
当某个 Linux 系统发行版使用 systemd[2] 作为其初始化系统时，初始化进程会生成并使用一个 root 控制组（cgroup），并充当 cgroup 管理器。本质上来说，cgroups 是内核附加在程序上的一系列钩子 (hook)，通过程序运行时对资源的调度触发相应的钩子以达到资源追踪和限制的目的。7 系统，都是使用 systemd 初始化系统的。也就意味着操作系统里面存在两种资源分配的视图，当操作系统上存在 CPU，内存等等资源不足的时候，操作系统上的进程会变得不稳定。Cgroup 是一个。.
kubeadm部署Kuberentes-v1.23.1的集群（Wmware环境）
hwj2004dhc的空间
12-20 520
1、基础环境及安装系统版本 操作系统：Centos8.5（kernel 4.18.0-384.e18-x86_64） 容器引擎：docker20.10.11 kubernetes：v1.23.1 注：kubernetes版本查看 最新版本号：https://storage.googleapis.com/kubernetes-release/release/stable.txt 版本发型说明：https://kubernetes.io/docs/setup/release/notes kubeadm..
CentOS 7 安装 kubernetes1.24.x 保姆教程
kaiyuanheshang的博客
09-09 1174
让所有集群保持相同的时间，防止因为时间误差导致互联互通失败。
openshift启动失败
日进一步
06-29 6647
问题描述： kube-apiserver自检没有通过，检查发现端口8443没有监听 [root@openshift openshift]# oc cluster up Getting a Docker client ... Checking if image openshift/origin-control-plane:v3.11 is available ... Checking type...
lvextend -l +100%FREE /dev/mapper/centos-root
09-06
您的第一个问题是关于使用 lvextend 命令来扩展逻辑卷的容量。将逻辑卷扩展到 100%FREE 的大小，设备名称为 /dev/mapper/centos-root。 回答您的问题，您可以使用以下命令来扩展逻辑卷的容量： ```shell lvextend -l 100%FREE /dev/mapper/centos-root ``` 这将使用所有可用的空闲空间来扩展逻辑卷 `/dev/mapper/centos-root` 的大小。请确保您具有足够的空闲空间来进行扩展操作。

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

Terry_Tsang

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值