该文详细记录了Karmada集群从v1.5.1版本升级至v1.6.0的过程，包括代码拉取、本地模拟环境搭建、应用部署、镜像构建与推送、组件升级以及升级后的问题排查。在升级过程中发现，仅修改./hack/local-up-karmada.sh文件的VERSION对主机侧镜像生效，而对kind容器内及已有业务的deployment无效，并且升级后karmada-apiserver出现超时错误。
一、构建1.5.1环境老环境
1、拉取1.5.1仓库代码
root@zishen:/usr/workspace/go/src/karmada-io# git clone https://github.com/karmada-io/karmada.git
Cloning into 'karmada'...
remote: Enumerating objects: 52928, done.
remote: Counting objects: 100% (8165/8165), done.
remote: Compressing objects: 100% (1171/1171), done.
remote: Total 52928 (delta 7163), reused 7363 (delta 6936), pack-reused 44763
Receiving objects: 100% (52928/52928), 36.44 MiB | 1.39 MiB/s, done.
Resolving deltas: 100% (32043/32043), done.
root@zishen:/usr/workspace/go/src/karmada-io# cd karmada/
root@zishen:/usr/workspace/go/src/karmada-io/karmada# git tag
v0.1.0
...
v1.5.1
root@zishen:/usr/workspace/go/src/karmada-io/karmada# git checkout v1.5.1
Note: checking out 'v1.5.1'.
...
root@zishen:/usr/workspace/go/src/karmada-io/karmada#
root@zishen:/usr/workspace/go/src/karmada-io/karmada# git status
HEAD detached at v1.5.1
nothing to commit, working tree clean
2、安装karmada模拟环境
1）、修改安装版本号
该步骤在v1.6.0前可不做，后续修复该VERSION不生效问题后，可按此操作。
oot@zishen:/usr/workspace/go/src/karmada-io/karmada# git status
HEAD detached at v1.5.1
nothing to commit, working tree clean
root@zishen:/usr/workspace/go/src/karmada-io/karmada# vim ./hack/local-up-karmada.sh
修改VERSION的内容为v1.5.1：
...
88 #step2. make images and get karmadactl
89 export VERSION="v1.5.1"
90 export REGISTRY="docker.io/karmada"
91 make images GOOS="linux" --directory="${REPO_ROOT}"
...
2）、清理环境
卸载之前的karmada：
bash ./hack/local-down-karmada.sh
删除之前的镜像
for i in `docker images|grep -E 'none|karmada' |awk '{print $3}'`;do docker rmi $i;done
3）、执行编译安装安装如下：
root@zishen:/usr/workspace/go/src/karmada-io/karmada# bash ./hack/local-up-karmada.sh
...
cluster.cluster.karmada.io/member3 condition met
------------------------------------------------------------------------------------------------------
█████ ████ █████████ ███████████ ██████ ██████ █████████ ██████████ █████████
░░███ ███░ ███░░░░░███ ░░███░░░░░███ ░░██████ ██████ ███░░░░░███ ░░███░░░░███ ███░░░░░███
░███ ███ ░███ ░███ ░███ ░███ ░███░█████░███ ░███ ░███ ░███ ░░███ ░███ ░███
░███████ ░███████████ ░██████████ ░███░░███ ░███ ░███████████ ░███ ░███ ░███████████
░███░░███ ░███░░░░░███ ░███░░░░░███ ░███ ░░░ ░███ ░███░░░░░███ ░███ ░███ ░███░░░░░███
░███ ░░███ ░███ ░███ ░███ ░███ ░███ ░███ ░███ ░███ ░███ ███ ░███ ░███
█████ ░░████ █████ █████ █████ █████ █████ █████ █████ █████ ██████████ █████ █████
░░░░░ ░░░░ ░░░░░ ░░░░░ ░░░░░ ░░░░░ ░░░░░ ░░░░░ ░░░░░ ░░░░░ ░░░░░░░░░░ ░░░░░ ░░░░░
------------------------------------------------------------------------------------------------------
Local Karmada is running.
To start using your karmada, run:
export KUBECONFIG=/root/.kube/karmada.config
Please use 'kubectl config use-context karmada-host/karmada-apiserver' to switch the host and control plane cluster.
To manage your member clusters, run:
export KUBECONFIG=/root/.kube/members.config
Please use 'kubectl config use-context member1/member2/member3' to switch to the different member cluster.
3）、查看使用镜像：
主机：
root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
karmada/karmada-operator v1.5.1 3b7cb440aaad 13 minutes ago 59.3MB
karmada/karmada-search v1.5.1 8fa225c1f206 13 minutes ago 102MB
karmada/karmada-interpreter-webhook-example v1.5.1 ba469aa91374 13 minutes ago 62.8MB
karmada/karmada-scheduler-estimator v1.5.1 5cbe32d605c9 14 minutes ago 70.8MB
karmada/karmada-agent v1.5.1 388db18e3708 14 minutes ago 78.2MB
karmada/karmada-webhook v1.5.1 4cb0053c5ab7 14 minutes ago 68.5MB
karmada/karmada-descheduler v1.5.1 6f07bf2a6be0 14 minutes ago 71.2MB
karmada/karmada-scheduler v1.5.1 67052b5deb1f 14 minutes ago 71.7MB
karmada/karmada-controller-manager v1.5.1 51c09880714d 15 minutes ago 83.5MB
karmada/karmada-aggregated-apiserver v1.5.1 b0cfba8d54bc 15 minutes ago 93.3MB
zishen1988/kube-apiserver-amd64 latest 6f6e73fa8162 6 weeks ago 121MB
kind容器内：
root@zishen:/home/btg/yaml# docker container ls
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
45516dd5679d kindest/node:v1.26.0 "/usr/local/bin/entr…" 8 hours ago Up 8 hours 127.0.0.1:40207->6443/tcp member3-control-plane
3e1e35ec0f2b kindest/node:v1.26.0 "/usr/local/bin/entr…" 8 hours ago Up 8 hours 127.0.0.1:33387->6443/tcp karmada-host-control-plane
b203b03b03a3 kindest/node:v1.26.0 "/usr/local/bin/entr…" 8 hours ago Up 8 hours 127.0.0.1:45343->6443/tcp member2-control-plane
ca7a21af6a5a kindest/node:v1.26.0 "/usr/local/bin/entr…" 8 hours ago Up 8 hours 127.0.0.1:44911->6443/tcp member1-control-plane
root@zishen:/home/btg/yaml# docker exec -i 3e1e35ec0f2b bash
crictl images
IMAGE TAG IMAGE ID SIZE
docker.io/karmada/karmada-aggregated-apiserver latest f02c482e5c9f5 40.6MB
docker.io/karmada/karmada-aggregated-apiserver v1.5.1 7ff2ea0294821 93.9MB
docker.io/karmada/karmada-controller-manager latest d651530f77284 41.3MB
docker.io/karmada/karmada-controller-manager v1.5.1 c08b381e4a122 84.1MB
docker.io/karmada/karmada-descheduler latest 6c5ada5682c5f 31.4MB
docker.io/karmada/karmada-descheduler v1.5.1 640f37b181de8 71.8MB
docker.io/karmada/karmada-scheduler-estimator latest f09827af787d0 31.2MB
docker.io/karmada/karmada-scheduler-estimator v1.5.1 9d33b6257009c 71.3MB
docker.io/karmada/karmada-scheduler latest bc90c17d68648 31.6MB
docker.io/karmada/karmada-scheduler v1.5.1 b78d2eab602f5 72.2MB
docker.io/karmada/karmada-search latest a1f60bff0fa21 43.9MB
docker.io/karmada/karmada-search v1.5.1 efd81d3bf544c 103MB
docker.io/karmada/karmada-webhook latest ffa65b8b4fbcd 31MB
docker.io/karmada/karmada-webhook v1.5.1 246d61ef6d25e 69MB
docker.io/kindest/kindnetd v20221004-44d545d1 d6e3e26021b60 25.8MB
docker.io/kindest/local-path-helper v20220607-9a4d8d2a d2f902e939cc3 2.86MB
docker.io/kindest/local-path-provisioner v0.0.22-kind.0 4c1e997385b8f 17.4MB
registry.k8s.io/coredns/coredns v1.9.3 5185b96f0becf 14.8MB
registry.k8s.io/etcd 3.5.3-0 aebe758cef4cd 102MB
registry.k8s.io/etcd 3.5.6-0 fce326961ae2d 103MB
registry.k8s.io/kube-apiserver v1.25.2 97801f8394908 34.2MB
registry.k8s.io/kube-apiserver v1.26.0 433283fa69d94 80.3MB
registry.k8s.io/kube-controller-manager v1.25.2 dbfceb93c69b6 31.3MB
registry.k8s.io/kube-controller-manager v1.26.0 a1151715817c7 68.9MB
registry.k8s.io/kube-proxy v1.26.0 52e36c9323249 67.2MB
registry.k8s.io/kube-scheduler v1.26.0 9959074212d44 57.7MB
registry.k8s.io/pause 3.7 221177c6082a8 311kB
3、部署应用
只需验证应用的状态是否发生变化即可：
对应的yaml为"karmada/samples/nginx"：
deployment.yaml的内容增加如下：
...
containers:
- image: nginx
name: nginx
command:
- "/bin/bash"
- "-c"
args: [ "aa=0;while true;do sleep 1;((aa++));echo $aa;done" ]
propagationpolicy.yaml中，需要添加member3（验证karmada-agent）
apiVersion: policy.karmada.io/v1alpha1
kind: PropagationPolicy
metadata:
name: nginx-propagation
spec:
resourceSelectors:
- apiVersion: apps/v1
kind: Deployment
name: nginx
placement:
clusterAffinity:
clusterNames:
- member1
- member2
- member3
replicaScheduling:
replicaDivisionPreference: Weighted
replicaSchedulingType: Divided
weightPreference:
staticWeightList:
- targetCluster:
clusterNames:
- member1
weight: 1
- targetCluster:
clusterNames:
- member2
weight: 1
- targetCluster:
clusterNames:
- member3
weight: 1
查看应用状态
root@zishen:~# export KUBECONFIG="$HOME/.kube/members.config"
root@zishen:~# kubectl config use-context member3
Switched to context "member3".
root@zishen:~# kubectl get pod -A
NAMESPACE NAME READY STATUS RESTARTS AGE
default nginx-5dbb584b95-sz4g2 1/1 Running 0 70s
root@zishen:/home/btg/yaml# kubectl logs -f -n default nginx-5dbb584b95-sk7fv
1
2
3
4
5
6
7
....
二、升级到v1.6.0
【注意】
若使用远端或者发布镜像验证，则需要按照升级文档操作。
1、构建master镜像
export VERSION="v1.6.0"
make images
查看编辑出的镜像：
root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker images|grep v1.6.0
karmada/karmada-operator v1.6.0 2edee816160b 58 seconds ago 59.3MB
karmada/karmada-search v1.6.0 deec326ec47f About a minute ago 102MB
karmada/karmada-interpreter-webhook-example v1.6.0 678d5fa1aac2 About a minute ago 62.8MB
karmada/karmada-scheduler-estimator v1.6.0 aa0f3a7dd2f1 About a minute ago 70.8MB
karmada/karmada-agent v1.6.0 4d9a7b93a25a About a minute ago 78.2MB
karmada/karmada-webhook v1.6.0 c6029f586501 About a minute ago 68.5MB
karmada/karmada-descheduler v1.6.0 990d1b67de23 About a minute ago 71.2MB
karmada/karmada-scheduler v1.6.0 e95e90bce524 2 minutes ago 71.7MB
karmada/karmada-controller-manager v1.6.0 e3b9425e24a7 2 minutes ago 83.5MB
karmada/karmada-aggregated-apiserver v1.6.0 0dcd5bde6254 2 minutes ago 93.3MB
2、推送到kind容器中
推送到karmada-host中：
kind load docker-image karmada/karmada-metrics-adapter:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-operator:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-search:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-interpreter-webhook-example:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-scheduler-estimator:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-webhook:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-descheduler:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-scheduler:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-controller-manager:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-aggregated-apiserver:v1.6.0 --name karmada-host
karmada/karmada-agent推送到cluster中：
kind load docker-image karmada/karmada-agent:v1.6.0 --name member3
查看推送的结果
karmada-host中：
root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker container ls
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
45516dd5679d kindest/node:v1.26.0 "/usr/local/bin/entr…" 9 hours ago Up 9 hours 127.0.0.1:40207->6443/tcp member3-control-plane
3e1e35ec0f2b kindest/node:v1.26.0 "/usr/local/bin/entr…" 9 hours ago Up 9 hours 127.0.0.1:33387->6443/tcp karmada-host-control-plane
b203b03b03a3 kindest/node:v1.26.0 "/usr/local/bin/entr…" 9 hours ago Up 9 hours 127.0.0.1:45343->6443/tcp member2-control-plane
ca7a21af6a5a kindest/node:v1.26.0 "/usr/local/bin/entr…" 9 hours ago Up 9 hours 127.0.0.1:44911->6443/tcp member1-control-plane
root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker exec -i 3e1e35ec0f2b bash
crictl images|grep v1.6.0
docker.io/karmada/karmada-aggregated-apiserver v1.6.0 0dcd5bde6254d 93.9MB
docker.io/karmada/karmada-controller-manager v1.6.0 e3b9425e24a7f 84.1MB
docker.io/karmada/karmada-descheduler v1.6.0 990d1b67de23d 71.8MB
docker.io/karmada/karmada-interpreter-webhook-example v1.6.0 678d5fa1aac25 63.3MB
docker.io/karmada/karmada-operator v1.6.0 2edee816160b3 59.8MB
docker.io/karmada/karmada-scheduler-estimator v1.6.0 aa0f3a7dd2f18 71.3MB
docker.io/karmada/karmada-scheduler v1.6.0 e95e90bce524b 72.2MB
docker.io/karmada/karmada-search v1.6.0 deec326ec47f5 103MB
docker.io/karmada/karmada-webhook v1.6.0 c6029f5865015 69MB
member3中：
root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker container ls
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
45516dd5679d kindest/node:v1.26.0 "/usr/local/bin/entr…" 9 hours ago Up 9 hours 127.0.0.1:40207->6443/tcp member3-control-plane
3e1e35ec0f2b kindest/node:v1.26.0 "/usr/local/bin/entr…" 9 hours ago Up 9 hours 127.0.0.1:33387->6443/tcp karmada-host-control-plane
b203b03b03a3 kindest/node:v1.26.0 "/usr/local/bin/entr…" 9 hours ago Up 9 hours 127.0.0.1:45343->6443/tcp member2-control-plane
ca7a21af6a5a kindest/node:v1.26.0 "/usr/local/bin/entr…" 9 hours ago Up 9 hours 127.0.0.1:44911->6443/tcp member1-control-plane
root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker exec -i 45516dd5679d bash
crictl images|grep v1.6.0
docker.io/karmada/karmada-agent v1.6.0 4d9a7b93a25ab 78.7MB
3、执行升级
如下修改image的版本为v1.6.0即可。
karmada-host侧升级(必须的组件如下，可适量增加)的组件如下：
export KUBECONFIG="$HOME/.kube/karmada.config"
kubectl config use-context karmada-host
kubectl edit deployment -n karmada-system karmada-aggregated-apiserver
kubectl edit deployment -n karmada-system karmada-controller-manager
kubectl edit deployment -n karmada-system karmada-descheduler
kubectl edit deployment -n karmada-system karmada-scheduler
kubectl edit deployment -n karmada-system karmada-search
kubectl edit deployment -n karmada-system karmada-webhook
cluster侧member3升级：
export KUBECONFIG="$HOME/.kube/members.config"
kubectl config use-context member3
kubectl edit deployment -n karmada-system karmada-agent
4、检查升级结果
1)、关键组件日志：
karmada host：
root@zishen:/home/btg/yaml# kubectl logs -n karmada-system karmada-apiserver-77974ccbff-s66rw -f
...
E0602 02:33:42.753750 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=6m19s&timeoutSeconds=379&watch=true" audit-ID="05fdfba1-dcc5-438d-947b-6e04c0528ad0"
2023/06/02 02:34:11 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=53, ErrCode=NO_ERROR, debug=""
2023/06/02 02:34:11 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=53, ErrCode=NO_ERROR, debug=""
E0602 02:34:11.624674 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297289&timeout=6m49s&timeoutSeconds=409&watch=true" audit-ID="22d82e01-9e2c-4060-899e-1f857d3e4f81"
E0602 02:34:11.626506 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297442&timeoutSeconds=403&watch=true" audit-ID="b304a0e8-ffe8-44e2-8423-b6b5af25b144"
E0602 02:34:33.972632 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeoutSeconds=303&watch=true" audit-ID="622a4cac-721e-4609-bb0b-368b42800a08"
karmada cluster
oot@zishen:/home/btg/yaml# kubectl describe deployment -n karmada-system karmada-agent
...
Conditions:
Type Status Reason
---- ------ ------
Available True MinimumReplicasAvailable
Progressing True NewReplicaSetAvailable
OldReplicaSets: <none>
NewReplicaSet: karmada-agent-5474c8b886 (2/2 replicas created)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal ScalingReplicaSet 6m14s deployment-controller Scaled up replica set karmada-agent-5474c8b886 to 1
Normal ScalingReplicaSet 6m13s deployment-controller Scaled down replica set karmada-agent-7cd65ffd5d to 1 from 2
Normal ScalingReplicaSet 6m13s deployment-controller Scaled up replica set karmada-agent-5474c8b886 to 2 from 1
Normal ScalingReplicaSet 6m12s deployment-controller Scaled down replica set karmada-agent-7cd65ffd5d to 0 from 1
测试程序
root@zishen:/home/btg/yaml# grep -w "100" /home/btg/hahaha.log
100
2）、应用程序状态：
karmada-host侧：
root@zishen:/usr/workspace/go/src/karmada-io/karmada# kubectl get pod -A
NAMESPACE NAME READY STATUS RESTARTS AGE
karmada-system etcd-0 1/1 Running 0 23h
karmada-system karmada-aggregated-apiserver-64cf9f7845-g4gp4 1/1 Running 0 3m41s
karmada-system karmada-aggregated-apiserver-64cf9f7845-xrww6 1/1 Running 0 3m44s
karmada-system karmada-apiserver-77974ccbff-s66rw 1/1 Running 0 23h
karmada-system karmada-controller-manager-6787457d89-hss52 1/1 Running 0 3m16s
karmada-system karmada-controller-manager-6787457d89-lzxwh 1/1 Running 0 3m17s
karmada-system karmada-descheduler-5f69bc6c84-p2r8r 1/1 Running 0 2m54s
karmada-system karmada-descheduler-5f69bc6c84-qzjtx 1/1 Running 0 2m56s
karmada-system karmada-kube-controller-manager-795c547674-ffqjj 1/1 Running 0 23h
karmada-system karmada-scheduler-7f865f68d6-4txzp 1/1 Running 0 2m33s
karmada-system karmada-scheduler-7f865f68d6-zm8vs 1/1 Running 0 2m31s
karmada-system karmada-scheduler-estimator-member1-5bdd4ff65f-lb997 1/1 Running 0 23h
karmada-system karmada-scheduler-estimator-member1-5bdd4ff65f-w7c7k 1/1 Running 0 23h
karmada-system karmada-scheduler-estimator-member2-58fdf7c575-54jj5 1/1 Running 0 23h
karmada-system karmada-scheduler-estimator-member2-58fdf7c575-wvs4n 1/1 Running 0 23h
karmada-system karmada-scheduler-estimator-member3-f6895d459-4j47l 1/1 Running 0 23h
karmada-system karmada-scheduler-estimator-member3-f6895d459-l27wl 1/1 Running 0 23h
karmada-system karmada-search-7fd469d685-kgdb7 1/1 Running 0 2m11s
karmada-system karmada-search-7fd469d685-sjghp 1/1 Running 0 2m10s
karmada-system karmada-webhook-6858449bf7-45ggl 1/1 Running 0 109s
karmada-system karmada-webhook-6858449bf7-s4kvc 1/1 Running 0 110s
kube-system coredns-787d4945fb-765jg 1/1 Running 0 23h
...
cluster侧member3：
root@zishen:/usr/workspace/go/src/karmada-io/karmada# kubectl get pod -A
NAMESPACE NAME READY STATUS RESTARTS AGE
default nginx-5dbb584b95-sz4g2 1/1 Running 0 14h
karmada-system karmada-agent-5474c8b886-flqbp 1/1 Running 0 40s
karmada-system karmada-agent-5474c8b886-v6l8x 1/1 Running 0 39s
...
故升级前程序业务不受影响，但不能处理了。新业务不受影响。
三、参考文档
四、发现问题
1、修改./hack/local-up-karmada.sh 文件的VERSION，只在主机侧的镜像有作用，kind内和部署的deployment无效
2、若升级前存在业务，升级后karmada-apiserver会一直报。知道删除或重新部署业务。
root@zishen:/home/btg/yaml# kubectl logs -n karmada-system karmada-apiserver-77974ccbff-s66rw -f
...
E0602 02:30:55.124997 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=295002&timeoutSeconds=446&watch=true" audit-ID="e6ef60c4-6523-429a-9024-23d7bfa79516"
E0602 02:30:55.125529 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeoutSeconds=525&watch=true" audit-ID="0ef45f3b-47e8-43f3-ae9a-f7c6cd9b1297"
2023/06/02 02:32:40 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
E0602 02:32:40.324668 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeout=7m46s&timeoutSeconds=466&watch=true" audit-ID="05600c47-fc20-48bb-b6ab-19ba2a5744b1"
2023/06/02 02:32:40 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
E0602 02:32:40.327519 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeoutSeconds=326&watch=true" audit-ID="eb7ef0f0-0328-4159-81b1-aea8fe947d29"
2023/06/02 02:32:42 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=77, ErrCode=NO_ERROR, debug=""
2023/06/02 02:32:42 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=71, ErrCode=NO_ERROR, debug=""
2023/06/02 02:32:42 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=77, ErrCode=NO_ERROR, debug=""
2023/06/02 02:32:42 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=77, ErrCode=NO_ERROR, debug=""
E0602 02:32:42.338783 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeout=8m39s&timeoutSeconds=519&watch=true" audit-ID="3e13f137-738e-408f-9392-551e6e8b7198"
E0602 02:32:42.339028 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeout=6m50s&timeoutSeconds=410&watch=true" audit-ID="ac5783af-64c1-402f-8458-95a82efbfdaa"
E0602 02:32:42.338888 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=293953&timeout=8m24s&timeoutSeconds=504&watch=true" audit-ID="3ece225c-3b77-4571-983a-8294af3ee541"
E0602 02:32:42.338976 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeout=6m38s&timeoutSeconds=398&watch=true" audit-ID="c48f1c05-1aa2-4e3e-a9ed-c662155371a4"
E0602 02:32:57.459740 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=9m48s&timeoutSeconds=588&watch=true" audit-ID="6c1a2bf3-6c34-4756-9372-db5925762946"
E0602 02:33:20.572474 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=9m29s&timeoutSeconds=569&watch=true" audit-ID="f3499f66-263b-4343-bec3-25fed6d7bb27"
E0602 02:33:41.595589 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297289&timeout=7m46s&timeoutSeconds=466&watch=true" audit-ID="31648c60-34f3-4f8e-841d-2f5b3fbbf1b5"
E0602 02:33:41.596261 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=8m17s&timeoutSeconds=497&watch=true" audit-ID="d16341f3-1571-4c97-b223-47c24e9fcad4"
E0602 02:33:42.753710 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=295002&timeout=9m4s&timeoutSeconds=544&watch=true" audit-ID="05e6a0b0-012a-466c-9cb4-7275b1ccc2f9"
E0602 02:33:42.753750 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=6m19s&timeoutSeconds=379&watch=true" audit-ID="05fdfba1-dcc5-438d-947b-6e04c0528ad0"
2023/06/02 02:34:11 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=53, ErrCode=NO_ERROR, debug=""
2023/06/02 02:34:11 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=53, ErrCode=NO_ERROR, debug=""
E0602 02:34:11.624674 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297289&timeout=6m49s&timeoutSeconds=409&watch=true" audit-ID="22d82e01-9e2c-4060-899e-1f857d3e4f81"
E0602 02:34:11.626506 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297442&timeoutSeconds=403&watch=true" audit-ID="b304a0e8-ffe8-44e2-8423-b6b5af25b144"
E0602 02:34:33.972632 1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeoutSeconds=303&watch=true" audit-ID="622a4cac-721e-4609-bb0b-368b42800a08"
I0602 02:45:15.747866 1 trace.go:205] Trace[649290080]: "Call conversion webhook" custom-resource-definition:resourcebindings.work.karmada.io,desired-api-version:work.karmada.io/v1alpha1,object-count:1,UID:5303fdca-2225-444f-a618-f821a2f71b6e (02-Jun-2023 02:45:15.666) (total time: 81ms):
Trace[649290080]: ---"Request completed" 81ms (02:45:15.747)
Trace[649290080]: [81.732754ms] [81.732754ms] END
扫一扫
728
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
