karmada升级到1.6.0本地验证

一、构建1.5.1环境老环境

1、拉取1.5.1仓库代码

root@zishen:/usr/workspace/go/src/karmada-io# git clone https://github.com/karmada-io/karmada.git
Cloning into 'karmada'...
remote: Enumerating objects: 52928, done.
remote: Counting objects: 100% (8165/8165), done.
remote: Compressing objects: 100% (1171/1171), done.
remote: Total 52928 (delta 7163), reused 7363 (delta 6936), pack-reused 44763
Receiving objects: 100% (52928/52928), 36.44 MiB | 1.39 MiB/s, done.
Resolving deltas: 100% (32043/32043), done.
root@zishen:/usr/workspace/go/src/karmada-io# cd karmada/
root@zishen:/usr/workspace/go/src/karmada-io/karmada# git tag
v0.1.0
...
v1.5.1
root@zishen:/usr/workspace/go/src/karmada-io/karmada# git checkout v1.5.1
Note: checking out 'v1.5.1'.
...
root@zishen:/usr/workspace/go/src/karmada-io/karmada# 
root@zishen:/usr/workspace/go/src/karmada-io/karmada# git status
HEAD detached at v1.5.1
nothing to commit, working tree clean

2、安装karmada模拟环境

1)、修改安装版本号

该步骤在v1.6.0前可不做,后续修复该VERSION不生效问题后,可按此操作。

oot@zishen:/usr/workspace/go/src/karmada-io/karmada# git status
HEAD detached at v1.5.1
nothing to commit, working tree clean
root@zishen:/usr/workspace/go/src/karmada-io/karmada# vim ./hack/local-up-karmada.sh 

修改VERSION的内容为v1.5.1:

 ...
 88 #step2. make images and get karmadactl
 89 export VERSION="v1.5.1"
 90 export REGISTRY="docker.io/karmada"
 91 make images GOOS="linux" --directory="${REPO_ROOT}"
 ...

2)、清理环境

卸载之前的karmada:

 bash ./hack/local-down-karmada.sh

删除之前的镜像

for i in `docker images|grep -E 'none|karmada' |awk '{print $3}'`;do docker rmi $i;done

3)、执行编译安装安装如下:

root@zishen:/usr/workspace/go/src/karmada-io/karmada# bash ./hack/local-up-karmada.sh 
...
cluster.cluster.karmada.io/member3 condition met

------------------------------------------------------------------------------------------------------
 █████   ████   █████████   ███████████   ██████   ██████   █████████   ██████████     █████████
░░███   ███░   ███░░░░░███ ░░███░░░░░███ ░░██████ ██████   ███░░░░░███ ░░███░░░░███   ███░░░░░███
 ░███  ███    ░███    ░███  ░███    ░███  ░███░█████░███  ░███    ░███  ░███   ░░███ ░███    ░███
 ░███████     ░███████████  ░██████████   ░███░░███ ░███  ░███████████  ░███    ░███ ░███████████
 ░███░░███    ░███░░░░░███  ░███░░░░░███  ░███ ░░░  ░███  ░███░░░░░███  ░███    ░███ ░███░░░░░███
 ░███ ░░███   ░███    ░███  ░███    ░███  ░███      ░███  ░███    ░███  ░███    ███  ░███    ░███
 █████ ░░████ █████   █████ █████   █████ █████     █████ █████   █████ ██████████   █████   █████
░░░░░   ░░░░ ░░░░░   ░░░░░ ░░░░░   ░░░░░ ░░░░░     ░░░░░ ░░░░░   ░░░░░ ░░░░░░░░░░   ░░░░░   ░░░░░
------------------------------------------------------------------------------------------------------

Local Karmada is running.

To start using your karmada, run:
  export KUBECONFIG=/root/.kube/karmada.config
Please use 'kubectl config use-context karmada-host/karmada-apiserver' to switch the host and control plane cluster.

To manage your member clusters, run:
  export KUBECONFIG=/root/.kube/members.config
Please use 'kubectl config use-context member1/member2/member3' to switch to the different member cluster.

3)、查看使用镜像:

主机:

root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker images
REPOSITORY                                              TAG                IMAGE ID       CREATED          SIZE
karmada/karmada-operator                                v1.5.1             3b7cb440aaad   13 minutes ago   59.3MB
karmada/karmada-search                                  v1.5.1             8fa225c1f206   13 minutes ago   102MB
karmada/karmada-interpreter-webhook-example             v1.5.1             ba469aa91374   13 minutes ago   62.8MB
karmada/karmada-scheduler-estimator                     v1.5.1             5cbe32d605c9   14 minutes ago   70.8MB
karmada/karmada-agent                                   v1.5.1             388db18e3708   14 minutes ago   78.2MB
karmada/karmada-webhook                                 v1.5.1             4cb0053c5ab7   14 minutes ago   68.5MB
karmada/karmada-descheduler                             v1.5.1             6f07bf2a6be0   14 minutes ago   71.2MB
karmada/karmada-scheduler                               v1.5.1             67052b5deb1f   14 minutes ago   71.7MB
karmada/karmada-controller-manager                      v1.5.1             51c09880714d   15 minutes ago   83.5MB
karmada/karmada-aggregated-apiserver                    v1.5.1             b0cfba8d54bc   15 minutes ago   93.3MB
zishen1988/kube-apiserver-amd64                         latest             6f6e73fa8162   6 weeks ago      121MB

kind容器内:

root@zishen:/home/btg/yaml# docker container ls
CONTAINER ID   IMAGE                  COMMAND                  CREATED       STATUS       PORTS                       NAMES
45516dd5679d   kindest/node:v1.26.0   "/usr/local/bin/entr…"   8 hours ago   Up 8 hours   127.0.0.1:40207->6443/tcp   member3-control-plane
3e1e35ec0f2b   kindest/node:v1.26.0   "/usr/local/bin/entr…"   8 hours ago   Up 8 hours   127.0.0.1:33387->6443/tcp   karmada-host-control-plane
b203b03b03a3   kindest/node:v1.26.0   "/usr/local/bin/entr…"   8 hours ago   Up 8 hours   127.0.0.1:45343->6443/tcp   member2-control-plane
ca7a21af6a5a   kindest/node:v1.26.0   "/usr/local/bin/entr…"   8 hours ago   Up 8 hours   127.0.0.1:44911->6443/tcp   member1-control-plane
root@zishen:/home/btg/yaml# docker exec -i 3e1e35ec0f2b  bash
crictl images
IMAGE                                            TAG                  IMAGE ID            SIZE
docker.io/karmada/karmada-aggregated-apiserver   latest               f02c482e5c9f5       40.6MB
docker.io/karmada/karmada-aggregated-apiserver   v1.5.1               7ff2ea0294821       93.9MB
docker.io/karmada/karmada-controller-manager     latest               d651530f77284       41.3MB
docker.io/karmada/karmada-controller-manager     v1.5.1               c08b381e4a122       84.1MB
docker.io/karmada/karmada-descheduler            latest               6c5ada5682c5f       31.4MB
docker.io/karmada/karmada-descheduler            v1.5.1               640f37b181de8       71.8MB
docker.io/karmada/karmada-scheduler-estimator    latest               f09827af787d0       31.2MB
docker.io/karmada/karmada-scheduler-estimator    v1.5.1               9d33b6257009c       71.3MB
docker.io/karmada/karmada-scheduler              latest               bc90c17d68648       31.6MB
docker.io/karmada/karmada-scheduler              v1.5.1               b78d2eab602f5       72.2MB
docker.io/karmada/karmada-search                 latest               a1f60bff0fa21       43.9MB
docker.io/karmada/karmada-search                 v1.5.1               efd81d3bf544c       103MB
docker.io/karmada/karmada-webhook                latest               ffa65b8b4fbcd       31MB
docker.io/karmada/karmada-webhook                v1.5.1               246d61ef6d25e       69MB
docker.io/kindest/kindnetd                       v20221004-44d545d1   d6e3e26021b60       25.8MB
docker.io/kindest/local-path-helper              v20220607-9a4d8d2a   d2f902e939cc3       2.86MB
docker.io/kindest/local-path-provisioner         v0.0.22-kind.0       4c1e997385b8f       17.4MB
registry.k8s.io/coredns/coredns                  v1.9.3               5185b96f0becf       14.8MB
registry.k8s.io/etcd                             3.5.3-0              aebe758cef4cd       102MB
registry.k8s.io/etcd                             3.5.6-0              fce326961ae2d       103MB
registry.k8s.io/kube-apiserver                   v1.25.2              97801f8394908       34.2MB
registry.k8s.io/kube-apiserver                   v1.26.0              433283fa69d94       80.3MB
registry.k8s.io/kube-controller-manager          v1.25.2              dbfceb93c69b6       31.3MB
registry.k8s.io/kube-controller-manager          v1.26.0              a1151715817c7       68.9MB
registry.k8s.io/kube-proxy                       v1.26.0              52e36c9323249       67.2MB
registry.k8s.io/kube-scheduler                   v1.26.0              9959074212d44       57.7MB
registry.k8s.io/pause                            3.7                  221177c6082a8       311kB

3、部署应用

只需验证应用的状态是否发生变化即可:

对应的yaml为"karmada/samples/nginx":

deployment.yaml的内容增加如下:

...
      containers:
      - image: nginx
        name: nginx
        command:
        - "/bin/bash"
        - "-c"
        args: [ "aa=0;while true;do sleep 1;((aa++));echo $aa;done" ]

propagationpolicy.yaml中,需要添加member3(验证karmada-agent)

apiVersion: policy.karmada.io/v1alpha1
kind: PropagationPolicy
metadata:
  name: nginx-propagation
spec:
  resourceSelectors:
    - apiVersion: apps/v1
      kind: Deployment
      name: nginx
  placement:
    clusterAffinity:
      clusterNames:
        - member1
        - member2
        - member3
    replicaScheduling:
      replicaDivisionPreference: Weighted
      replicaSchedulingType: Divided
      weightPreference:
        staticWeightList:
          - targetCluster:
              clusterNames:
                - member1
            weight: 1
          - targetCluster:
              clusterNames:
                - member2
            weight: 1
          - targetCluster:
              clusterNames:
                - member3
            weight: 1

查看应用状态

root@zishen:~# export KUBECONFIG="$HOME/.kube/members.config"
root@zishen:~# kubectl config use-context member3
Switched to context "member3".
root@zishen:~# kubectl get pod -A
NAMESPACE            NAME                                            READY   STATUS    RESTARTS   AGE
default              nginx-5dbb584b95-sz4g2                          1/1     Running   0          70s
root@zishen:/home/btg/yaml# kubectl logs -f -n default              nginx-5dbb584b95-sk7fv
1
2
3
4
5
6
7
....

二、升级到v1.6.0

【注意】

若使用远端或者发布镜像验证,则需要按照升级文档操作。

1、构建master镜像

export VERSION="v1.6.0"
make images

查看编辑出的镜像:

root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker images|grep v1.6.0
karmada/karmada-operator                                v1.6.0             2edee816160b   58 seconds ago       59.3MB
karmada/karmada-search                                  v1.6.0             deec326ec47f   About a minute ago   102MB
karmada/karmada-interpreter-webhook-example             v1.6.0             678d5fa1aac2   About a minute ago   62.8MB
karmada/karmada-scheduler-estimator                     v1.6.0             aa0f3a7dd2f1   About a minute ago   70.8MB
karmada/karmada-agent                                   v1.6.0             4d9a7b93a25a   About a minute ago   78.2MB
karmada/karmada-webhook                                 v1.6.0             c6029f586501   About a minute ago   68.5MB
karmada/karmada-descheduler                             v1.6.0             990d1b67de23   About a minute ago   71.2MB
karmada/karmada-scheduler                               v1.6.0             e95e90bce524   2 minutes ago        71.7MB
karmada/karmada-controller-manager                      v1.6.0             e3b9425e24a7   2 minutes ago        83.5MB
karmada/karmada-aggregated-apiserver                    v1.6.0             0dcd5bde6254   2 minutes ago        93.3MB

2、推送到kind容器中

推送到karmada-host中:

kind load docker-image karmada/karmada-metrics-adapter:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-operator:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-search:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-interpreter-webhook-example:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-scheduler-estimator:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-webhook:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-descheduler:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-scheduler:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-controller-manager:v1.6.0 --name karmada-host
kind load docker-image karmada/karmada-aggregated-apiserver:v1.6.0 --name karmada-host

karmada/karmada-agent推送到cluster中:

kind load docker-image karmada/karmada-agent:v1.6.0 --name member3

查看推送的结果

karmada-host中:

root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker container ls
CONTAINER ID   IMAGE                  COMMAND                  CREATED       STATUS       PORTS                       NAMES
45516dd5679d   kindest/node:v1.26.0   "/usr/local/bin/entr…"   9 hours ago   Up 9 hours   127.0.0.1:40207->6443/tcp   member3-control-plane
3e1e35ec0f2b   kindest/node:v1.26.0   "/usr/local/bin/entr…"   9 hours ago   Up 9 hours   127.0.0.1:33387->6443/tcp   karmada-host-control-plane
b203b03b03a3   kindest/node:v1.26.0   "/usr/local/bin/entr…"   9 hours ago   Up 9 hours   127.0.0.1:45343->6443/tcp   member2-control-plane
ca7a21af6a5a   kindest/node:v1.26.0   "/usr/local/bin/entr…"   9 hours ago   Up 9 hours   127.0.0.1:44911->6443/tcp   member1-control-plane
root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker exec -i 3e1e35ec0f2b  bash
crictl images|grep v1.6.0     
docker.io/karmada/karmada-aggregated-apiserver          v1.6.0               0dcd5bde6254d       93.9MB
docker.io/karmada/karmada-controller-manager            v1.6.0               e3b9425e24a7f       84.1MB
docker.io/karmada/karmada-descheduler                   v1.6.0               990d1b67de23d       71.8MB
docker.io/karmada/karmada-interpreter-webhook-example   v1.6.0               678d5fa1aac25       63.3MB
docker.io/karmada/karmada-operator                      v1.6.0               2edee816160b3       59.8MB
docker.io/karmada/karmada-scheduler-estimator           v1.6.0               aa0f3a7dd2f18       71.3MB
docker.io/karmada/karmada-scheduler                     v1.6.0               e95e90bce524b       72.2MB
docker.io/karmada/karmada-search                        v1.6.0               deec326ec47f5       103MB
docker.io/karmada/karmada-webhook                       v1.6.0               c6029f5865015       69MB

member3中:

root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker container ls
CONTAINER ID   IMAGE                  COMMAND                  CREATED       STATUS       PORTS                       NAMES
45516dd5679d   kindest/node:v1.26.0   "/usr/local/bin/entr…"   9 hours ago   Up 9 hours   127.0.0.1:40207->6443/tcp   member3-control-plane
3e1e35ec0f2b   kindest/node:v1.26.0   "/usr/local/bin/entr…"   9 hours ago   Up 9 hours   127.0.0.1:33387->6443/tcp   karmada-host-control-plane
b203b03b03a3   kindest/node:v1.26.0   "/usr/local/bin/entr…"   9 hours ago   Up 9 hours   127.0.0.1:45343->6443/tcp   member2-control-plane
ca7a21af6a5a   kindest/node:v1.26.0   "/usr/local/bin/entr…"   9 hours ago   Up 9 hours   127.0.0.1:44911->6443/tcp   member1-control-plane
root@zishen:/usr/workspace/go/src/karmada-io/karmada# docker exec -i 45516dd5679d  bash
crictl images|grep v1.6.0 
docker.io/karmada/karmada-agent            v1.6.0               4d9a7b93a25ab       78.7MB

3、执行升级

如下修改image的版本为v1.6.0即可。

karmada-host侧升级(必须的组件如下,可适量增加)的组件如下:

export KUBECONFIG="$HOME/.kube/karmada.config"
kubectl config use-context karmada-host

kubectl edit deployment -n karmada-system       karmada-aggregated-apiserver
kubectl edit deployment -n karmada-system       karmada-controller-manager
kubectl edit deployment -n karmada-system       karmada-descheduler
kubectl edit deployment -n karmada-system       karmada-scheduler
kubectl edit deployment -n karmada-system       karmada-search
kubectl edit deployment -n karmada-system       karmada-webhook

cluster侧member3升级:

export KUBECONFIG="$HOME/.kube/members.config"
kubectl config use-context member3
kubectl edit deployment -n karmada-system       karmada-agent

4、检查升级结果

1)、关键组件日志:

karmada host:

root@zishen:/home/btg/yaml# kubectl logs -n karmada-system       karmada-apiserver-77974ccbff-s66rw -f
...
E0602 02:33:42.753750       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=6m19s&timeoutSeconds=379&watch=true" audit-ID="05fdfba1-dcc5-438d-947b-6e04c0528ad0"
2023/06/02 02:34:11 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=53, ErrCode=NO_ERROR, debug=""
2023/06/02 02:34:11 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=53, ErrCode=NO_ERROR, debug=""
E0602 02:34:11.624674       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297289&timeout=6m49s&timeoutSeconds=409&watch=true" audit-ID="22d82e01-9e2c-4060-899e-1f857d3e4f81"
E0602 02:34:11.626506       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297442&timeoutSeconds=403&watch=true" audit-ID="b304a0e8-ffe8-44e2-8423-b6b5af25b144"
E0602 02:34:33.972632       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeoutSeconds=303&watch=true" audit-ID="622a4cac-721e-4609-bb0b-368b42800a08"

karmada cluster

oot@zishen:/home/btg/yaml# kubectl describe deployment -n karmada-system       karmada-agent
...
Conditions:
  Type           Status  Reason
  ----           ------  ------
  Available      True    MinimumReplicasAvailable
  Progressing    True    NewReplicaSetAvailable
OldReplicaSets:  <none>
NewReplicaSet:   karmada-agent-5474c8b886 (2/2 replicas created)
Events:
  Type    Reason             Age    From                   Message
  ----    ------             ----   ----                   -------
  Normal  ScalingReplicaSet  6m14s  deployment-controller  Scaled up replica set karmada-agent-5474c8b886 to 1
  Normal  ScalingReplicaSet  6m13s  deployment-controller  Scaled down replica set karmada-agent-7cd65ffd5d to 1 from 2
  Normal  ScalingReplicaSet  6m13s  deployment-controller  Scaled up replica set karmada-agent-5474c8b886 to 2 from 1
  Normal  ScalingReplicaSet  6m12s  deployment-controller  Scaled down replica set karmada-agent-7cd65ffd5d to 0 from 1

测试程序

root@zishen:/home/btg/yaml# grep -w "100" /home/btg/hahaha.log
100

2)、应用程序状态:

karmada-host侧:

root@zishen:/usr/workspace/go/src/karmada-io/karmada# kubectl get pod -A
NAMESPACE            NAME                                                   READY   STATUS    RESTARTS   AGE
karmada-system       etcd-0                                                 1/1     Running   0          23h
karmada-system       karmada-aggregated-apiserver-64cf9f7845-g4gp4          1/1     Running   0          3m41s
karmada-system       karmada-aggregated-apiserver-64cf9f7845-xrww6          1/1     Running   0          3m44s
karmada-system       karmada-apiserver-77974ccbff-s66rw                     1/1     Running   0          23h
karmada-system       karmada-controller-manager-6787457d89-hss52            1/1     Running   0          3m16s
karmada-system       karmada-controller-manager-6787457d89-lzxwh            1/1     Running   0          3m17s
karmada-system       karmada-descheduler-5f69bc6c84-p2r8r                   1/1     Running   0          2m54s
karmada-system       karmada-descheduler-5f69bc6c84-qzjtx                   1/1     Running   0          2m56s
karmada-system       karmada-kube-controller-manager-795c547674-ffqjj       1/1     Running   0          23h
karmada-system       karmada-scheduler-7f865f68d6-4txzp                     1/1     Running   0          2m33s
karmada-system       karmada-scheduler-7f865f68d6-zm8vs                     1/1     Running   0          2m31s
karmada-system       karmada-scheduler-estimator-member1-5bdd4ff65f-lb997   1/1     Running   0          23h
karmada-system       karmada-scheduler-estimator-member1-5bdd4ff65f-w7c7k   1/1     Running   0          23h
karmada-system       karmada-scheduler-estimator-member2-58fdf7c575-54jj5   1/1     Running   0          23h
karmada-system       karmada-scheduler-estimator-member2-58fdf7c575-wvs4n   1/1     Running   0          23h
karmada-system       karmada-scheduler-estimator-member3-f6895d459-4j47l    1/1     Running   0          23h
karmada-system       karmada-scheduler-estimator-member3-f6895d459-l27wl    1/1     Running   0          23h
karmada-system       karmada-search-7fd469d685-kgdb7                        1/1     Running   0          2m11s
karmada-system       karmada-search-7fd469d685-sjghp                        1/1     Running   0          2m10s
karmada-system       karmada-webhook-6858449bf7-45ggl                       1/1     Running   0          109s
karmada-system       karmada-webhook-6858449bf7-s4kvc                       1/1     Running   0          110s
kube-system          coredns-787d4945fb-765jg                               1/1     Running   0          23h
...

cluster侧member3:

root@zishen:/usr/workspace/go/src/karmada-io/karmada# kubectl get pod -A
NAMESPACE            NAME                                            READY   STATUS    RESTARTS   AGE
default              nginx-5dbb584b95-sz4g2                          1/1     Running   0          14h
karmada-system       karmada-agent-5474c8b886-flqbp                  1/1     Running   0          40s
karmada-system       karmada-agent-5474c8b886-v6l8x                  1/1     Running   0          39s
...

故升级前程序业务不受影响,但不能处理了。新业务不受影响。

三、参考文档

【karmada升级指导】

四、发现问题

1、修改./hack/local-up-karmada.sh 文件的VERSION,只在主机侧的镜像有作用,kind内和部署的deployment无效

2、若升级前存在业务,升级后karmada-apiserver会一直报。知道删除或重新部署业务。

root@zishen:/home/btg/yaml# kubectl logs -n karmada-system       karmada-apiserver-77974ccbff-s66rw -f
...
E0602 02:30:55.124997       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=295002&timeoutSeconds=446&watch=true" audit-ID="e6ef60c4-6523-429a-9024-23d7bfa79516"
E0602 02:30:55.125529       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeoutSeconds=525&watch=true" audit-ID="0ef45f3b-47e8-43f3-ae9a-f7c6cd9b1297"
2023/06/02 02:32:40 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
E0602 02:32:40.324668       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeout=7m46s&timeoutSeconds=466&watch=true" audit-ID="05600c47-fc20-48bb-b6ab-19ba2a5744b1"
2023/06/02 02:32:40 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
E0602 02:32:40.327519       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeoutSeconds=326&watch=true" audit-ID="eb7ef0f0-0328-4159-81b1-aea8fe947d29"
2023/06/02 02:32:42 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=77, ErrCode=NO_ERROR, debug=""
2023/06/02 02:32:42 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=71, ErrCode=NO_ERROR, debug=""
2023/06/02 02:32:42 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=77, ErrCode=NO_ERROR, debug=""
2023/06/02 02:32:42 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=77, ErrCode=NO_ERROR, debug=""
E0602 02:32:42.338783       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeout=8m39s&timeoutSeconds=519&watch=true" audit-ID="3e13f137-738e-408f-9392-551e6e8b7198"
E0602 02:32:42.339028       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeout=6m50s&timeoutSeconds=410&watch=true" audit-ID="ac5783af-64c1-402f-8458-95a82efbfdaa"
E0602 02:32:42.338888       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=293953&timeout=8m24s&timeoutSeconds=504&watch=true" audit-ID="3ece225c-3b77-4571-983a-8294af3ee541"
E0602 02:32:42.338976       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=295969&timeout=6m38s&timeoutSeconds=398&watch=true" audit-ID="c48f1c05-1aa2-4e3e-a9ed-c662155371a4"
E0602 02:32:57.459740       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=9m48s&timeoutSeconds=588&watch=true" audit-ID="6c1a2bf3-6c34-4756-9372-db5925762946"
E0602 02:33:20.572474       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=9m29s&timeoutSeconds=569&watch=true" audit-ID="f3499f66-263b-4343-bec3-25fed6d7bb27"
E0602 02:33:41.595589       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297289&timeout=7m46s&timeoutSeconds=466&watch=true" audit-ID="31648c60-34f3-4f8e-841d-2f5b3fbbf1b5"
E0602 02:33:41.596261       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=8m17s&timeoutSeconds=497&watch=true" audit-ID="d16341f3-1571-4c97-b223-47c24e9fcad4"
E0602 02:33:42.753710       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=295002&timeout=9m4s&timeoutSeconds=544&watch=true" audit-ID="05e6a0b0-012a-466c-9cb4-7275b1ccc2f9"
E0602 02:33:42.753750       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeout=6m19s&timeoutSeconds=379&watch=true" audit-ID="05fdfba1-dcc5-438d-947b-6e04c0528ad0"
2023/06/02 02:34:11 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=53, ErrCode=NO_ERROR, debug=""
2023/06/02 02:34:11 httputil: ReverseProxy read error during body copy: http2: server sent GOAWAY and closed the connection; LastStreamID=53, ErrCode=NO_ERROR, debug=""
E0602 02:34:11.624674       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297289&timeout=6m49s&timeoutSeconds=409&watch=true" audit-ID="22d82e01-9e2c-4060-899e-1f857d3e4f81"
E0602 02:34:11.626506       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/search.karmada.io/v1alpha1/resourceregistries?allowWatchBookmarks=true&resourceVersion=297442&timeoutSeconds=403&watch=true" audit-ID="b304a0e8-ffe8-44e2-8423-b6b5af25b144"
E0602 02:34:33.972632       1 wrap.go:53] timeout or abort while handling: method=GET URI="/apis/cluster.karmada.io/v1alpha1/clusters?allowWatchBookmarks=true&resourceVersion=297505&timeoutSeconds=303&watch=true" audit-ID="622a4cac-721e-4609-bb0b-368b42800a08"
I0602 02:45:15.747866       1 trace.go:205] Trace[649290080]: "Call conversion webhook" custom-resource-definition:resourcebindings.work.karmada.io,desired-api-version:work.karmada.io/v1alpha1,object-count:1,UID:5303fdca-2225-444f-a618-f821a2f71b6e (02-Jun-2023 02:45:15.666) (total time: 81ms):
Trace[649290080]: ---"Request completed" 81ms (02:45:15.747)
Trace[649290080]: [81.732754ms] [81.732754ms] END
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值