kubernetes 部署本地dns_kubectl部署localdns-CSDN博客

本文链接：https://blog.csdn.net/wangjunsheng/article/details/86095544

下载

输入 k8s-dns-sidecar-amd64:1.14.5 搜索

我随便找了个最前面的链接下载,一共要下载3个镜像，如下

sudo docker pull registry.cn-hangzhou.aliyuncs.com/inspur_research/k8s-dns-sidecar-amd64:1.14.5
sudo docker pull registry.cn-hangzhou.aliyuncs.com/wonders/k8s-dns-kube-dns-amd64:1.14.5
sudo docker pull registry.cn-hangzhou.aliyuncs.com/inspur_research/k8s-dns-dnsmasq-nanny-amd64:1.14.5

下载后看看

~/k8s/demo1 $ docker images
REPOSITORY                                                                      TAG                 IMAGE ID            CREATED             SIZE
registry.cn-hangzhou.aliyuncs.com/wonders/k8s-dns-kube-dns-amd64                1.14.5              b72a8701739b        6 weeks ago         49.4 MB
registry.cn-hangzhou.aliyuncs.com/inspur_research/k8s-dns-sidecar-amd64         1.14.5              8559c9d8d1a6        11 months ago       41.8 MB
registry.cn-hangzhou.aliyuncs.com/inspur_research/k8s-dns-dnsmasq-nanny-amd64   1.14.5              96c7a8682152        11 months ago       41.4 MB

配置

kubedns-controller.yaml

apiVersion: extensions/v1beta1
kind: Deployment
metadata:
  name: kube-dns
  namespace: kube-system
  labels:
    k8s-app: kube-dns
    kubernetes.io/cluster-service: "true"
    addonmanager.kubernetes.io/mode: Reconcile
spec:
  # replicas: not specified here:
  # 1. In order to make Addon Manager do not reconcile this replicas parameter.
  # 2. Default is 1.
  # 3. Will be tuned in real time if DNS horizontal auto-scaling is turned on.
  strategy:
    rollingUpdate:
      maxSurge: 10%
      maxUnavailable: 0
  selector:
    matchLabels:
      k8s-app: kube-dns
  template:
    metadata:
      labels:
        k8s-app: kube-dns
      annotations:
        scheduler.alpha.kubernetes.io/critical-pod: ''
    spec:
      tolerations:
      - key: "CriticalAddonsOnly"
        operator: "Exists"
#      volumes:
#      - name: kube-dns-config
#        configMap:
#          name: kube-dns
#          optional: true
      containers:
      - name: kubedns
        image: registry.cn-hangzhou.aliyuncs.com/wonders/k8s-dns-kube-dns-amd64:1.14.5
        resources:
          # TODO: Set memory limits when we've profiled the container for large
          # clusters, then set request = limit to keep this container in
          # guaranteed class. Currently, this container falls into the
          # "burstable" category so the kubelet doesn't backoff from restarting it.
          limits:
            memory: 170Mi
          requests:
            cpu: 100m
            memory: 70Mi
        livenessProbe:
          httpGet:
            path: /healthcheck/kubedns
            port: 10054
            scheme: HTTP
          initialDelaySeconds: 60
          timeoutSeconds: 5
          successThreshold: 1
          failureThreshold: 5
        readinessProbe:
          httpGet:
            path: /readiness
            port: 8081
            scheme: HTTP
          # we poll on pod startup for the Kubernetes master service and
          # only setup the /readiness HTTP server once that's available.
          initialDelaySeconds: 3
          timeoutSeconds: 5
        args:
        - --domain=cluster.local.
        - --dns-port=10053
        - --config-dir=/kube-dns-config
        - --kube-master-url=http://192.168.254.158:8080
        - --v=0
        env:
        - name: PROMETHEUS_PORT
          value: "10055"
        ports:
        - containerPort: 10053
          name: dns-local
          protocol: UDP
        - containerPort: 10053
          name: dns-tcp-local
          protocol: TCP
        - containerPort: 10055
          name: metrics
          protocol: TCP
#        volumeMounts:
#        - name: kube-dns-config
#          mountPath: /kube-dns-config
      - name: dnsmasq
        image: registry.cn-hangzhou.aliyuncs.com/inspur_research/k8s-dns-dnsmasq-nanny-amd64:1.14.5
        livenessProbe:
          httpGet:
            path: /healthcheck/dnsmasq
            port: 10054
            scheme: HTTP
          initialDelaySeconds: 60
          timeoutSeconds: 5
          successThreshold: 1
          failureThreshold: 5
        args:
        - -v=2
        - -logtostderr
        - -configDir=/etc/k8s/dns/dnsmasq-nanny
        - -restartDnsmasq=true
        - --
        - -k
        - --cache-size=1000
        - --log-facility=-
        - --server=/cluster.local/127.0.0.1#10053
        - --server=/in-addr.arpa/127.0.0.1#10053
        - --server=/ip6.arpa/127.0.0.1#10053
        ports:
        - containerPort: 53
          name: dns
          protocol: UDP
        - containerPort: 53
          name: dns-tcp
          protocol: TCP
        # see: https://github.com/kubernetes/kubernetes/issues/29055 for details
        resources:
          requests:
            cpu: 150m
            memory: 20Mi
#        volumeMounts:
#        - name: kube-dns-config
#          mountPath: /etc/k8s/dns/dnsmasq-nanny
      - name: sidecar
        image: registry.cn-hangzhou.aliyuncs.com/inspur_research/k8s-dns-sidecar-amd64:1.14.5
        livenessProbe:
          httpGet:
            path: /metrics
            port: 10054
            scheme: HTTP
          initialDelaySeconds: 60
          timeoutSeconds: 5
          successThreshold: 1
          failureThreshold: 5
        args:
        - --v=2
        - --logtostderr
        - --probe=kubedns,127.0.0.1:10053,kubernetes.default.svc.cluster.local,5,A
        - --probe=dnsmasq,127.0.0.1:53,kubernetes.default.svc.cluster.local,5,A
        ports:
        - containerPort: 10054
          name: metrics
          protocol: TCP
        resources:
          requests:
            memory: 20Mi
            cpu: 10m
      dnsPolicy: Default  # Don't use cluster DNS.
      serviceAccountName: kube-dns

kubedns-svc.yaml

apiVersion: v1
kind: Service
metadata:
  name: kube-dns
  namespace: kube-system
  labels:
    k8s-app: kube-dns
    kubernetes.io/cluster-service: "true"
    addonmanager.kubernetes.io/mode: Reconcile
    kubernetes.io/name: "KubeDNS"
spec:
  selector:
    k8s-app: kube-dns
  clusterIP: 10.254.0.2
  ports:
  - name: dns
    port: 53
    protocol: UDP
  - name: dns-tcp
    port: 53
    protocol: TCP

kubedns-cm.yaml

apiVersion: v1
kind: ConfigMap
metadata:
  name: kube-dns
  namespace: kube-system
  labels:
    addonmanager.kubernetes.io/mode: EnsureExists

kubedns-sa.yaml

apiVersion: v1
kind: ServiceAccount
metadata:
  name: kube-dns
  namespace: kube-system
  labels:
    kubernetes.io/cluster-service: "true"
    addonmanager.kubernetes.io/mode: Reconcile

把他们都启动了

kubectl create -f kubedns-controller.yaml --validate=false
kubectl create -f kubedns-cm.yaml
kubectl create -f kubedns-sa.yaml 
kubectl create -f kubedns-svc.yaml

注意点:

主要修改了

1. clusterIP: 10.254.0.2 大家的集群ip不一定一样。可以通过 kubectl get svc 查询

2. image 地址改一下改成 docker images 里显示的

3. --kube-master-url=http://192.168.254.158:8080 这个ip改成自己电脑虚拟机的

4. kube-apiserver 配置文件的侦听地址要改一下 /etc/kubernetes/apiserver

KUBE_API_ADDRESS="--insecure-bind-address=0.0.0.0"

否则会出现如下错误，

E0108 12:38:25.653292       1 reflector.go:199] k8s.io/dns/vendor/k8s.io/client-go/tools/cache/reflector.go:94: Failed to list *v1.Endpoints: Get http://127.0.0.1:8080/api/v1/endpoints?resourceVersion=0: dial tcp 127.0.0.1:8080: getsockopt: connection refused
E0108 12:38:25.653320       1 reflector.go:199] k8s.io/dns/vendor/k8s.io/client-go/tools/cache/reflector.go:94: Failed to list *v1.Service: Get http://127.0.0.1:8080/api/v1/services?resourceVersion=0: dial tcp 127.0.0.1:8080: getsockopt: connection refused

5. kubelet 配置文件 /etc/kubernetes/kubelet

KUBELET_ARGS="--cluster-dns=10.254.0.2 --cluster-domain=cluster.local"

6. 如果不能成功启动

docker logs 相应的容器id 来判断哪里出错

7. 重启 kube-apiserver 和 kubelet

systemctl restart kube-apiserver

systemctl restart kubelet

验证

重新部署开启之前的demo

k8s 示例

这次不用人肉填写 /etc/hosts 的域名 ip 就可以直接访问了

kubectl get svc --all-namespaces
NAMESPACE     NAME         CLUSTER-IP       EXTERNAL-IP   PORT(S)          AGE
default       kubernetes   10.254.0.1       <none>        443/TCP          23h
default       mysql        10.254.248.21    <none>        3306/TCP         30m
default       myweb        10.254.115.226   <nodes>       8080:30001/TCP   30m
kube-system   kube-dns     10.254.0.2       <none>        53/UDP,53/TCP    30m

kubectl get ep --all-namespaces
NAMESPACE     NAME                      ENDPOINTS                     AGE
default       kubernetes                192.168.254.158:6443          23h
default       mysql                     172.17.0.4:3306               30m
default       myweb                     172.17.0.3:8080               30m
kube-system   kube-controller-manager   <none>                        23h
kube-system   kube-dns                  172.17.0.2:53,172.17.0.2:53   31m
kube-system   kube-scheduler            <none>                        23h

参考文章

https://blog.csdn.net/xxb249/article/details/79929752

https://blog.csdn.net/luckytanggu/article/details/70807398