2021-02-24

KubeSphere 容器平台安装

云环境准备

华为云环境

主机IP地址	主机名称	SSH密码
192.168.0.19/119.3.204.36	[ecs-gateway]	#####
192.168.0.79	[docker-node2]	#####
192.168.0.208/119.3.193.112	[docker-master]	#####
192.168.0.55/119.3.202.18	[docker-node3]	#####
192.168.0.112	[docker-node1]	#####

由于存在两台主机不能上网，因此需先设置上网代理，保证每个节点均可上网。需要完成以下几步：

1. 在代理服务器【192.168.0.19】的标签页选择网卡，将源/目的检查设置为OFF；

2. 登录代理服务器，执行ping，检查是否可以链接外网；

3. 执行cat /proc/sys/net/ipv4/ip_forward指令，查看结果是否为1；

4. 若结果不为1，执行echo net.ipv4.ip_forward=1 >> /etc/sysctl.conf，再执行vi /etc/sysctl.conf检查net.ipv4.ip_forward的值；

5. 执行sysctl -p /etc/sysctl.conf保存配置修改；

6. 执行iptables -F命令，清除原有iptables规则。

7. 执行以下命令，配置SNAT；

   iptables -t nat -A POSTROUTING -o eth0 -s 192.168.0.0/16 -j SNAT --to 192.168.0.19

8. 为了确保重启后上述规则不丢失，可以执行vi /etc/rc.local编辑rc.local文件，将16中的规则复制到rc.local文件，按“ESC”退出编辑模式，输入“:wq”保存并退出。

组件预装

执行 yum install -y socat

执行yum install conntrack-tools

下载 KubeKey

执行以下指令：

wget -c https://kubesphere.io/download/kubekey-v1.0.0-linux-amd64.tar.gz -O - | tar -xz
chmod +x kk

生成安装配置并修改

./kk create config --with-kubesphere v3.0.0 --with-kubernetes v1.17.9 -f master-HA.yaml

指定永久化存储

./kk create config --with-storage nfs-client

执行

apiVersion: kubekey.kubesphere.io/v1alpha1
kind: Cluster
metadata:
  name: sample
spec:
  hosts:
  - {name: master1, address: 192.168.0.208, internalAddress: 192.168.0.208, user: root, password: ABC@5wei}
  - {name: master2, address: 192.168.0.55, internalAddress: 192.168.0.55, user: root, password: ABC@5wei}
  - {name: node1, address: 192.168.0.19, internalAddress: 192.168.0.19, user: root, password: ABC@5wei}
  - {name: node2, address: 192.168.0.79, internalAddress: 192.168.0.79, user: root, password: ABC@5wei}
  - {name: node3, address: 192.168.0.112, internalAddress: 192.168.0.112, user: root, password: ABC@5wei}
  roleGroups:
    etcd:
    - master[1:2]
    master: 
    - master[1:2]
    worker:
    - node1
    - node2
    - node3
  kubernetes:
    version: v1.17.9
    imageRepo: kubesphere
    clusterName: cluster.local
  network:
    plugin: calico
    kubePodsCIDR: 10.233.64.0/18
    kubeServiceCIDR: 10.233.0.0/18
  registry:
    registryMirrors: ["https://*.mirror.aliyuncs.com"]
    insecureRegistries: []
  addons: 
  - name: nfs-client
    namespace: kube-system
    sources:
      chart:
        name: nfs-client-provisioner
        repo: https://charts.kubesphere.io/main
        values: 
        - nfs.server=sfs-nas1.cn-north-1b.myhuaweicloud.com
        - nfs.path=/mnt/NFS/DEV
        - storageClass.defaultClass=true
​
​
---
apiVersion: installer.kubesphere.io/v1alpha1
kind: ClusterConfiguration
metadata:
  name: ks-installer
  namespace: kubesphere-system
  labels:
    version: v3.0.0
spec:
  local_registry: ""
  persistence:
    storageClass: ""
  authentication:
    jwtSecret: ""
  etcd:
    monitoring: true
    endpointIps: 192.168.0.208,192.168.0.55
    port: 2379
    tlsEnable: true
  common:
    es:
      elasticsearchDataVolumeSize: 20Gi
      elasticsearchMasterVolumeSize: 4Gi
      elkPrefix: logstash
      logMaxAge: 7
    mysqlVolumeSize: 20Gi
    minioVolumeSize: 20Gi
    etcdVolumeSize: 20Gi
    openldapVolumeSize: 2Gi
    redisVolumSize: 2Gi
  console:
    enableMultiLogin: false  # enable/disable multi login
    port: 30880
  alerting:
    enabled: true
  auditing:
    enabled: true
  devops:
    enabled: true
    jenkinsMemoryLim: 2Gi
    jenkinsMemoryReq: 1500Mi
    jenkinsVolumeSize: 8Gi
    jenkinsJavaOpts_Xms: 512m
    jenkinsJavaOpts_Xmx: 512m
    jenkinsJavaOpts_MaxRAM: 2g
  events:
    enabled: true
    ruler:
      enabled: true
      replicas: 2
  logging:
    enabled: true
    logsidecarReplicas: 2
  metrics_server:
    enabled: true
  monitoring:
    prometheusMemoryRequest: 400Mi
    prometheusVolumeSize: 20Gi
  multicluster:
    clusterRole: none  # host | member | none
  networkpolicy:
    enabled: true
  notification:
    enabled: true
  openpitrix:
    enabled: true
  servicemesh:
    enabled: true

使用KubeKey执行安装

执行以下指令

./kk create cluster -f master-HA.yaml

等待安装完成...

安装完成后的检查

执行以下语句进行组件安装检查

kubectl logs -n kubesphere-system $(kubectl get pod -n kubesphere-system -l app=ks-install -o jsonpath='{.items[0].metadata.name}') -f