Doris on K8s部署

置顶 已于 2023-12-22 14:50:01 修改
阅读量1.6k 收藏 25
点赞数 26
分类专栏： Doris On Kubernetes 文章标签： kubernetes 容器 云原生 数据仓库 大数据
于 2023-11-23 10:02:53 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/jwandbj/article/details/134568179
版权

拉取doris的镜像：

docker pull apache/doris:2.0.0_alpha-be-x86_64

docker pull apache/doris:2.0.0_alpha-fe-x86_64

先创建doris_be.yaml的文件，如果部署的时候提示这个错误“error: error validating "doris_be.yml": error validating data: invalid object to validate; if you choose to ignore these errors, turn validation off with --validate=false”可以试用Validate YAML - Online YAML Tools这个来检查yaml文件的格式，看哪里需要修改。

apiVersion: v1
kind: Service
metadata:
  name: doris-be-cluster1
  labels:
    app: doris-be-cluster1
spec:
  ports:
  - port: 9060
    name: be-port
  - port: 8040
    name: webserver-port
  - port: 9050
    name: heartbeat-port #This name should be fixed. Doris will get the port information through this name
  - port: 8060
    name: brpc-port
  clusterIP: None
  selector:
    app: doris-be-cluster1
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: doris-be-cluster1
  labels:
    app: doris-be-cluster1
spec:
  selector:
    matchLabels:
      app: doris-be-cluster1
  serviceName: doris-be-cluster1
  replicas: 3
  template:
    metadata:
      name: doris-be-cluster1
      labels:
        app: doris-be-cluster1
    spec:
      nodeSelector:
        tag: bigdata
    	initContainers:
      - command:
        - sh
        - -c
        - sysctl -w vm.max_map_count=2000000
        image: apache/doris:2.0.0_alpha-be-x86_64
        imagePullPolicy: IfNotPresent
        name: sysctl
        resources: {}
        securityContext:
          privileged: true
      containers:
      - name: doris-be-cluster1
        #Need to change to real mirror information
        #image: apache-doris-be:test
        # 修改点1： 镜像地址修改为真实doris镜像，可在https://hub.docker.com/r/apache/doris/tags找到需要的镜像版本
        image: apache/doris:2.0.0_alpha-be-x86_64
        imagePullPolicy: IfNotPresent
        env:
        #Specify the startup type as k8s to bypass some restrictions of the official image initialization script
        - name: BUILD_TYPE
          value: "k8s"
          # 修改点2： 增加环境变量，写明FE的IP与端口
        - name: FE_MASTER_IP
          value: "doris-follower-cluster1-0.doris-follower-cluster1.doris.svc.cluster.local"
        - name: FE_MASTER_PORT
          value: "9030"
        ports: 
        - containerPort: 9060
          name: be-port
        - containerPort: 8040
          name: webserver-port
        - containerPort: 9050
          name: heartbeat-port
        - containerPort: 8060
          name: brpc-port
        volumeMounts:
        #Mount the configuration file in the way of configmap
        - name: conf
          mountPath: /opt/apache-doris/be/conf
          #Ifnot mounted, when enable_profile, error will be reported when querying the data from jdbc catalog
          #Error message: error setting certificate verify locations: CAfile:/etc/pki/tls/certs/ca-bundle.crt CApath: none
        - name: sys
          mountPath: /etc/pki
          # 修改点3： 挂载存储
          subPath: pki
          readOnly: true
          # 同修改点3
        - name: sys
          mountPath: /opt/apache-doris/be/storage
          subPath: storage
      volumes:
      - name: conf
        configMap:
          name: be-conf
      - name: sys
        # 修改点4：不使用hostpath，注释掉
            #hostPath:
            #path: /etc/pki
  # 修改点5： 增加存储配置，此处使用longhorn
  volumeClaimTemplates:
  - metadata:
      name: sys
    spec:
      storageClassName: local-path
      accessModes: [ "ReadWriteOnce" ]
      resources:
        requests:
          storage: 50Gi 
---
apiVersion: v1
kind: ConfigMap
metadata:
  name: be-conf
data:
  be.conf: |
    PPROF_TMPDIR="$DORIS_HOME/log/"
    sys_log_level = INFO

    be_port = 9060
    webserver_port = 8040
    heartbeat_service_port = 9050
    brpc_port = 8060

    # 修改点6： 修改网段为k8s使用网段，配置数据存储路径
    priority_networks = 10.42.0.0/16
    storage_root_path = /opt/apache-doris/be/storage

然后创建doris_follower.yml文件

# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements.  See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership.  The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License.  You may obtain a copy of the License at
#
#   http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied.  See the License for the
# specific language governing permissions and limitations
# under the License.

apiVersion: v1
kind: Service
metadata:
  name: doris-follower-cluster1
  labels:
    app: doris-follower-cluster1
spec:
  ports:
    - port: 8030
      name: http-port
    - port: 9020
      name: rpc-port
    - port: 9030
      name: query-port
    - port: 9010
      name: edit-log-port #This name should be fixed. Doris will get the port information through this name
  clusterIP: None
  selector:
    app: doris-follower-cluster1
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: doris-follower-cluster1
  labels:
    app: doris-follower-cluster1
spec:
  selector:
    matchLabels:
      app: doris-follower-cluster1
  serviceName: doris-follower-cluster1
  # 修改点1： 修改fe副本为1
  replicas: 1
  template:
    metadata:
      name: doris-follower-cluster1
      labels:
        app: doris-follower-cluster1
    spec:
      nodeSelector:
        tag: bigdata
      containers:
        - name: doris-follower-cluster1
          #Need to change to real mirror information
          # 修改点2： 镜像地址修改为真实doris镜像，可在https://hub.docker.com/r/apache/doris/tags找到需要的镜像版本
          image: apache/doris:2.0.0_alpha-fe-x86_64
          imagePullPolicy: IfNotPresent
          env:
            # 修改点3： 增加了APP_NAMESPACE与FE_IPADDRESS环境变量
            - name: APP_NAMESPACE
              valueFrom:
                fieldRef:
                  fieldPath: metadata.namespace
            - name: FE_IPADDRESS
              valueFrom:
                fieldRef:
                  fieldPath: status.podIP
            #Specify the startup type as k8s to bypass some restrictions of the official image initialization script
            - name: BUILD_TYPE
              value: "k8s"
            #Initialize the fe of three nodes
            - name: FE_INIT_NUMBER
            # 修改点4： 将数量改为1
              value: "1"
            #ServiceName of bakend_cn node,（if do not have bakend_cn node,do not configure this environment variable）
            # 修改点5： 不使用cn节点，注释变量CN_SERVICE  CN_STATEFULSET
            #- name: CN_SERVICE
            #  value: "doris-cn-cluster1"
            #StatefulSetName of bakend_cn node,（if do not have bakend_cn node,do not configure this environment variable)
            #- name: CN_STATEFULSET
            #  value: "doris-cn-cluster1"
            #ServiceName of bakend node,（if do not have bakend node,do not configure this environment variable）
            - name: BE_SERVICE
              value: "doris-be-cluster1"
            #StatefulSetName of bakend node,（if do not have bakend node,do not configure this environment variable)
            - name: BE_STATEFULSET
              value: "doris-be-cluster1"
            #ServiceName of follower node,（if do not have follower node,do not configure this environment variable）
            - name: FE_SERVICE
              value: "doris-follower-cluster1"
            ##StatefulSetName of follower node,（if do not have follower node,do not configure this environment variable)
            - name: FE_STATEFULSET
              value: "doris-follower-cluster1"
          ports:
            - containerPort: 8030
              name: http-port
            - containerPort: 9020
              name: rpc-port
            - containerPort: 9030
              name: query-port
            - containerPort: 9010
              name: edit-log-port
          volumeMounts:
            #Mount the configuration file in the way of configmap
            - name: conf
              mountPath: /opt/apache-doris/fe/conf
              #In order to call the api of k8s
            - name: kube
            # 使用本地配置则为/root/.kube/config
              mountPath: /root/.kube
              readOnly: true
            # 修改点6： 配置存储，用于元数据持久化
            - name: metadata
              mountPath: /opt/apache-doris/fe/doris-meta
      volumes:
        - name: conf
          configMap:
            name: follower-conf
        - name: kube
        # 修改点7： 修改为使用configMap(此处可以不修改，使用本地配置)
          #hostPath:
            #path: /root/.kube/config
          configMap:
            name: kube-conf
  # 修改点8： 增加存储配置，此处使用longhorn
  volumeClaimTemplates:
  - metadata:
      name: metadata
    spec:
      storageClassName: local-path
      accessModes: [ "ReadWriteOnce" ]
      resources:
        requests:
          storage: 10Gi
---
apiVersion: v1
kind: ConfigMap
metadata:
  name: follower-conf
data:
  fe.conf: |
    # 修改点9： 修改网段为k8s使用网段
    priority_networks = 10.42.0.0/16
    #It can automatically maintain node information by getting the number of replicas of StatefulSet, similar to alter system add/drop back
    enable_deploy_manager = k8s
    #Automatically adjust the IP of the node according to the domain name (for example, after the pod is restarted, the domain name is still doris-be-cluster1-0-doris-be-cluster1.default.svc.cluster.local, but the IP may change from 172.16.0.9 to 172.16.0.10)
    enable_fqdn_mode = true
    LOG_DIR = ${DORIS_HOME}/log
    sys_log_level = INFO
    http_port = 8030
    rpc_port = 9020
    query_port = 9030
    edit_log_port = 9010
    #Doris needs to generate the log4j configuration file according to the fe.yml configuration information, which is written in the same directory as fe.yml by default, but the config we mount is readonly, so specify this configuration to write the log4j file to another location
    custom_config_dir = /opt/apache-doris/
    #when set to false, the backend will not be dropped and remaining in DECOMMISSION state
    drop_backend_after_decommission = false
    # 修改点10： 增加元数据、java等配置
    mysql_service_nio_enabled = true
    JAVA_OPTS = "-Xmx8192m -XX:+UseMembar -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=7 -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:+CMSClassUnloadingEnabled -XX:-CMSParallelRemarkEnabled -XX:CMSInitiatingOccupancyFraction=80 -XX:SoftRefLRUPolicyMSPerMB=0 -Xloggc:$DORIS_HOME/log/fe.gc.log.$DATE"
    JAVA_OPTS_FOR_JDK_9 = "-Xmx8192m -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=7 -XX:+CMSClassUnloadingEnabled -XX:-CMSParalle=80 -XX:SoftRefLRUPolicyMSPerMB=0 -Xlog:gc*:$DORIS_HOME/log/fe.gc.log.$DATE:time"
    meta_dir = /opt/apache-doris/fe/doris-meta
    #metadata_failure_recovery = true
---
# 修改点11： 增加kube config的configmap（此处可不修改，直接使用本地节点配置）
apiVersion: v1
kind: ConfigMap
metadata:
  name: kube-conf
data:
  config: |
    # 此处内容复制配置文件内容，如果server地址指向的为127.0.0.1，注意修改为实际节点IP
    # 一般为 /root/.kube/config 内容， rancher安装的rke2环境默认为/etc/rancher/rke2/rke2.yaml

然后创建doris-svc.yaml文件

apiVersion: v1
kind: Service
metadata:
  name: doris-svc
  namespace: doris
spec:
  type: NodePort
  ports:
    - port: 8030
      nodePort: 30803
      name: "p8030"
    - port: 9030
      nodePort: 30903
      name: "p9030"
  selector:
    app: doris-follower-cluster1

最后部署

#先创建命名空间
kubectl create ns doris
#然后部署be三个副本
kubectl apply -f doris_be.yml -n doris
#再部署一个fe
kubectl apply -f doris_follower.yml -n doris
#最后创建一个外部访问的服务svc
kubectl apply -f doris-svc.yaml -n doris

如果需要删除这些，使用kubectl get deploy xxx -n doris是找不到的，因为kubernetes部署分为两种，一种是有状态的使用“sts”,无状态的使用“deployment”

所以查找doris的需要使用下面的语句才能查找到：

kubect get sts -n doris

删除的时候使用如下语句：

kubectl delete sts doris-follower-cluster1 -n doris

通过查看pod的日志： kubectl -n doris logs -f doris-follower-cluster1-0 ,提示需要证书certification

解决上面的问题需要在spec:containers:env下面加上

KUBERNETES_TRUST_CERTIFICATES:"true" ，

KUBERNETES_DISABLE_HOSTNAME_VERIFICATION:"true"

查看k8s上yaml的文件：

第一步先kubectl get po -n doris，查看pod名称

通过验证，最终正确的doris_be.yaml

apiVersion: v1
kind: Service
metadata:
  name: doris-be-cluster1
  labels:
    app: doris-be-cluster1
spec:
  ports:
  - port: 9060
    name: be-port
  - port: 8040
    name: webserver-port
  - port: 9050
    name: heartbeat-port #This name should be fixed. Doris will get the port information through this name
  - port: 8060
    name: brpc-port
  clusterIP: None
  selector:
    app: doris-be-cluster1
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: doris-be-cluster1
  labels:
    app: doris-be-cluster1
spec:
  selector:
    matchLabels:
      app: doris-be-cluster1
  serviceName: doris-be-cluster1
  replicas: 3
  template:
    metadata:
      name: doris-be-cluster1
      labels:
        app: doris-be-cluster1
    spec:
      nodeSelector:
        tag: bigdata
        initContainers:
      - command:
        - sh
        - -c
        - sysctl -w vm.max_map_count=2000000
        image: apache/doris:2.0.0_alpha-be-x86_64
        imagePullPolicy: IfNotPresent
        name: sysctl
        resources: {}
        securityContext:
          privileged: true
      containers:
      - name: doris-be-cluster1
        #Need to change to real mirror information
        #image: apache-doris-be:test
        # 修改点1： 镜像地址修改为真实doris镜像，可在https://hub.docker.com/r/apache/doris/tags找到需要的镜像版本
        image: apache/doris:2.0.0_alpha-be-x86_64
        imagePullPolicy: IfNotPresent
        env:
        #Specify the startup type as k8s to bypass some restrictions of the official image initialization script
        - name: BUILD_TYPE
          value: "k8s"
          # 修改点2： 增加环境变量，写明FE的IP与端口
        - name: FE_MASTER_IP
          value: "doris-follower-cluster1-0.doris-follower-cluster1.doris.svc.cluster.local"
        - name: FE_MASTER_PORT
          value: "9030"
        ports: 
        - containerPort: 9060
          name: be-port
        - containerPort: 8040
          name: webserver-port
        - containerPort: 9050
          name: heartbeat-port
        - containerPort: 8060
          name: brpc-port
        volumeMounts:
        #Mount the configuration file in the way of configmap
        - name: conf
          mountPath: /opt/apache-doris/be/conf
          #Ifnot mounted, when enable_profile, error will be reported when querying the data from jdbc catalog
          #Error message: error setting certificate verify locations: CAfile:/etc/pki/tls/certs/ca-bundle.crt CApath: none
        - name: sys
          mountPath: /etc/pki
          # 修改点3： 挂载存储
          subPath: pki
          readOnly: true
          # 同修改点3
        - name: sys
          mountPath: /opt/apache-doris/be/storage
          subPath: storage
      volumes:
      - name: conf
        configMap:
          name: be-conf
      - name: sys
        # 修改点4：不使用hostpath，注释掉
            #hostPath:
            #path: /etc/pki
  # 修改点5： 增加存储配置，此处使用longhorn
  volumeClaimTemplates:
  - metadata:
      name: sys
    spec:
      storageClassName: local-path
      accessModes: [ "ReadWriteOnce" ]
      resources:
        requests:
          storage: 50Gi 
---
apiVersion: v1
kind: ConfigMap
metadata:
  name: be-conf
data:
  be.conf: |
    PPROF_TMPDIR="$DORIS_HOME/log/"
    sys_log_level = INFO

    be_port = 9060
    webserver_port = 8040
    heartbeat_service_port = 9050
    brpc_port = 8060

    # 修改点6： 修改网段为k8s使用网段，配置数据存储路径
    priority_networks = 10.42.0.0/16
    storage_root_path = /opt/apache-doris/be/storage

最终正确的doris_follower.yaml。最后一段注释掉，因为使用了serviceaccount，所以访问k8s的时候直接使用serviceaccount的，不需要配置.kube/config

# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements.  See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership.  The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License.  You may obtain a copy of the License at
#
#   http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied.  See the License for the
# specific language governing permissions and limitations
# under the License.

apiVersion: v1
kind: Service
metadata:
  name: doris-follower-cluster1
  labels:
    app: doris-follower-cluster1
spec:
  ports:
    - port: 8030
      name: http-port
    - port: 9020
      name: rpc-port
    - port: 9030
      name: query-port
    - port: 9010
      name: edit-log-port #This name should be fixed. Doris will get the port information through this name
  clusterIP: None
  selector:
    app: doris-follower-cluster1
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: doris-follower-cluster1
  labels:
    app: doris-follower-cluster1
spec:
  selector:
    matchLabels:
      app: doris-follower-cluster1
  serviceName: doris-follower-cluster1
  # 修改点1： 修改fe副本为1
  replicas: 1
  template:
    metadata:
      name: doris-follower-cluster1
      labels:
        app: doris-follower-cluster1
    spec:
      serviceAccountName: doris
      nodeSelector:
        tag: bigdata
      containers:
        - name: doris-follower-cluster1
          #Need to change to real mirror information
          # 修改点2： 镜像地址修改为真实doris镜像，可在https://hub.docker.com/r/apache/doris/tags找到需要的镜像版本
          image: apache/doris:2.0.0_alpha-fe-x86_64
          imagePullPolicy: IfNotPresent
          env:
            # 修改点3： 增加了APP_NAMESPACE与FE_IPADDRESS环境变量
            - name: APP_NAMESPACE
              valueFrom:
                fieldRef:
                  fieldPath: metadata.namespace
            - name: FE_IPADDRESS
              valueFrom:
                fieldRef:
                  fieldPath: status.podIP
            #Specify the startup type as k8s to bypass some restrictions of the official image initialization script
            - name: BUILD_TYPE
              value: "k8s"
            #Initialize the fe of three nodes
            - name: FE_INIT_NUMBER
            # 修改点4： 将数量改为1
              value: "1"
            #ServiceName of bakend_cn node,（if do not have bakend_cn node,do not configure this environment variable）
            # 修改点5： 不使用cn节点，注释变量CN_SERVICE  CN_STATEFULSET
            #- name: CN_SERVICE
            #  value: "doris-cn-cluster1"
            #StatefulSetName of bakend_cn node,（if do not have bakend_cn node,do not configure this environment variable)
            #- name: CN_STATEFULSET
            #  value: "doris-cn-cluster1"
            #ServiceName of bakend node,（if do not have bakend node,do not configure this environment variable）
            - name: BE_SERVICE
              value: "doris-be-cluster1"
            #StatefulSetName of bakend node,（if do not have bakend node,do not configure this environment variable)
            - name: BE_STATEFULSET
              value: "doris-be-cluster1"
            #ServiceName of follower node,（if do not have follower node,do not configure this environment variable）
            - name: FE_SERVICE
              value: "doris-follower-cluster1"
            ##StatefulSetName of follower node,（if do not have follower node,do not configure this environment variable)
            - name: FE_STATEFULSET
              value: "doris-follower-cluster1"
            - name: KUBERNETES_TRUST_CERTIFICATES
              value: "true"
            - name: KUBERNETES_DISABLE_HOSTNAME_VERIFICATION
              value: "true"
          ports:
            - containerPort: 8030
              name: http-port
            - containerPort: 9020
              name: rpc-port
            - containerPort: 9030
              name: query-port
            - containerPort: 9010
              name: edit-log-port
          volumeMounts:
            #Mount the configuration file in the way of configmap
            - name: conf
              mountPath: /opt/apache-doris/fe/conf
              #In order to call the api of k8s
            # 修改点6： 配置存储，用于元数据持久化
            - name: metadata
              mountPath: /opt/apache-doris/fe/doris-meta
      volumes:
        - name: conf
          configMap:
            name: follower-conf
  # 修改点8： 增加存储配置，此处使用longhorn
  volumeClaimTemplates:
  - metadata:
      name: metadata
    spec:
      storageClassName: csi-disk
      accessModes: [ "ReadWriteOnce" ]
      resources:
        requests:
          storage: 10Gi
---
apiVersion: v1
kind: ConfigMap
metadata:
  name: follower-conf
data:
  fe.conf: |
    # 修改点9： 修改网段为k8s使用网段
    priority_networks = 172.31.0.0/16
    #It can automatically maintain node information by getting the number of replicas of StatefulSet, similar to alter system add/drop back
    enable_deploy_manager = k8s
    #Automatically adjust the IP of the node according to the domain name (for example, after the pod is restarted, the domain name is still doris-be-cluster1-0-doris-be-cluster1.default.svc.cluster.local, but the IP may change from 172.16.0.9 to 172.16.0.10)
    enable_fqdn_mode = true
    LOG_DIR = ${DORIS_HOME}/log
    sys_log_level = INFO
    http_port = 8030
    rpc_port = 9020
    query_port = 9030
    edit_log_port = 9010
    #Doris needs to generate the log4j configuration file according to the fe.yml configuration information, which is written in the same directory as fe.yml by default, but the config we mount is readonly, so specify this configuration to write the log4j file to another location
    custom_config_dir = /opt/apache-doris/
    #when set to false, the backend will not be dropped and remaining in DECOMMISSION state
    drop_backend_after_decommission = false
    # 修改点10： 增加元数据、java等配置
    mysql_service_nio_enabled = true
    JAVA_OPTS = "-Xmx8192m -XX:+UseMembar -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=7 -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:+CMSClassUnloadingEnabled -XX:-CMSParallelRemarkEnabled -XX:CMSInitiatingOccupancyFraction=80 -XX:SoftRefLRUPolicyMSPerMB=0 -Xloggc:$DORIS_HOME/log/fe.gc.log.$DATE"
    JAVA_OPTS_FOR_JDK_9 = "-Xmx8192m -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=7 -XX:+CMSClassUnloadingEnabled -XX:-CMSParalle=80 -XX:SoftRefLRUPolicyMSPerMB=0 -Xlog:gc*:$DORIS_HOME/log/fe.gc.log.$DATE:time"
    meta_dir = /opt/apache-doris/fe/doris-meta
    #metadata_failure_recovery = true
---
# 修改点11： 增加kube config的configmap（此处可不修改，直接使用本地节点配置）
#注释掉这段，因为使用了serviceaccount，所以访问k8s的时候直接使用serviceaccount的，
#不需要配置.kube/config
#apiVersion: v1
#kind: ConfigMap
#metadata:
#  name: kube-conf
#data:
#  config: |
    # 此处内容复制配置文件内容，如果server地址指向的为127.0.0.1，注意修改为实际节点IP
    # 一般为 /root/.kube/config 内容， rancher安装的rke2环境默认为/etc/rancher/rke2/rke2.yaml
 

doris能够正常访问，但是用代码跑的时候提示No doris FE is available

然后你通过网页登录没问题，通过postman请求也没有问题

需要定位问题，把doris的源码下载下来，找到RestService这个类

在这一行打上断点

发现是301重定向了。因为我们使用了APISIX作为边缘网关来跳转，这个时候需要再APISIX里面把https去掉就可以。

有问题加群聊：

jwandbj
关注
  • 26
    点赞
  • 踩
  • 25
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
doris阿里云K8s部署文档
08-30
doris通过阿里云K8s部署文档
k8ssandra：K8ssandra是用于Kubernetes的Apache Cassandra的开源发行版，包括API服务和操作工具
02-03
K8sandra 是易于管理，可用于生产环境的和，可用于 。 它建立在坚如磐石的开源项目的基础上，涵盖了Cassandra部署的交易和运营方面。 该项目以图表的集合形式分发。 随意分叉回购并做出贡献。 如果您要安装K8ssandra，请转到“指南”。 组件 K8ssandra由许多子图组成，每个子图代表K8ssandra堆栈中的一个组件。 默认安装集中在开发人员部署上，所有功能都已启用并配置为使用最少的资源运行。 这些组件中的许多组件都可以以集中方式独立部署。 以下是K8ssandra堆栈中的组件列表，以及指向相应项目的链接。 阿帕奇·卡桑德拉（Apache Cassandra） K8ss
使用Helm在Kubernetes部署DataEase（全组件模式）
范一刀的博客
06-16 765
此安装包支持选择部署模式：“精简模式” 和 “集群模式”；精简模式下仅部署dataease和MySQL，集群模式下将部署dataease、doris-fe、doris-be、kettle、mysql。 Doris在Kubernetes中的部署方式为 hostNetwork，PodIP 即节点 IP，如此可避免BE节点重启BEIP发生变化需重新ADD BACKEND，保证了Doris服务的连续性。............
K8S安装网络插件报错error: error validating “calico.yaml“: error validating data: invalid object to validate；
最新发布
weixin_57401160的博客
06-03 561
在我看完这段报错信息之后抱着侥幸心里输入了--validate=false。
doris on k8s 的安装部署
github_39319229的博客
06-27 2879
【代码】doris on k8s 的安装部署。
doris on k8s
zyz_Alvin的博客
06-02 1854
用于帮助读者快速在k8s集群中部署doris
Doris on K8s
千载春秋书风华的博客
01-13 474
以下以doris2.0.3版本为例。
K8s安装doris踩坑记录
小哲的无何有镜
11-14 725
官方文档： https://doris.apache.org/zh-CN/docs/install/k8s-deploy/整体流程：配置yml文件，k8s执行apply命令以官方文档为基础，进行修改。官方文档镜像拉取存在问题，直接拉取test会出现拉取异常。k8s对应的网络地址请修改为使用命令获取pod的CIDR参数–cluster-cidr如果您没有直接访问控制平面节点的权限，可以使用 kubectl 命令：使用命令启动fe。
Doris应用指南Doris
05-06
Doris应用指南Doris
apache doris 从部署到应用全解
06-27
在部署方面，Apache Doris 提供了多种方式，包括标准部署、Docker 部署以及 Kubernetes (K8s) 部署。对于开发者而言，可以通过构建 Docker Image 或者直接部署 Docker 集群来快速启动服务。同时，Doris 也支持在 ARM...
doris数据分析教程
04-08
│ 01-课程学习目标.mp4 │ 02-Doris的简介.mp4 │ 03-Doris的核心特性.mp4 │ 04-Doris的发展历程.mp4 ...│ 13-Doris的安装部署-Doris部署-前置介绍.mp4 因字数限制之列一部分目录，一共78节和相关配套资源
doris 0.15版本 安装包
01-26
已对doris 0.15版本进行了编译，可以直接使用此包进行 分发，修改配置文件，启动 如果需要积分或者校验码，可以去百度网盘中下载，地址如下： 链接：https://pan.baidu.com/s/1BA3ZRcfjj4-tVVZNUIw9Bw 提取码：...
doris operator部署Doris集群教程
神技圈子的博客
10-19 706
详细讲解了如何使用Doris operator来部署Doris集群
Apache Doris 入门教程03：使用Docker或Kubernetes部署Doris
sunjian286的专栏
07-02 2188
本文要介绍如何通过Docker或Kubernetes来构建和部署运行Doris集群
基于Doris的日志存储分析平台（Doris安装部署）
nick_huangzheng的博客
05-10 738
基于Doris的日志存储分析平台（Doris安装部署）
【云原生】Redis on k8s 编排部署讲解与实战操作
匠人精神，持之以恒！
11-05 920
Redis) 是一个由 Salvatore Sanfilippo 写的 key-value 存储系统，是跨平台的非关系型数据库。Redis有三种集群模式：主从模式，Sentinel（哨兵）模式，Cluster模式，这三种模式环境编排部署都会在本文章介绍与实战操作。Redis原理介绍与环境部署（主从模式、哨兵模式、集群模式）
error validating data: ValidationError(Deployment.spec): missing required field "selector" in io.k8s
qq_38359135的博客
05-07 7277
error: error validating data: ValidationError(Deployment.spec): missing required field “selector” in io.k8s.api.apps.v1.DeploymentSpec; if you choose to ignore these errors, turn validation off with ...
Docker部署Doris超详细图文教程
热门推荐
a805814077的博客
07-07 1万+
Windows/Linux下通过Docker安装Doris的超强攻略，安装不上来kan我！
[K8S] 使用yaml文件创建deployment踩坑(新手的小坑)
皮卡丘在充电
07-27 8423
虽然用过、修改过现成的yaml文件，但这个东西一次没纯手打真的不行！以下是一个非常简单且漏洞百出的yaml文件||| # WRONG example version 1 apiVersion: apps/v1 kind: Deployment metadata: name: nginx1 namespace:default spec: replicas: 3 selector: matchLabels: app: nginx2 template: meta
k8s安装doris
08-24
您好！对于在Kubernetes上安装Doris，您可以按照以下步骤进行操作： 1. 创建一个Kubernetes集群：您可以使用自己喜欢的工具（如kubeadm、kops、minikube等）来创建一个Kubernetes集群。 2. 部署Doris集群：根据您的需求，可以选择在Kubernetes上使用StatefulSet或者Deployment来部署Doris集群。这里以使用StatefulSet为例： - 首先，创建一个包含Doris所有组件的YAML文件（如doris.yaml），并配置相应的参数，包括副本数、资源配额、存储等。您可以参考Doris官方文档中的示例文件。 - 接下来，使用kubectl命令来创建Doris StatefulSet：kubectl apply -f doris.yaml - Kubernetes将自动创建并管理Doris集群的各个组件，包括Doris FE（Frontend）、BE（Backend）、MySQL元数据存储等。 3. 检查Doris集群状态：使用kubectl命令，您可以随时检查Doris集群的状态，确保所有的组件都已经成功启动。 4. 访问Doris集群：根据您的配置，您可以通过Service或者Ingress来访问Doris集群。您可以使用kubectl命令获取相应的访问地址，并使用Doris提供的客户端工具连接到集群。 请注意，以上是一个简单的概述，实际操作中还需要根据您的具体环境和需求进行适当的调整和配置。建议您参考Doris官方文档中提供的更详细的安装和配置指南。希望对您有所帮助！如有更多问题，请随时提问。

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值