持续集成JAVA_后台

最新推荐文章于 2024-05-29 15:55:44 发布

薯味

最新推荐文章于 2024-05-29 15:55:44 发布

阅读量238

点赞数

本文链接：https://blog.csdn.net/qq_42555061/article/details/115799512

版权

CICD_Docker镜像_Harbor仓库_Gitlab版本控制_K8s

Docker
将Dockerfile放在项目的根目录同级

FROM harbor1.wok.wistron.com.cn/baseimage/maven-jdk8:3.6.1 AS base

MAINTAINER pengfei ge

ENV APP_HOME=/usr/app

COPY target/*.jar ${APP_HOME}/app.jar

RUN chmod 777 ${APP_HOME}/app.jar

VOLUME /usr/app

EXPOSE 项目端口

WORKDIR ${APP_HOME}

ENTRYPOINT ["java","-jar","app.jar"]

Docker打包镜像命令

docker build -t 配置项目名:版本 . 注意后面有一个点

例子：

docker build -t test:0.1 .

Docker镜像暴露端口发布

docker run -p 需要暴露的端口:docker端口 -v -d 项目名:版本

例子：

docker run -p 8888:8103 -v -d test:0.1

Harbor1

Docker登录harbor1

docker login harbor1.wok.wistron.com.cn

Docker镜像打Tag将本地镜像打版本号

docker tag wok_dpm_api:1.0.1 harbor1.wok.wistron.com.cn/learn/wok_dpm_api:1.0.1

Docker镜像打Tag后推送到Harbor仓库

docker push harbor1.wok.wistron.com.cn/learn/wok_dpm_api:1.0.1

GitLab版本控制
需要配置CICD_文件——.gitlab-ci.yml、ci-funcs.sh
.gitlab-ci.yml 文件

 stages:
    - code_scan
    - test
    - setup
    - deploy
    - update
    - update-daily

vulnerability_scan:
    image: harbor1.wok.wistron.com.cn/baseimage/sonar-scanner-cli:4
    stage: code_scan
    tags:
        - docker01
    before_script:
        - if test "${SOURCEPJ}" != "true"; then echo "Not Source Code Project, exit ci."; exit 0; fi;
    script:
        - sonar-scanner -Dsonar.projectName=${PROJECT_NAME} -Dsonar.projectKey=${PROJECT_NAME} -Dsonar.sources=./ -Dsonar.host.url=${SONAR_URL} -Dsonar.scm.provider=git -Dsonar.login=${SONAR_TOKEN} -Dsonar.language=java -Dsonar.sourceEncoding=UTF-8 -Dsonar.java.binaries=./

auto_testing:
    image: harbor1.wok.wistron.com.cn/baseimage/maven-jdk8:3.6.1
    stage: test
    tags:
        - docker01
    before_script:
        - if test "${SOURCEPJ}" != "true"; then echo "Not Source Code Project, exit ci."; exit 0; fi;
        - mvn --version
    script:
        - echo "No Need Test!"
        - mvn clean package -DskipTests
    artifacts:
        paths:
            - target/
        when: on_success
        expire_in: 1 days

get_version:  #获取版本号
    only:     #允许执行的分支
        - master
        - Develop
        - /^fix-.*$/
        - schedules
    image: harbor1.wok.wistron.com.cn/baseimage/vc-tool:latest  #基础镜像
    stage: setup    
    tags:
        - docker01
    before_script:
        - . ci-funcs.sh
    script:
        - get_version
    artifacts:
        paths:
            - build-vars.sh
        when: always
        expire_in: 1 days

docker-build:  #发布
    image: harbor1.wok.wistron.com.cn/baseimage/vc-tool:latest
    stage: deploy
    tags:
        - docker01
    only:
        - master
        - Develop
        - /^fix-.*$/
    except:
        - schedules
    variables:
        GIT_SUBMODULE_STRATEGY: recursive
    before_script:
        - if test "${SOURCEPJ}" != "true"; then echo "Not Source Code Project, exit ci."; exit 0; fi;
        - source build-vars.sh
        - echo ${SYS_VER}
        - . ci-funcs.sh
    script:
        - docker_build
        - if test "${CI_COMMIT_REF_NAME}" != "master"; then docker rmi ${BUILD_IMAGE_NAME}:${SYS_VER} ; docker rmi ${HARBOR_URL}/${HARBOR_PROJECT}/${BUILD_IMAGE_NAME}:${SYS_VER}; fi;
    artifacts:
        paths:
          - build-vars-docker_build.sh
        when: always
        expire_in: 1 days

publish:
    image: harbor1.wok.wistron.com.cn/baseimage/vc-tool:latest
    stage: update
    tags:
        - docker01
    only:
        - master
        - Develop
        - /^fix-.*$/
    except:
        - schedules
    before_script:
        - export CI_JOB_TIMESTAMP=$(date +"%s")
        - |
            {
                source build-vars-docker_build.sh;
            } || {
                echo "No need to update."; 
                exit 0;
            }
        - echo ${SYS_VER}
        - . ci-funcs.sh
    script:
        - cd_update

publish-daily:
    image: harbor1.wok.wistron.com.cn/baseimage/vc-tool:latest
    stage: update-daily
    tags:
        - docker01
    only:
        - schedules
    before_script:
        - export CI_JOB_TIMESTAMP=$(date +"%s")
        - |
            {
                source build-vars.sh;
            } || {
                echo "No need to update."; 
                exit 0;
            }
        - echo ${SYS_VER}
        - . ci-funcs.sh
    script:
        - echo cd_update

ci-funcs.sh文件

ci-funcs.sh
 #!/bin/sh

# -----------------Main function------------------------

# Get version of current commit
# master: VER_M + (VER_S + 1)
# pre-production/production: trace parent commits to get version
# fix-: trace parent commits to get master version then create hotfix version
function get_version() {

    echo "Begin: get_version()"

    echo "1: Check inputs"

    # Check if Gitlab CI/CD variables been set.
    echo "1.1: Check Gitlab CI/CD vars"
    if ! check_vars "GITLAB_KEY" "${GITLAB_KEY}" ""; then exit 0; fi
    if ! check_vars "GITLAB_URL" "${GITLAB_URL}" ""; then exit 0; fi
    if ! check_vars "VER_M" "${VER_M}" ""; then exit 0; fi
    if ! check_vars "VER_S" "${VER_S}" ""; then exit 0; fi

    # Skip process if it's conflict commit
    echo "1.2: Check if it's conflict commit"
    current_commit=$(get_commit_info "${CI_COMMIT_SHORT_SHA}")
    conflict_commit=$(get_conflict_commit "${current_commit}")
    if test "$conflict_commit" != ""; then

      # Save version to file for artifact usage
      echo "export SYS_VER="NA";" >build-vars.sh

      # exit process
      echo "Skip process for conflict commit, exit"
      exit 0
    fi

    echo "End 1: Check pass."

    echo "2: Get branch"

    # Get current branch type (master, production, pre-production, or fix-)
    get_branch "${CI_COMMIT_REF_NAME}" branch

    echo "End 2: Branch: ${branch}"

    echo "3: Get version by branch"

    # Default version as NA
    version="NA"

    if test "${branch}" == "Develop"; then

        # New version: VER_M + (VER_S + 1)
        next_ver_s=$((${VER_S} + 1))
        version="${VER_M}${next_ver_s}"
        echo "New master version : $version"

    elif test "${branch}" == "fix-"; then

        # Get tags information from Gitlab API
        all_tags=$(get_tags)

        # Get version form existed tag (Deal with branch initial)
        get_existed_ver "${all_tags}" "${CI_COMMIT_SHORT_SHA}" version
        echo "current commit version: $version"

        # If there's no version on current commit, Get version from master (x.x.x)
        if test "${version}" == ""; then
          only_get_master="true"
          get_prior_ver "${all_tags}" "${CI_COMMIT_SHORT_SHA}" "$only_get_master" version
          echo "Parent master version: $version"
        fi

        # Get (count of version: x.x.x) to construct hotfix version
        hotfixver=$(jq -r 'map(select(.name | contains ($newVal))) | length' --arg newVal "$version" <<<"${all_tags}")

        # New hotfix version: x.x.x.x
        version=${version}.$((${hotfixver}))"-hotfix"
        echo "New hotfix version: $version"

    else

        # Get tags information from Gitlab API
        all_tags=$(get_tags)

        # Get version form existed tag (Deal with branch initial)
        get_existed_ver "${all_tags}" "${CI_COMMIT_SHORT_SHA}" version
        echo "current commit version: $version"

        # If there's no version on cuurent commit, Get version from master
        if test "${version}" == ""; then
            only_get_master="false"
            get_prior_ver "${all_tags}" "${CI_COMMIT_SHORT_SHA}" "$only_get_master" version
            echo "Parent version: $version"
        fi
    fi

    echo "End 3: version: ${version}"

    echo "4: Save version to file"

    # Save version to file for artifact usage
    echo "export SYS_VER=${version};" >build-vars.sh

    if test "${branch}" == "Develop"; then
        # Save VER_S to file for artifact usage
        echo "export SYS_VER_S=${next_ver_s};" >>build-vars.sh
    fi

    echo "End 4"

    echo "End: get_version()"
}

# Get Build & test docker image, then push to Harbor
# Develop/fix- of Source project: Build image by version
# others: No need to build image
function docker_build() {

    # Get SYS_VER from artifact: build-vars.sh
    version="${SYS_VER}"
    echo "(Input) Version: ${version}"

    # Get SYS_VER_S from artifact: build-vars.sh
    version_s="${SYS_VER_S}"
    if test "${version_s}" != ""; then echo "(Input) Version_s: ${version_s}"; fi

    echo "Begin: docker_build()"

    echo "1: Check input"

    # Check if Gitlab CI/CD variables been set.
    echo "1.1: Check Gitlab CI/CD vars"
    if ! check_vars "GITLAB_KEY" "${GITLAB_KEY}" ""; then exit 0; fi
    if ! check_vars "GITLAB_URL" "${GITLAB_URL}" ""; then exit 0; fi
    if ! check_vars "VERSION_FILE" "${VERSION_FILE}" ""; then exit 0; fi
    if ! check_vars "version" "${version}" ""; then exit 0; fi

    # Skip process if it's conflict commit
    echo "1.2: Check if it's conflict commit"
    current_commit=$(get_commit_info "${CI_COMMIT_SHORT_SHA}")
    conflict_commit=$(get_conflict_commit "${current_commit}")
    if test "$conflict_commit" != ""; then

      # Save version to file for artifact usage
      echo "export SYS_VER="NA";" >build-vars-docker_build.sh

      # exit process
      echo "Skip process for conflict commit, exit"
      exit 0
    fi

    echo "End 1: Check pass."

    echo "2: Get branch"

    # Get current branch type (master, production, pre-production, or fix-)
    get_branch "${CI_COMMIT_REF_NAME}" branch

    echo "End 2: Branch: ${branch}"

    echo "3: Define docker tag"

    # Define docker tag by branch
    get_docker_tag ${branch} tag

    echo "End3: Docker tag: ${tag}"

    echo "4. Save version to file"

    # Save version to file for artifact usage
    echo "export SYS_VER=${version};" >build-vars-docker_build.sh

    # Save version to file as version info. in container tmp remove
    # echo "${version}" > ${VERSION_FILE}

    echo "End 4"

    echo "5. Build and push image"

    if test "${branch}" == "master"; then

        # No need to build image for PRD
        echo "Skip Docker biuld and push for PRD"

    elif test "${branch}" == "daily"; then

        # No need to build image for QAS
        echo "Skip Docker biuld and push for QAS"

    elif test "${SOURCEPJ}" != "true"; then

        # No need to build image if it's not source project
        echo "Skip Docker biuld and push for non-source project"

    else

        # Check if Harbor related Gitlab CI/CD variables been set.
        echo "5.1: Check Harbor related Gitlab CI/CD vars and version_s"
        if ! check_vars "HARBOR_PROJECT" "${HARBOR_PROJECT}" ""; then exit 0; fi
        if ! check_vars "HARBOR_URL" "${HARBOR_URL}" ""; then exit 0; fi
        if ! check_vars "HARBOR_USER" "${HARBOR_USER}" ""; then exit 0; fi
        if ! check_vars "HARBOR_PASSWORD" "${HARBOR_PASSWORD}" ""; then exit 0; fi

        # Build & test Docker image
        echo "5.2: Create Docker image"
        create_image ${tag}

        # Push image to harbor
        echo "5.3: Push image to harbor"
        push_image ${tag}

        # Update version & tag to Gitlab CI/CD variables
        echo "5.4: Update Gitlab variables"
        update_git_version ${branch} ${version} ${version_s}
    fi

    echo "End 5"

    echo "End: docker_build()"
}

# Update Rancher settings
# Optional input $1: If custom K8S vars (true/false)
function cd_update() {

    # Get SYS_VER from artifact: build-vars-docker_build.sh
    version="${SYS_VER}"
    echo "(Input) Version: ${version}"

    # Get custom_k8s_vars flag from yml
    if test "${1}" == "true"; then
        custom_k8s_vars="true"
    else
        custom_k8s_vars="false"
    fi
    echo "(Input) custom_k8s_vars: ${custom_k8s_vars}"

    echo "Begin: cd_update()"

    echo "1: Check input"

    # Check if Gitlab CI/CD variables and version been set.
    echo "1.1: Check Gitlab CI/CD vars and version"
    if ! check_vars "GITLAB_KEY" "${GITLAB_KEY}" ""; then exit 0; fi
    if ! check_vars "BUILD_IMAGE_NAME" "${BUILD_IMAGE_NAME}" ""; then exit 0; fi
    if ! check_vars "HARBOR_URL" "${HARBOR_URL}" ""; then exit 0; fi
    if ! check_vars "HARBOR_PROJECT" "${HARBOR_PROJECT}" ""; then exit 0; fi
    if ! check_vars "version" "${version}" ""; then exit 0; fi

    # Skip process if it's conflict commit
    echo "1.2: Check if it's conflict commit"
    current_commit=$(get_commit_info "${CI_COMMIT_SHORT_SHA}")
    conflict_commit=$(get_conflict_commit "${current_commit}")
    if test "$conflict_commit" != ""; then
        echo "Skip process for conflict commit, exit"
        exit 0
    fi

    # Skip cd_update if version if NA
    echo "1.3: Check if it's NA version"
    if test "${version}" == "NA"; then
        echo "No New Version to update, exit"
        exit 0
    fi

    echo "End 1: Check pass."

    echo "2: Get branch"

    # Get current branch type (master, production, pre-production, or fix-)
    get_branch "${CI_COMMIT_REF_NAME}" branch

    echo "End 2: Branch: ${branch}"

    echo "3: Define K8S env. by branch"

    # If custom_k8s_vars is true, K8S related vars should be assigned before call cd_update()
    if test "${custom_k8s_vars}" != "true"; then

        # Set below K8S related vars: K8S_API, K8S_KEY, CFG_VERSION_RECORD, CONFIG_LATEST, LATEST_VAR, RECORD_VAR
        echo "Set K8S related vars by branch"
        set_k8s_vars ${branch}

    fi

    # Check if K8S related vars exists
    echo "Check K8S related vars"
    if ! check_vars "K8S_API" "${K8S_API}" ""; then exit 0; else echo "K8S_API: $K8S_API"; fi
    if ! check_vars "K8S_KEY" "${K8S_KEY}" ""; then exit 0; else echo "K8S_KEY: $K8S_KEY"; fi
    if ! check_vars "CFG_VERSION_RECORD" "${CFG_VERSION_RECORD}" ""; then exit 0; else echo "CFG_VERSION_RECORD: $CFG_VERSION_RECORD"; fi
    if ! check_vars "CONFIG_LATEST" "${CONFIG_LATEST}" ""; then exit 0; else echo "CONFIG_LATEST: $CONFIG_LATEST"; fi
    if ! check_vars "LATEST_VAR" "${LATEST_VAR}" ""; then exit 0; else echo "LATEST_VAR: $LATEST_VAR"; fi
    if ! check_vars "RECORD_VAR" "${RECORD_VAR}" ""; then exit 0; else echo "RECORD_VAR: $RECORD_VAR"; fi

    echo "End 3"

    echo "4: Get current K8s settings "

    pod_upgrade_body=$(curl -H "Authorization:${K8S_KEY}" -H "Content-Type:application/json" -X GET ${K8S_API})

    if test "${pod_upgrade_body}" == ""; then
        echo "Failed to get current K8S settings. Please check API and token."
        exit -1
    fi

    # Turn on if need to debug in detail
    # echo "pod_upgrade_body: ${pod_upgrade_body}"

    # Retrive K8S config, volume, and prior version
    echo "Get current K8S volumes settings"
    cfg=$(jq -r '.volumes' <<<$pod_upgrade_body)
    echo "cfg: $cfg"

    echo "Get current K8S volumeMounts settings"
    vol=$(jq -r '.containers[].volumeMounts' <<<$pod_upgrade_body)
    echo "vol: $vol"

    echo "Get prior version"
    prever=$(jq -r '.containers[0].image | split(":")[1]' <<<$pod_upgrade_body)
    echo "prever: $prever"


    # Turn on if need to debug in detail
    # echo "CFG_VERSION_RECORD: $CFG_VERSION_RECORD"

    echo "check if prior version exists in config record"
    is_version_exists=$(jq --arg key "${prever}" 'has($key)' <<<$CFG_VERSION_RECORD)
    echo "is_version_exists: $is_version_exists"

    echo "End 4"

    echo "5: Update config record/latest config to Gitlab"

    # Split piror version and judge if it's hotfix
    split_ver $prever pv1 pv2 pv3 pv4
    if test "${pv4}" == "0"; then
      hotfix_pre_ver="false";
    else
      hotfix_pre_ver="true";
    fi
    echo "prever: ${pv1}.${pv2}.${pv3}.${pv4}; hotifx:$hotfix_pre_ver"

    # Split current version and judge if it's hotfix
    split_ver $version v1 v2 v3 v4
    if test "${v4}" == "0"; then
      hotfix_current_ver="false";
    else
      hotfix_current_ver="true";
    fi
    echo "version: ${v1}.${v2}.${v3}.${v4}; hotifx:$hotfix_current_ver"

    if test "${hotfix_current_ver}" != "true"; then

      # Check prior version need to update to CONFIG_LATEST
      compare_version ${pv1} ${pv2} ${pv3} ${pv4} ${v1} ${v2} ${v3} ${v4} $is_version_exists is_update_latest_config
      echo "is_update_latest_config: $is_update_latest_config"

      if test "${is_update_latest_config}" == "true"; then

        # Update Latest config to Gitlab with current commit version
        echo "Update current version into latest config"
        update_latest_cfg $version "${cfg}" "${vol}"

      fi

    fi

    if test "${hotfix_pre_ver}" != "true"; then

      echo "Update prior version into config record"
      update_cfg_record $is_version_exists $prever "${cfg}" "${vol}"

    fi

    echo "6: Get latest config"
    if test "${hotfix_current_ver}" != "true"; then

      # 如不是hotfix，找LATEST，更新CONFIG
      ConfigCfg=$(jq '.cfg' <<<$CONFIG_LATEST)
      ConfigVol=$(jq '.vol' <<<$CONFIG_LATEST)

    else

      config_version="${v1}.${v2}.${v3}"
      echo "hotfix version: $version"
      echo "config version: $config_version"

      # 如是hotfix，只抓前三版本號，找RECORD的CONFIG
      ConfigCfg=$(jq --arg key "$config_version" '.[$key].cfg' <<<$CFG_VERSION_RECORD)
      ConfigVol=$(jq --arg key "$config_version" '.[$key].vol' <<<$CFG_VERSION_RECORD)

    fi

    echo "End 6"

    echo "-------------------------------------"
    echo $ConfigCfg
    echo "-------------------------------------"
    echo $ConfigVol
    echo "-------------------------------------"

    echo "7: Update to K8S"

    # prepare script
    pod_upgrade_body=$(jq '.annotations."cattle.io/timestamp"=$newVal' --arg newVal ${CI_JOB_TIMESTAMP} <<<"$pod_upgrade_body")
    pod_upgrade_body=$(jq '.containers[].image=$newVal' --arg newVal ${HARBOR_URL}/${HARBOR_PROJECT}/${BUILD_IMAGE_NAME}:${version} <<<"$pod_upgrade_body")
    #pod_upgrade_body=$(jq '.volumes=$newVal' --argjson newVal "${ConfigCfg}" <<<"$pod_upgrade_body")
    #pod_upgrade_body=$(jq '.containers[].volumeMounts=$newVal' --argjson newVal "${ConfigVol}" <<<"$pod_upgrade_body")

    # Turn on if need to debug in detail
    # echo "pod_upgrade_body: ${pod_upgrade_body}"

    # Update to K8S
    echo "${pod_upgrade_body}" >json.txt
    curl -H "Authorization:${K8S_KEY}" -H "Content-Type:application/json" -d "@json.txt" -X PUT ${K8S_API}

    echo "End 7"

    echo "End: cd_update()"

}

# ----------------- Sub function: Common ------------------------

# Check if variable been null
# Input $1: key of variable
# Input $2: value of variable
# Input $3: value to compare
function check_vars() {

    if test "${2}" == "${3}"; then
        echo "Check ${1} failed: value is ${3}"
        return 1
    else
        return 0
    fi
}

# Judge branch type of current commit
# Input $1: current commit branch name
# Ouput $2: branch type
function get_branch() {

    ref_name=${1}
    all_branchs=("master" "Develop" "feature" "fix-")

    if test "${CI_PIPELINE_SOURCE}" == "schedule"; then
        eval "$2=daily"
        return 0
    fi
    # defualt ref_name as branch type
    eval "$2=$1"

    for current_branch in "${all_branchs[@]}"
    do
        prefix="${ref_name/$current_branch*/$current_branch}"
        if test $prefix == $current_branch; then

            # Set branch type
            eval "$2=$prefix"
            break
        fi
    done

}

# Get current commit info
# Input $1: current commit id
function get_commit_info () {
    url=${GITLAB_URL}/api/v4/projects/${CI_PROJECT_ID}/repository/commits/$1
    echo $(curl --header "PRIVATE-TOKEN:${GITLAB_KEY}" ${url%$'\r'})
}

# Get conflict commit.
# Input $1: current commit info
function get_conflict_commit() {

  # If there's merge conflict, a reverse pipeline will be triggerd (ex production -> pre-production) before normal pipeline
  # Current check logic: If message contains "# Conflicts:"
  # Need future study for better ways to judge if it's reverse pipeline.
  echo $(jq -r 'select(.message|contains("# Conflicts:")) | .id' <<<"${1}")
}

# ----------------- Sub function: get_version ------------------------

# Get tags information from Gitlab API
# Ouput $1: tags info. from Gitlab API
function get_tags() {

    # Notice:
    # Latest 100 records should be enough.
    # Refers to below link to implement pagination if your project need more records.
    # Reference: https://docs.gitlab.com/ee/api/#pagination
    echo $(curl --header "PRIVATE-TOKEN:${GITLAB_KEY}" "${GITLAB_URL}/api/v4/projects/${CI_PROJECT_ID}/repository/tags?page=1&per_page=100")
}

# Get version form existed tag (Deal with branch initial)
# Input $1: tags info. from Gitlab API
# Input $2: current commit id
# Output $3: matched version in tags info.
function get_existed_ver() {
    eval "$3="$(jq -r 'map(select(.target | contains ($newVal))) | .[] .name' --arg newVal "$2" <<<"$1")""
}

# Get prior version for non-hofix branch
# Input $1: tags info. from Gitlab API
# Input $2: current commit id
# Input $3: If get master only.
# Output $4: matched version in tags info.
function get_prior_ver () {

    echo "Find Parent of $2"

    # Get current commit info from Gitlab API
    current_commit=$(get_commit_info "$2")

    # Get parent commit ids
    parent_commits_ids=$(jq -r '.parent_ids' <<< "${current_commit}")
    echo "parent_commits_ids: $parent_commits_ids"

    # Get last commit id index = lenght - 1
    last_commit_id_index=$(jq '. | length-1' <<<"${parent_commits_ids}")
    last_commit_id_index=${last_commit_id_index%$'\r'}
    echo "last_commit_id_index: $last_commit_id_index"

    # Return if there's no parent commit.
    if test "$last_commit_id_index" == "-1"; then
        echo "No parent commit. VER: NA"
        eval "$4="NA""
        return 0
    fi

    # Get conflict commit.
    conflict_commit=$(get_conflict_commit "${current_commit}")

    if test "$conflict_commit" != ""; then

      # If it's reverse pipeline triggerd by conflict, search first parent_commits_id, which means trace target history
      echo "Reverse pipeline. Trace first parent id (Target history)."
      parent_index=0

    else
      # If it's normal pipeline, search last parent_commits_id, which means trace source history
      echo "Normal pipeline. Trace last parent id (Source history)."
      parent_index=${last_commit_id_index}

    fi

    # Get last parent commit
    parent_commits_id=$(jq -r '.[$newVal|tonumber]' --arg newVal ${parent_index} <<<"${parent_commits_ids}")
    parent_commits_id=${parent_commits_id%$'\r'}
    echo "parent_commits_id: $parent_commits_id"

    # Get prior version
    if test "$3" == "true"; then
      # Get only master version
      parent_ver=$(jq -r 'map(select(.target | contains ($newVal))) | map(select(.name | contains ("hotfix-") | not)) | .[].name' --arg newVal "${parent_commits_id}" <<<"$1")
    else
      # Get master or hotfix version
      parent_ver=$(jq -r 'map(select(.target | contains ($newVal))) | .[].name' --arg newVal "${parent_commits_id}" <<<"$1")
    fi
    parent_ver=${parent_ver%$'\r'}
    echo "parent_ver: $parent_ver"

    # If parent commit has version, return it. Otherwise, keep tracing it's parent
    if test "${parent_ver}" == ""; then
        get_prior_ver "$1" "$parent_commits_id" "$3" parent_ver
    fi

    #return version
    eval "$4="${parent_ver}""
}

# ----------------- Sub function: docker_build ------------------------

# Define docker tag by branch
# Input $1: current branch
# Output $2: docker tag
function get_docker_tag() {

    if test "$1" == "Develop"; then

        # Assign tag as version
        eval $2=${version}

    elif test "${branch}" == "daily"; then

        # pre-production use master image instead of create it's own
        echo "QAS no need to build image."
        eval $2="NA"

    elif test "${branch}" == "master"; then

         # pre-production use master image instead of create it's own
        echo "PRD no need to build image."
        eval $2="NA"

    elif test "${branch}" == "fix-"; then

        # Assign tag as hotfix version
        eval $2=${version}
    fi
}

# Build & test Docker image
# Input $1: Docker image tag
function create_image() {

    # Build image
    echo "Build image"
    docker build -t ${BUILD_IMAGE_NAME}:${1} --rm=true .

    # Test image when goss.yaml exists
    if [ -f "goss.yaml" ]; then

        echo "Testing image..."

        if test "${TEST_PORT}" != ""; then

            echo "Port Working？"
            GOSS_FILES_STRATEGY=cp dgoss run -p ${TEST_PORT} ${BUILD_IMAGE_NAME}:${1}
        else

            echo "Job Running？"
            GOSS_FILES_STRATEGY=cp dgoss run ${BUILD_IMAGE_NAME}:${1}
        fi

        echo "Testing image OK"

    else
        echo "goss.yaml not exists. Skip image test."
    fi
}

# Push image to harbor
# Input $1: Docker image tag
function push_image() {

    #tag image
    echo "tag image"
    docker tag ${BUILD_IMAGE_NAME}:${1} ${HARBOR_URL}/${HARBOR_PROJECT}/${BUILD_IMAGE_NAME}:${1}

    echo "$HARBOR_PASSWORD" | docker login -u "$HARBOR_USER" --password-stdin ${HARBOR_URL}

    #push image
    echo "push image"
    docker push ${HARBOR_URL}/${HARBOR_PROJECT}/${BUILD_IMAGE_NAME}:${1}

}

# Update version & tag to Gitlab CI/CD variables
# Input $1: Branch of current commit (master, production, pre-production, fix)
# Input $2: version
# Input $3: small version (VER_S in Gitlab)
function update_git_version() {

    if test "${1}" == "Develop"; then

        echo "Develop: update VER_S & tag"

        # Block if small version not set
        if ! check_vars "version_s" "${3}" ""; then exit 0; fi

        # Update VER_S to Gitlab
        curl --request PUT --header "PRIVATE-TOKEN:${GITLAB_KEY}" "${GITLAB_URL}/api/v4/projects/${CI_PROJECT_ID}/variables/VER_S" --form "value=${3}"

        # Create tag by version to Gitlab
        curl --request POST --header "PRIVATE-TOKEN:${GITLAB_KEY}" "${GITLAB_URL}/api/v4/projects/${CI_PROJECT_ID}/repository/tags?tag_name=${2}&ref=${CI_COMMIT_REF_NAME}"

    elif test "${1}" == "fix-"; then

        echo "fix-: update tag"

        # Create tag by version to Gitlab
        curl --request POST --header "PRIVATE-TOKEN:${GITLAB_KEY}" "${GITLAB_URL}/api/v4/projects/${CI_PROJECT_ID}/repository/tags?tag_name=${2}&ref=${CI_COMMIT_REF_NAME}"

    else

        # No need to update due to there's no new version been created
        echo "${1}: No need to update"

    fi
}

# ----------------- Sub function: cd_update ------------------------

# Set K8S related vars by branch
# Global vars change: K8S_API, K8S_KEY, CFG_VERSION_RECORD, CONFIG_LATEST, LATEST_VAR, RECORD_VAR
function set_k8s_vars() {

    if test "${branch}" == "Develop"; then
        echo "update DEV Project"
        K8S_API=${K8S_DEV_API}
        K8S_KEY=${K8S_DEV_KEY}
        CFG_VERSION_RECORD=${CFG_RECORD_DEV}
        CONFIG_LATEST=${CFG_LATEST_DEV}
        LATEST_VAR="CFG_LATEST_DEV"
        RECORD_VAR="CFG_RECORD_DEV"

    elif test "${branch}" == "daily"; then
        echo "update QAS Project"
        K8S_API=${K8S_QAS_API}
        K8S_KEY=${K8S_QAS_KEY}
        CFG_VERSION_RECORD=${CFG_RECORD_QAS}
        CONFIG_LATEST=${CFG_LATEST_QAS}
        LATEST_VAR="CFG_LATEST_QAS"
        RECORD_VAR="CFG_RECORD_QAS"

    elif test "${branch}" == "fix-"; then
        echo "Hotfix!! update DEV Project"
        K8S_API=${K8S_DEV_API}
        K8S_KEY=${K8S_DEV_KEY}
        CFG_VERSION_RECORD=${CFG_RECORD_DEV}
        CONFIG_LATEST=${CFG_LATEST_DEV}
        LATEST_VAR="CFG_LATEST_DEV"
        RECORD_VAR="CFG_RECORD_DEV"

    elif test "${branch}" == "master"; then
        echo "update PRD Project"
        K8S_API=${K8S_PRD_API}
        K8S_KEY=${K8S_PRD_KEY}
        CFG_VERSION_RECORD=${CFG_RECORD_PRD}
        CONFIG_LATEST=${CFG_LATEST_PRD}
        LATEST_VAR="CFG_LATEST_PRD"
        RECORD_VAR="CFG_RECORD_PRD"

    else
        echo "No Need to update"
        exit 0
    fi
}

# Update Latest config to Gitlab
# Input $1: current commit version
# Inpit $2: current K8S volumes settings
# Inpit $3: current K8S volumesmounts settings
function update_latest_cfg() {

    # prepare json
    config_latest="{\"VER\":\"$version\",\"cfg\":$cfg,\"vol\":$vol}"
    echo "UPDATE LATEST: $config_latest"

    # update to Gitlab
    curl --request PUT --header "PRIVATE-TOKEN:${GITLAB_KEY}" "${GITLAB_URL}/api/v4/projects/${CI_PROJECT_ID}/variables/${LATEST_VAR}" --form "value=${config_latest}"
}

# Update Latest config to Gitlab
# Input $1: if prior version exists in config record
# Input $2: prior version
# Inpit $3: current K8S volumes settings
# Inpit $4: current K8S volumesmounts settings
function update_cfg_record() {
    # prepare json
    if test "$1" == "false"; then
        echo "Not exsit: Add new"
        CFG_VERSION_RECORD=$(jq --arg key "$2" --argjson value1 "${3}" --argjson value2 "${4}" '. * {($key):{vol:$value2,cfg:$value1}}' <<<$CFG_VERSION_RECORD)
    else
        echo "Exsit: Update"
        CFG_VERSION_RECORD=$(jq --arg key "$2" --argjson value "${3}" '.[$key].cfg=$value' <<<$CFG_VERSION_RECORD)
        CFG_VERSION_RECORD=$(jq --arg key "$2" --argjson value "${4}" '.[$key].vol=$value' <<<$CFG_VERSION_RECORD)

    fi
    echo "CFG_VERSION_RECORD: $CFG_VERSION_RECORD"

    # update to Gitlab
    curl --request PUT --header "PRIVATE-TOKEN:${GITLAB_KEY}" "${GITLAB_URL}/api/v4/projects/${CI_PROJECT_ID}/variables/${RECORD_VAR}" --form "value=${CFG_VERSION_RECORD}"
}

# Check if prior version
# Input 1~4: piror version
# Input 5~8: current commit version
# Input 9: if prior version exists in config record
# Output 10: if prior version need to update to latest config
function compare_version() {

    # Defualt as need to update to latest config
    eval "${10}="false""

    if test "${CONFIG_LATEST}" != ""; then

        echo "LATEST CONFIG EXIST!"
        newer="true"

      # versions to compare
      banchmark_vers=($1 $2 $3 $4)
      input_vers=($5 $6 $7 $8)

      # loop every element
      for i in $(seq 0 3)
      do
        if test "${input_vers[i]}" -lt "${banchmark_vers[i]}"; then

          # Quit when version input less then banchmark (Older verion)
          echo "Check $i: ${input_vers[i]} < ${banchmark_vers[i]}"
          newer="false"
          break

        elif test "${input_vers[i]}" -gt "${banchmark_vers[i]}"; then

          # Quit when version input greater then banchmark (Newer verion)
          echo "Check $i: : ${input_vers[i]} > ${banchmark_vers[i]}"
          newer="true"
          break

        else

          # Continue loop to compare small ver when input equal to banchmark
          echo "Check $i: : ${input_vers[i]} = ${banchmark_vers[i]}"

        fi
      done

      echo "newer: $newer"

      if test "$newer" == "true" && test "$9" == "false"; then
          echo "A Newer version"
          eval "${10}="true""
      fi

    else
        echo "NO LATEST CONFIG"
        # 不存在，表示是最新的
        eval "${10}="true""
    fi
}

# Split version
# Input $1: version
# Output $2: 1st element of version
# Output $3: 2nd element of version
# Output $4: 3rd element of version
# Output $5: 4th element of version
function split_ver() {

  current_ver=$1
  dash="-"

  if [[ $current_ver == *$dash* ]]; then
      current_ver="${current_ver/*$dash/$dash}"
      current_ver=${current_ver:1}
  fi

  # split value
  v1=$(jq -r 'split(".")[0]' <<<"\"$current_ver\"")  # "
  v2=$(jq -r 'split(".")[1]' <<<"\"$current_ver\"")  # "
  v3=$(jq -r 'split(".")[2]' <<<"\"$current_ver\"")  # "
  v4=$(jq -r 'split(".")[3]' <<<"\"$current_ver\"")  # "
  if test "${v4}" == "null"; then v4=0; fi

  # return value
  eval "$2=$v1"
  eval "$3=$v2"
  eval "$4=$v3"
  eval "$5=$v4"
}

配置CIDI变量
在这里插入图片描述

Variable
BUILD_IMAGE_NAME
wokdpmapi

Variable
CFG_LATEST_DEV
{"VER":"1.0.1","cfg":null,"vol":null}

Variable
CFG_LATEST_PRD
{"VER":"1.0.13","cfg":null,"vol":null}

Variable
CFG_RECORD_DEV
{
  "1.0.1": {
    "vol": null,
    "cfg": null
  }
}

Variable
CFG_RECORD_PRD
{
  "1.0.1": {
    "vol": null,
    "cfg": null
  }
}

Variable
custom_k8s_vars
true

Variable
GITLAB_KEY
8qJvg1G6nJdQtBQBFCna

Variable
GITLAB_URL
https://gitlab1.wok.wistron.com.cn


Variable
HARBOR_PASSWORD
Do_mes999.

Variable
HARBOR_PROJECT
library

Variable
HARBOR_URL
harbor1.wok.wistron.com.cn

Variable
HARBOR_USER
O0000573

Variable
K8S_DEV_API
https://k8sdev-wok.wistron.com.cn/v3/project/local:p-rkkrv/workloads/deployment:i4project:wokdpmapijavaqas

Variable
K8S_DEV_KEY
Bearer token-cxdsk:lt65r9ncrkhjwznmtw9hdjhzjx2hlsskctbswslftc24ptjbrr85wr

Variable
K8S_PRD_API
https://k8sdev-wok.wistron.com.cn/v3/project/local:p-rkkrv/workloads/deployment:i4project:wokdpmapijavaprd

Variable
K8S_PRD_KEY
Bearer token-cxdsk:lt65r9ncrkhjwznmtw9hdjhzjx2hlsskctbswslftc24ptjbrr85wr

Variable
PROJECT_NAME
wokdpmapi

Variable
SONAR_TOKEN
4149f223274f3d6eb51a291846feece67b4b3253

Variable
SONAR_URL
http://10.57.1.33:9000/

Variable
SOURCEPJ
true

Variable
TEST_PORT
8999

Variable
VER_M
1.0.

Variable
VER_S
2

Variable
VERSION_FILE
versionlog

K8S
第一步设置：Workloads

在这里插入图片描述

第二步设置：Load Balancing
在这里插入图片描述

第三部设置：Service Discovery

在这里插入图片描述

薯味

关注

0
点赞
踩
0

收藏

觉得还不错? 一键收藏
0
评论
持续集成JAVA_后台

**CICD_Docker镜像_Harbor仓库_Gitlab版本控制_K8sDocker将Dockerfile放在项目的根目录同级FROM harbor1.wok.wistron.com.cn/baseimage/maven-jdk8:3.6.1 AS baseMAINTAINER pengfei geENV APP_HOME=/usr/appCOPY target/*.jar ${APP_HOME}/app.jarRUN chmod 777 ${APP_HOME}/app.jar
复制链接

扫一扫