持续基础怎么搞？Jenkins+Docker+Git实战

在如今的互联网时代，随着软件开发复杂度的不断提高，软件开发和发布管理也越来越重要。目前已经形成一套标准的流程，最重要的组成部分就是持续集成（Continuous Integration，CI）及持续部署、交付（CD）。在此，我们来以一个案例初步了解 CI 流程。那么什么是 CI 呢？简单来讲，CI 就是将传统的代码合并、构建、部署、测试都集成在一起，不断地执行这个过程，并对结果进行反馈。

CI 流程设计图：

工作流程：

• 开发人员提交代码到Git版本仓库；

• Jenkins人工/定时触发项目构建；

• Jenkins拉取代码、代码编码、打包镜像、推送到镜像仓库；

• Jenkins在Docker主机创建容器并发布

主机环境规划：

• docker-jenkins：    10.0.0.98

• docker-git-harbor：10.0.0.99

01 部署Git代码版本仓库

安装：

[root@docker-git-harbor ~]# yum install git -y

配置git用户：

1. [root@docker-git-harbor ~]# useradd git

3. [root@docker-git-harbor ~]# passwd git

创建库：

1. [git@docker-git-harbor ~]$ mkdir tomcat-java-demo.git

3. [git@docker-git-harbor ~]$ cd tomcat-java-demo.git/

4. [git@docker-git-harbor tomcat-java-demo.git]$ git --bare init

5. Initialized empty Git repository in /home/git/tomcat-java-demo.git/

6. [git@docker-git-harbor tomcat-java-demo.git]$ ls

7. branches config description HEAD hooks info objects refs

8. [git@docker-git-harbor tomcat-java-demo.git]$

另一台docker-jenkins访问该仓库：

1. [root@docker-jenkins ~]# git clone git@10.0.0.99:/home/git/tomcat-java-demo.git

3. Cloning into 'solo'...

4. The authenticity of host '10.0.0.99 (10.0.0.99)' can't be established.

5. ECDSA key fingerprint is SHA256:XNWQhGsAsqd84k/6OYV3xl1+mPGjtASsxeV1YVLZVas.

6. ECDSA key fingerprint is MD5:b4:bd:16:2b:de:e7:7c:fd:c5:dd:91:75:20:ff:3e:0a.

7. Are you sure you want to continue connecting (yes/no)? yes

8. Warning: Permanently added '10.0.0.99' (ECDSA) to the list of known hosts.

9. git@10.0.0.99's password:

10. warning: You appear to have cloned an empty repository.

11. [root@docker-jenkins ~]# ls

12. anaconda-ks.cfg tomcat-java-demo.git

13. [root@docker-jenkins ~]# ls tomcat-java-demo.git

14. [root@docker-jenkins ~]#

模拟生产项目，拉取github上的一个demo，并上传至本地git库

1. [root@docker-jenkins ~]# mv tomcat-java-demo tomcat-java-demo.bak

3. [root@docker-jenkins ~]# git clone https://github.com/dingkai163/tomcat-java-demo.git

4. [root@docker-jenkins tomcat-java-demo]# cat .git/config

5. [core]

6. repositoryformatversion = 0

7. filemode = true

8. bare = false

9. logallrefupdates = true

10. [remote "origin"]

11. url = git@10.0.0.99:/home/git/tomcat-java-demo.git # 修改为本地的git库地址

12. fetch = +refs/heads/*:refs/remotes/origin/*

13. [branch "master"]

14. remote = origin

15. merge = refs/heads/master

16. [root@docker-jenkins tomcat-java-demo]# git add .

17. [root@docker-jenkins tomcat-java-demo]# git status

18. # On branch master

19. nothing to commit, working directory clean

20. [root@docker-jenkins tomcat-java-demo]# git commit -m "all"

21. # On branch master

22. nothing to commit, working directory clean

23. [root@docker-jenkins tomcat-java-demo]# git push origin master

24. git@10.0.0.99's password:

25. Counting objects: 229, done.

26. Compressing objects: 100% (185/185), done.

27. Writing objects: 100% (229/229), 4.52 MiB | 0 bytes/s, done.

28. Total 229 (delta 25), reused 229 (delta 25)

29. To git@10.0.0.99:/home/git/tomcat-java-demo.git

30. * [new branch] master -> master

31. [ root edocker-jenkina tomcat- j ava -demo]#

02 jenkins环境部署

部署jdk环境及maven

1. [root@docker-jenkins ~]# mkdir tools

3. [root@docker-jenkins ~]# cd tools

4. [root@docker-jenkins tools]# rz -y

5. [root@docker-jenkins tools]# tar zxvf jdk-8u45-linux-x64.tar.gz

6. [root@docker-jenkins tools]# mv jdk1.8.0_45 /usr/local/jdk

7. [root@docker-jenkins tools]# vim /etc/profile

8. JAVA_HOME=/usr/local/jdk

9. PATH=$PATH:$JAVA_HOME/bin CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

10. export JAVA_HOME PATH CLASSPATH

11. [root@docker-jenkins tools]# source /etc/profile

12. [root@docker-jenkins tools]# java -version

13. java version "1.8.0_45"

14. Java(TM) SE Runtime Environment (build 1.8.0_45-b14)

15. Java HotSpot(TM) 64-Bit Server VM (build 25.45-b02, mixed mode)

17. [root@docker-jenkins tools]# tar zxf apache-maven-3.5.0-bin.tar.gz

18. [root@docker-jenkins tools]# mv apache-maven-3.5.0 /usr/local/maven

在10.0.0.98主机安装Jenkins，下载Tomcat二进制包将war包到webapps下即可：

1. [root@docker-jenkins tools]# wget http://mirrors.jenkins.io/war-stable/latest/jenkins.war

3. [root@docker-jenkins tools]# wget http://mirrors.shu.edu.cn/apache/tomcat/tomcat-8/v8.5.38/bin/apache-tomcat-8.5.38.tar.gz

4. [root@docker-jenkins tools]# tar zxf apache-tomcat-8.5.38.tar.gz

5. [root@docker-jenkins tools]# ls

6. apache-tomcat-8.5.38 apache-tomcat-8.5.38.tar.gz jdk-8u45-linux-x64.tar.gz jenkins.war

7. [root@docker-jenkins tools]# mv apache-tomcat-8.5.38 /usr/local/tomcat-jenkins

8. [root@docker-jenkins tools]# ls /usr/local/tomcat-jenkins/webapps/

9. docs examples host-manager manager ROOT

10. [root@docker-jenkins tools]# rm -rf /usr/local/tomcat-jenkins/webapps/*

11. [root@docker-jenkins tools]# mv jenkins.war /usr/local/tomcat-jenkins/webapps/ROOT.war

12. [root@docker-jenkins tools]# ll /usr/local/tomcat-jenkins/webapps/

13. total 75520

14. -rw-r--r--. 1 root root 77330344 Mar 15 00:55 ROOT.war

15. [root@docker-jenkins tools]# cd /usr/local/tomcat-jenkins/bin/

16. [root@docker-jenkins bin]# ./startup.sh

17. Using CATALINA_BASE: /usr/local/tomcat-jenkins

18. Using CATALINA_HOME: /usr/local/tomcat-jenkins

19. Using CATALINA_TMPDIR: /usr/local/tomcat-jenkins/temp

20. Using JRE_HOME: /usr/local/jdk1.8

21. Using CLASSPATH: /usr/local/tomcat-jenkins/bin/bootstrap.jar:/usr/local/tomcat-jenkins/bin/tomcat-juli.jar

22. Tomcat started.

23. [root@docker-jenkins bin]#

启动后，浏览器访问http://10.0.0.98:8080/，按提示输入密码，登录即可。

03 部署私有镜像仓库

企业级harbor镜像仓库部署：

https://www.cnblogs.com/kaye/p/10524391.html

构建Tomcat基础镜像，并推送到harbor镜像库：

1. [root@docker-git-harbor ~]# cd tomcat

3. [root@docker-git-harbor tomcat]# cat Dockerfile-tomcat

4. FROM centos:7

5. MAINTAINER www.cnblogs.com/kaye/

7. ENV VERSION=8.5.38

9. RUN yum install java-1.8.0-openjdk wget curl unzip iproute net-tools -y && \

10. yum clean all && \

11. rm -rf /var/cache/yum/*

12. RUN wget http://mirrors.shu.edu.cn/apache/tomcat/tomcat-8/v${VERSION}/bin/apachetomcat-${VERSION}.tar.gz && \

13. tar zxf apache-tomcat-${VERSION}.tar.gz && \

14. mv apache-tomcat-${VERSION} /usr/local/tomcat && \

15. rm -rf apache-tomcat-${VERSION}.tar.gz /usr/local/tomcat/webapps/* && \

16. mkdir /usr/local/tomcat/webapps/test && \

17. echo "ok" > /usr/local/tomcat/webapps/test/status.html && \

18. sed -i '1a JAVA_OPTS="-Djava.security.egd=file:/dev/./urandom"' /usr/local/tomcat/bin/catalina.sh && \

19. ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

21. ENV PATH $PATH:/usr/local/tomcat/bin

23. EXPOSE 8080

24. CMD ["catalina.sh", "run"]

25. [root@docker-git-harbor tomcat]# docker build -t tomcat:v1 -f Dockerfile-tomcat .

26. [root@docker-git-harbor tomcat]# docker tag tomcat:v1 reg.dingkai.com/library/tomcat:v1

27. [root@docker-git-harbor tomcat]# docker login reg.dingkai.com

28. [root@docker-git-harbor tomcat]# docker push reg.dingkai.com/library/tomcat:v1

04 Jenkins安装必要插件

由于jenkins是离线安装，所有在此需要配置一下插件下载地址：系统管理-->插件管理-->Advanced

修改下方地址，将https修改为http 再点Submit

Submit后点击Available，Check now此时我们可以看到很多可获得插件

首先搜索并安装Pipeline插件
pipeline 是一套运行于jenkins上的工作流框架，将原本独立运行于单个或者多个节点的任务连接起来，实现单个任务难以完成的复杂流程编排与可视化。

再安装SCM to job 插件，同上步骤（搜索，安装）。

05 项目创建

创建jobs

选择流水线类型

到这里我们就开始配置Pipeline script，点击Pipeline语法，来自动生成我们需要的配置。

如下图，我们Git方式，配置Git仓库地址，再添加认证相关。

这里我们使用的是秘钥认证方式，需要将jenkins上生成的公钥发送到git服务器上，然后将jenkins上的生成的私钥内容粘贴到下图Key中，这样jenkins就可以免交互的拉取git仓库中的代码了。

1. [root@docker-jenkins bin]# ssh-keygen

3. Generating public/private rsa key pair.

4. Enter file in which to save the key (/root/.ssh/id_rsa):

5. Enter passphrase (empty for no passphrase):

6. Enter same passphrase again:

7. Your identification has been saved in /root/.ssh/id_rsa.

8. Your public key has been saved in /root/.ssh/id_rsa.pub.

9. The key fingerprint is:

10. SHA256:1vD8XM3lDYFmrxgAbwPTLwb0fl+oEx8cFgtykpg4ODI root@

12. docker-jenkins

14. The key's randomart image is:

15. +---[RSA 2048]----+

16. | . o==o.o ... |

17. |E o o +=++ .+o . |

18. | o . . .*o o+.. .|

19. | oo*oo o.=o|

20. | .S.*o+.o =|

21. | . ..B.+ |

22. | o = |

23. | . |

24. | |

25. +----[SHA256]-----+

26. [root@docker-jenkins bin]# cd

27. [root@docker-jenkins ~]#

28. [root@docker-jenkins ~]#

29. [root@docker-jenkins ~]# ls .ssh/

30. id_rsa id_rsa.pub known_hosts

31. [root@docker-jenkins ~]# ssh-copy-id git@10.0.0.99

32. /usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"

33. /usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed

34. /usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys

35. git@10.0.0.99's password:

37. Number of key(s) added: 1

39. Now try logging into the machine, with: "ssh 'git@10.0.0.99'"

40. and check to make sure that only the key(s) you wanted were added.

42. [root@docker-jenkins ~]#

配置完成后，我们就可以生成Pipeline脚本了。点击下方Generate Pipeline Script，然后复制方框内的内容。

编写我们所需要的Pipeline脚本如下，将其粘贴到script的拉取代码模块中，并修改分支master为${branch}，其他模块内容自行编写。

1. node {

3. // 拉取代码 stage('Git Checkout') {

4. checkout([$class: 'GitSCM', branches: [[name: '${branch}']], doGenerateSubmoduleConfigurations: false, extensions: [], submoduleCfg: [], userRemoteConfigs: [[credentialsId: 'c42214eb-db1e-49fb-83c9-f78d1f4310a2', url: 'git@10.0.0.99:/home/git/tomcat-java-demo.git']]])

5. } // 代码编译 stage('Maven Build') {

6. sh '''

8. export JAVA_HOME=/usr/local/jdk

9. /usr/local/maven/bin/mvn clean package -Dmaven.test.skip=true ''' } // 项目打包到镜像并推送到镜像仓库

11. /usr/local/maven/bin/mvn clean package -Dmaven.test.skip=true ''' } // 项目打包到镜像并推送到镜像仓库 stage('Build and Push Image') {sh '''REPOSITORY=reg.dingkai.com/library/tomcat-java-demo:${branch}

12. cat > Dockerfile << EOFFROM reg.dingkai.com/library/tomcat:v1

15. EOF

17. docker build -t $REPOSITORY .

19. docker login reg.dingkai.com -u admin -p 123456

21. docker push $REPOSITORY'''

22. }

23. // 部署到Docker主机

26. '''

27. }

28. // 部署到Docker主机

29. stage('Deploy to Docker') {

30. sh '''

31. REPOSITORY=reg.dingkai.com/library/tomcat-java-demo:${branch}

32. docker rm -f tomcat-java-demo |true

33. docker pull $REPOSITORY

34. docker container run -d --name tomcat-java-demo -p 88:8080 $REPOSITORY

35. '''

36. }

37. }

在Pipeline脚本里面我们指定了一个branch参数，所以我们需要传递一个参数变量，这里我们选择参数化构建，默认值为master分支。

然后保存配置。

06 开始构建任务

回到主界面，我们开始构建任务

可以通过Console Output输出查看jenkins构建流程

成功构建会提示： SUCCESS

我们也可以查看构建成功后的图形构建过程

 

感谢每一个认真阅读我文章的人，礼尚往来总是要有的，虽然不是什么很值钱的东西，如果你用得到的话可以直接拿走：

这些资料，对于【软件测试】的朋友来说应该是最全面最完整的备战仓库，这个仓库也陪伴上万个测试工程师们走过最艰难的路程，希望也能帮助到你!有需要的小伙伴可以点击下方小卡片领取