高版本springcloud sleuth+zipkin+rabbitmq+ES 微服务链路追踪，还是有几个坑哎

最新推荐文章于 2024-04-18 13:43:37 发布

jwolf2

最新推荐文章于 2024-04-18 13:43:37 发布

阅读量2.3k

点赞数

分类专栏： springcloud

本文链接：https://blog.csdn.net/qq_39506978/article/details/88912365

版权

springcloud 专栏收录该内容

13 篇文章 1 订阅

订阅专栏

一、用来干嘛的

微服务运用较多，相互调用可能错综复杂,链路追踪可以帮助定位问题，分析各个服务性能瓶颈，快速了解整个服务调用过程。功能比较简单，UI简单，没有CAT的报表及报警/系统指标，但集成较简单，侵入较小；CAT有一定侵入，需要埋点（aop环绕通知），依赖mysql，skywalking是个比较新的链路追踪开源软件，界面比较炫，无侵入集成，没cat丰富的报表。但是它们的思路是差不多了，还是值得一学。

二、了解原理

虚线外部分一般springcloud sleuth，是zipkin的client端，用于收集链路数据，这些链路数据通过http或mq收集并存储到zipkin的存储—ES或MySQL，并可以在zipkin server的web ui上简单查询

一个链路一个traceId多个跨度spanId（第一个spanId=traceId）,可以自定义跨度，前一个spanId是后一个的parent，维系调用顺序。如图上一行的server received（SR）事件对应下一行的则是server sent (SS)事件（或相反），client sent （CS）对应client recieved（CR）事件（或相反），且上下行spanId对应，整个过程traveId不变。spanId=A的server receive时间与spanId=A的server sent时间差为调用耗时。springcloud-sleuth大致原理是这样的：也是扫描spring.factories里一些配置类实例化一些特殊bean实现链路追踪，有十余个配置类，这里简单看几个

TraceAutoConfiguration->主要配置了一个Tracing对象到spring

TraceWebServletAutoConfiguration->设置自定义请求头traceID,spanID，这是为什么traceID,spanID能跨服务器传递的原因，而同一进程内能够自由获取到traceID,spanID就是threadlocal的作用了

TraceSchedulingAutoConfiguration ->通过aop切入@Scheduled注解的方法来记录spanid等，

TraceFeignClientAutoConfiguration同上

TraceZuulAutoConfiguration以拦截器方式获取请求中获取请求头中的span等

三、集成步骤

先整合log4j2，@link https://mp.csdn.net/postedit/88916349 log4j2 异步日志总结

，关键是日志pattern配置pattern="%d{yyyy-MM-dd HH:mm:ss.SSS} [%t] %-5level [%logger{50}:%L] [%X{X-B3-TraceId},%X{X-B3-SpanId}] - %msg%n" ，然后每个服务添加依赖，重启即可看到traceID与spanID.，需要配置类zipkin URL等相关配置

        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-sleuth</artifactId>
        </dependency>
        <dependency>
             <groupId>org.springframework.cloud</groupId>
             <artifactId>spring-cloud-starter-zipkin</artifactId>
         </dependency>

每个服务的主配置都要配置，通过http上传链路数据
spring.zipkin.base-url=http://localhost:9411
spring.zipkin.enabled=true
spring.sleuth.sampler.probability=1

四、直接下载安装zipkin-server

springcloud F版本开始不需要自己搭建zipkin server工程，直接下载最新版：https://search.maven.org/remote_content?g=io.zipkin.java&a=zipkin-server&v=LATEST&c=exec或https://dl.bintray.com/openzipkin/maven/io/zipkin/java/zipkin-server/。 java -jar直接启动jar包，默认端口9411。浏览器访问：http://localhost:9411/zipkin/

五、使用rabbitmq/kafak收集数据，ES储存数据（自己搭建的zipkinserver）

1、自己搭建zipkin-server，实现从rabbitMQ收集数据，ES储存数据

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <parent>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-parent</artifactId>
        <version>2.1.1.RELEASE</version>
        <relativePath/>
    </parent>
    <groupId>com.jwolf</groupId>
    <artifactId>zipkin-server</artifactId>
    <version>0.0.1-SNAPSHOT</version>
    <name>zipkin-server</name>
    <description>zipkin-server</description>

    <properties>
        <project-name>zipkin-server-stream</project-name>
        <spring-cloud.version>Finchley.SR2</spring-cloud.version>
        <zipkin.version>2.11.9</zipkin.version>
    </properties>

    <dependencies>
        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-server</artifactId>
            <version>${zipkin.version}</version>
        </dependency>

        <!-- 使用消息的方式收集数据（使用rabbitmq） -->
        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-autoconfigure-collector-rabbitmq</artifactId>
            <version>${zipkin.version}</version>
        </dependency>

        <!-- 支持Elasticsearch 2.x - 6.x -->
        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-autoconfigure-storage-elasticsearch-http</artifactId>
            <version>2.8.4</version>
        </dependency>

        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-autoconfigure-ui</artifactId>
            <version>2.11.12</version>
        </dependency>
        
    </dependencies>
    <dependencyManagement>
        <dependencies>
            <dependency>
                <groupId>org.springframework.cloud</groupId>
                <artifactId>spring-cloud-dependencies</artifactId>
                <version>${spring-cloud.version}</version>
                <type>pom</type>
                <scope>import</scope>
            </dependency>
        </dependencies>
    </dependencyManagement>
    <build>
        <plugins>
            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
            </plugin>
        </plugins>
    </build>

</project>

2.配置文件，入口类开启@EnableZipkinServer

server.port=9411
spring.application.name=zipkin
management.metrics.web.server.auto-time-requests=false
#rabbitmq采集数据
zipkin.collector.rabbitmq.addresses=127.0.0.1:5672
zipkin.collector.rabbitmq.password=guest
zipkin.collector.rabbitmq.username=guest
zipkin.collector.rabbitmq.queue=zipkin  #不可自定义

#ES存储数据
zipkin.storage.type=elasticsearch
zipkin.storage.elasticsearch.cluster=elasticsearch
zipkin.storage.elasticsearch.hosts=192.168.199.128:9200
zipkin.storage.elasticsearch.index=zipkin #可自定义
zipkin.storage.elasticsearch.index-shards=3
zipkin.storage.elasticsearch.index-replicas=0

3.client端（各个微服务）依赖

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <parent>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-parent</artifactId>
        <version>2.1.1.RELEASE</version>
        <relativePath/> <!-- lookup parent from repository -->
    </parent>
    <groupId>com.jwolf</groupId>
    <artifactId>jwolf-ordercenter</artifactId>
    <version>0.0.1-SNAPSHOT</version>
    <name>jwolf-ordercenter</name>
    <description>order center</description>

    <properties>
        <java.version>1.8</java.version>
        <spring-cloud.version>Greenwich.RC2</spring-cloud.version>
    </properties>

    <dependencies>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-web</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-eureka-client</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-ribbon</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-openfeign</artifactId>
        </dependency>

        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-hystrix</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-actuator</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-hystrix-dashboard</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-test</artifactId>
            <scope>test</scope>
        </dependency>
        <dependency>
            <groupId>com.jwolf</groupId>
            <artifactId>jwolf-usercenter</artifactId>
            <version>0.0.1-SNAPSHOT</version>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-sleuth</artifactId>
        </dependency>
        <dependency>
             <groupId>org.springframework.cloud</groupId>
             <artifactId>spring-cloud-starter-zipkin</artifactId>
         </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-stream-binder-rabbit</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter</artifactId>
            <exclusions>
                <!-- 排除自带的logback依赖 -->
                <exclusion>
                    <groupId>org.springframework.boot</groupId>
                    <artifactId>spring-boot-starter-logging</artifactId>
                </exclusion>
            </exclusions>
        </dependency>

        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter</artifactId>
            <exclusions>
                <exclusion>   <!-- 排除自带的logback依赖 -->
                    <groupId>org.springframework.boot</groupId>
                    <artifactId>spring-boot-starter-logging</artifactId>
                </exclusion>
            </exclusions>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-log4j2</artifactId>
        </dependency>
        <dependency><!--log4j2异步支持-->
            <groupId>com.lmax</groupId>
            <artifactId>disruptor</artifactId>
            <version>3.3.6</version>
        </dependency>
        
    </dependencies>

    <dependencyManagement>
        <dependencies>
            <dependency>
                <groupId>org.springframework.cloud</groupId>
                <artifactId>spring-cloud-dependencies</artifactId>
                <version>${spring-cloud.version}</version>
                <type>pom</type>
                <scope>import</scope>
            </dependency>
        </dependencies>
    </dependencyManagement>

    <build>
        <plugins>
            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
            </plugin>
        </plugins>
    </build>

    <repositories>
        <repository>
            <id>spring-milestones</id>
            <name>Spring Milestones</name>
            <url>https://repo.spring.io/milestone</url>
        </repository>
    </repositories>

</project>

4.client端配置

spring.sleuth.sampler.probability=1
spring.sleuth.web.client.enabled=true
spring.zipkin.enabled=true
#spring.zipkin.base-url=http://localhost:9411   默认web http方式上传，改用mq异步方式
spring.zipkin.sender.type=rabbit
spring.rabbitmq.addresses=localhost:5672
spring.rabbitmq.password=guest
spring.rabbitmq.username=guest
spring.rabbitmq.port=5672
spring.zipkin.service.name=${spring.application.name}

5.ES效果预览

jwolf2

关注

0
点赞
踩
3

收藏

觉得还不错? 一键收藏
0
评论
高版本springcloud sleuth+zipkin+rabbitmq+ES 微服务链路追踪，还是有几个坑哎

一、用来干嘛的微服务运用较多，相互调用可能错综复杂，springcloud sleuth+zipkin+rabbitmq+ES可以帮助定位问题，分析各个服务性能瓶颈，快速了解整个服务调用过程二、了解原理，虚线外部分一般springcloud sleuth实现，zipkin将链路数据通过http或mq发送到ES或MySQL一个链路一个traceId多个跨度spanId（第一个span...
复制链接

扫一扫