分布式skywalking安装部署总结

1、服务器配置

1. 服务器规划
   

2 skywalking服务端安装

2.1 zookeeper安装

2.1.1 jdk安装

	在服务器上安装jdk1.8，由于系统模板已经集成jdk 1.8.0_221,这里不在单独安装

2.1.2 获取zookeeper安装程序

将安装程序分别上传到zookeeper服务器的/workspaces目录下

wget http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.5.5/apache-zookeeper-3.5.5-bin.tar.gz

2.1.3 解压zookeeper应用到/root目录下

tar zxvf  apache-zookeeper-3.5.5-bin.tar.gz  -C /root

2.1.4 配置zookeeper

修改如下：

tickTime=2000
dataLogDir=/var/zookeeper/logs
dataDir=/var/zookeeper/data
clientPort=2181
initLimit=10
syncLimit=5
autopurge.snapRetainCount=500
autopurge.purgeInterval=24
server.1=zk服务1ip:2888:3888
server.2= zk服务2ip:2888:3888
server.3= zk服务3ip:2888:3888

 cd /root/apache-zookeeper-3.5.5-bin/conf
 cp zoo_sample.cfg zoo.cfg
 vim zoo.cfg

配置详细说明请参考：

https://www.cnblogs.com/guohu/p/10766465.html

配置集群信息是存在一定的格式：service.N =YYY： A：B
N：代表服务器编号（也就是myid里面的值）
YYY：服务器地址
A：表示 Flower 跟 Leader的通信端口，简称服务端内部通信的端口（默认2888）
B：表示 是选举端口（默认是3888）

参考文档：

https://blog.csdn.net/milhua/article/details/78931672

2.1.5 生成数据文件目录和myid文件

在每个zookeeper节点上创建zookeeper的数据目录，并且在数据目录下创建myid文件，文件中存放当前节点的server-id，
下面命令中server-id，根据节点信息调整

 mkdir -p /var/zookeeper/data && echo “1”> /var/zookeeper/data/myid

2.1.6 启动zookeeper

进入到/root/apache-zookeeper-3.5.5-bin/bin/下启动 zookeeper

cd  /root/apache-zookeeper-3.5.5-bin/bin
./zkServer.sh start

2.1.7 测试

 cd  /root/apache-zookeeper-3.5.5-bin/bin
 ./zkCli.sh -server 集群机器1IP地址:2181,集群机器2IP地址:2181,集群机器3IP地址:2181
 ./zkServer.sh status

2.2 elasticsraech安装

2.2.1 jdk安装

在服务器上安装jdk1.8，由于系统模板已经集成jdk 1.8.0_221,这里不在单独安装

2.2.2 获取elasticsearch 安装程序

将安装程序上传到elasticsearch服务器的/workspaces目录下

wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.5.1-x86_64.rpm

2.2.3 安装elasticsearch

Yum install -y elasticsearch-7.5.1-x86_64.rpm

2.2.4 配置elasticsearch集群

只需要根据实际情况修改node.name 即可

cluster.name: skywalking
node.name: P-MAINTENANCE-SKY-ZK-ES-229
node.master: true
node.data: true 
path.data: /var/elasticsearch/data
path.logs: /var/elasticsearch/logs
network.host: 0.0.0.0
http.port: 9200
discovery.zen.ping.unicast.hosts: ["es服务器ip1", " es服务器ip2", " es服务器ip3"]
cluster.initial_master_nodes: ["P-MAINTENANCE-SKY-ZK-ES-229", "P-MAINTENANCE-SKY-ZK-ES-230", "P-MAINTENANCE-SKY-ZK-ES-231"]
discovery.zen.minimum_master_nodes: 2

 cd /etc/elasticsearch/
 vim elasticsearch.yml

es详细配置参数说明(https://blog.csdn.net/yjclsx/article/details/81319454
https://my.oschina.net/Yumikio/blog/805877)

2.2.5 配置jvm信息

注意：初始化和最大必须一样否则无法启动

cd /etc/elasticsearch/
 vim jvm.options

-Xms4g 
-Xmx4g
-XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=75
-XX:+UseCMSInitiatingOccupancyOnly
-Djava.io.tmpdir=${ES_TMPDIR}
-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/var/elasticsearch
-XX:ErrorFile=/var/elasticsearch/logs/hs_err_pid%p.log
9-:-Xlog:gc*,gc+age=trace,safepoint:file=/var/elasticsearch/logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m

具体说明：https://www.cnblogs.com/hapjin/archive/2019/07/12/11135187.html

2.2.6 创建相关目录

创建elasticsearch的数据目录和日志目录并设置权限

 mkdir -p  /var/elasticsearch/data
 mkdir -p  /var/elasticsearch/logs
 chowm -R elasticsearch: elasticsearch /var/elasticsearch

2.2.7 启动服务

 systemctl start elasticsearch

2.2.8 验证服务

curl 主节点ip:9200/_cluster/stats?pretty
 curl 主节点ip:9200/_nodes/process?pretty

2.3 skywalkingcollector安装

2.3.1 jdk安装

在服务器上安装jdk1.8，由于系统模板已经集成jdk 1.8.0_221,这里不在单独安装

2.3.2 获取安装文件

将安装程序上传到collector服务器的/workspaces目录下

wget http://mirrors.tuna.tsinghua.edu.cn/apache/skywalking/6.6.0/apache-skywalking-apm-es7-6.6.0.tar.gz

2.3.3 解压collector到/root目录

tar zxvf apache-skywalking-apm-es7-6.6.0.tar.gz -C /root

2.3.4 配置collector连接zookeeper

cluster下注释掉standalone，打开zookeeper相关,并配置zookeeper集群地址

	cluster:
	  zookeeper:
	    nameSpace: ${SW_NAMESPACE:""}
	    hostPort: ${SW_CLUSTER_ZK_HOST_PORT:zk服务器IP地址1:2181,zk服务器IP地址2:2181,zk服务器IP地址3:2181}
	    # Retry Policy
	    baseSleepTimeMs: 1000 # initial amount of time to wait between retries
	    maxRetries: 3 # max number of times to retry
	    # Enable ACL
	    enableACL: ${SW_ZK_ENABLE_ACL:false} # disable ACL in default
	    schema: ${SW_ZK_SCHEMA:digest} # only support digest schema
	    expression: ${SW_ZK_EXPRESSION:skywalking:skywalking}

cd  /root/apache-skywalking-apm-bin-es7/conf
 vim application.yml

2.3.5 配置collector连接elasticsearch

storage下注释掉h2相关，打开elasticsearch相关

storage:
  elasticsearch7:
    # nameSpace: ${SW_NAMESPACE:""}
    # user: ${SW_ES_USER:""} # User needs to be set when Http Basic authentication is enabled
    # password: ${SW_ES_PASSWORD:""} # Password to be set when Http Basic authentication is enabled
    #trustStorePath: ${SW_SW_STORAGE_ES_SSL_JKS_PATH:""}
    #trustStorePass: ${SW_SW_STORAGE_ES_SSL_JKS_PASS:""}
    clusterNodes: ${SW_STORAGE_ES_CLUSTER_NODES:es服务器地址1:9200, es服务器地址2:9200, es服务器地址3:9200}
    protocol: ${SW_STORAGE_ES_HTTP_PROTOCOL:"http"}
    indexShardsNumber: ${SW_STORAGE_ES_INDEX_SHARDS_NUMBER:2}
    indexReplicasNumber: ${SW_STORAGE_ES_INDEX_REPLICAS_NUMBER:0}
    # Those data TTL settings will override the same settings in core module.
    recordDataTTL: ${SW_STORAGE_ES_RECORD_DATA_TTL:7} # Unit is day
    otherMetricsDataTTL: ${SW_STORAGE_ES_OTHER_METRIC_DATA_TTL:45} # Unit is day
    monthMetricsDataTTL: ${SW_STORAGE_ES_MONTH_METRIC_DATA_TTL:18} # Unit is month
    # Batch process setting, refer to https://www.elastic.co/guide/en/elasticsearch/client/java-api/5.5/java-docs-bulk-processor.html
    bulkActions: ${SW_STORAGE_ES_BULK_ACTIONS:2000} # Execute the bulk every 2000 requests
    bulkSize: ${SW_STORAGE_ES_BULK_SIZE:20} # flush the bulk every 20mb
    flushInterval: ${SW_STORAGE_ES_FLUSH_INTERVAL:10} # flush the bulk every 10 seconds whatever the number of requests
    concurrentRequests: ${SW_STORAGE_ES_CONCURRENT_REQUESTS:2} # the number of concurrent requests
    resultWindowMaxSize: ${SW_STORAGE_ES_QUERY_MAX_WINDOW_SIZE:10000}
    metadataQueryMaxSize: ${SW_STORAGE_ES_QUERY_MAX_SIZE:5000}
    segmentQueryMaxSize: ${SW_STORAGE_ES_QUERY_SEGMENT_SIZE:200}
    advanced: ${SW_STORAGE_ES_ADVANCED:""}

cd  /root/apache-skywalking-apm-bin-es7/conf
 vim application.yml

2.3.6修改collector启动脚本

修改初始化内存2G， 最大可用6G

vim oapService.sh
   JAVA_OPTS=”-Xms2G -Xmx6G”

注释掉webapp的启动

 vim startup.sh
  #!/usr/bin/env sh
  PRG=”$0”
  PRGDIR=’dirname “$PRG”’
  OAP_EXE=oapService.sh
  #WEBAPP_EXE=webappService.sh
  “$PRGDIR/$OAP_EXE”
  #“$ PRGDIR/$ WEBAPP_EXE”

2.3.7 启动colletcot

cd  /root/apache-skywalking-apm-bin-es7/bin
 ./ startup.sh

2.3.8 验证

 tail -f /root/apache-skywalking-apm-bin-es7/logs/skywalking-oap-server.log

2.4 skywalking ui部署

2.4.1 jdk安装

在服务器上安装jdk1.8，由于系统模板已经集成jdk 1.8.0_221,这里不在单独安装

2.4.2 获取安装文件

将安装程序上传到UI服务器的/workspaces目录下

wget http://mirrors.tuna.tsinghua.edu.cn/apache/skywalking/6.6.0/apache-skywalking-apm-es7-6.6.0.tar.gz

2.4.3 解压UI到/root目录

 tar zxvf apache-skywalking-apm-es7-6.6.0.tar.gz -C /root

2.4.4 配置ui

 cd /root/apache-skywalking-apm-bin-es7/webapp
 vim webapp.yml
   listOfServers: collector服务器地址1:12800,collector服务器地址2:12800,collector服务器地址3:12800

2.4.5 修改UI启动脚本

注释掉oap服务的启动

cd  /root/apache-skywalking-apm-bin-es7/bin
vim startup.sh

文件如下：

#!/usr/bin/env sh
  PRG=”$0”
  PRGDIR=’dirname “$PRG”’
  #OAP_EXE=oapService.sh
  WEBAPP_EXE=webappService.sh
  #“$PRGDIR/$OAP_EXE”
 “$ PRGDIR/$ WEBAPP_EXE”

2.4.6 启动UI

cd  /root/apache-skywalking-apm-bin-es7/bin
 ./ startup.sh

2.4.7 验证

 tail -f /root/apache-skywalking-apm-bin-es7/logs/webapp.log

3 agent安装

3.1 获取程序

拷贝/root/apache-skywalking-apm-bin-es7/agent 文件夹到目标服务器上/root/agent

3.2 如果为oracle数据库需要上传oracle插件

将自己编译的apm-oracle-10.x-plugin-1.0.1.jar包放入agent程序的plugins目录下
链接：https://pan.baidu.com/s/1f1j7-PXiXUGtrKeBZZFhWQ
提取码：ot6p

3.3 修改配置

修改配置文件中注册到后台的服务名和后台的地址端口，
服务根据实际情况进行修改，格式环境-服务名，例如
Pro-portal
Uat-portal
其他项暂时保持默认不变

vi /root/agent/config/agent.config
  agent.service_name=${SW_AGENT_NAME:Uat-portal}
  collect,or.backend_service=${SW_AGENT_COLLECTOR_BACKEND_SERVICES:1 collector服务器ip地址:11800, collector服务器ip地址:11800, collector服务器ip地址:11800}

3.3 修改tomcat启动脚本

修改tomcat的bin/catalina.sh，在第一行加入

CATALINA_OPTS="$CATALINA_OPTS -javaagent:/root/agent/skywalking-agent.jar"; export CATALINA_OPTS

3.4 重启tomcat

重启tomcat加载agent。

备注：skywalking具体配置说明参考官网：https://github.com/apache/skywalking/blob/5.x/docs/README_ZH.md 或者https://github.com/apache/skywalking/blob/6.x/README.md
参数配置可以参考博客：https://smooth.blog.csdn.net/article/details/96479544