kafka-Eagle安装
在关闭kafka集群之后,修改启动kafka配置文件
vim bin/kafka-server-start.sh
修改如下参数:
if [ "x$KAFKA_HEAP_OPTS" = "x" ]; then
export KAFKA_HEAP_OPTS="-Xmx1G -Xms1G"
fi
改为
if [ "x$KAFKA_HEAP_OPTS" = "x" ]; then
export KAFKA_HEAP_OPTS="-server -Xms2G -Xmx2G
-XX:PermSize=128m -XX:+UseG1GC -XX:MaxGCPauseMillis=200
-XX:ParallelGCThreads=8 -XX:ConcGCThreads=5
-XX:InitiatingHeapOccupancyPercent=70"
export JMX_PORT="9999"
# export KAFKA_HEAP_OPTS="-Xmx1G -Xms1G"
fi
修改完成后将配置文件发送到其他节点
[root@master kafka-3.0.0]# vim bin/kafka-server-start.sh
[root@master kafka-3.0.0]# scp bin/kafka-server-start.sh slave1:/opt/moudel/kafka-3.0.0/bin/
kafka-server-start.sh 100% 1549 735.0KB/s 00:00
[root@master kafka-3.0.0]# scp bin/kafka-server-start.sh slave2:/opt/moudel/kafka-3.0.0/bin/
kafka-server-start.sh 100% 1549 640.9KB/s 00:00
(以上配置文件需要提前更改以后做如下配置)
1、上传文件kafka-eagle-bin-2.0.8.tar.gz
2、先解压文件到本地:tar -zxvf kafka-eagle-bin-2.0.8.tar.gz
3、进入刚才解压的目录,继续将文件解压,解压到/opt/moudel/
tar -zxvf efak-web-2.0.8-bin.tar.gz -C /opt/moudel
4、重命名解压后的文件为:efak
mv efak-web-2.0.8 efak
5、修改配置文件:vim efak/conf/system-config.properties
efak.zk.cluster.alias=cluster1
cluster1.zk.list=master:2181,slave1:2181,slave2:2181
#cluster2.zk.list=xdn10:2181,xdn11:2181,xdn12:2181(注释掉这一行)
# kafka offset storage(offset保存在kafka)
######################################
cluster1.efak.offset.storage=kafka
#cluster2.efak.offset.storage=zk(这行注释)
######################################
# kafka mysql jdbc driver address(配置mysql连接)
######################################
efak.driver=com.mysql.cj.jdbc.Driver
efak.url=jdbc:mysql://192.168.10.130:3306/ke?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull
efak.username=root
efak.password=123456
6、添加环境变量vim /etc/profile
#KE_HOME
export KE_HOME=/opt/moudel/efak
export PATH=$PATH:$KE_HOME/bin
7、启动,先启动Zookeeper和kafka
zkServer.sh start
bin/kafka-server-start.sh -daemon config/server.properties
ke.sh start
注意!!!(如果网页登录不进去,405)
修改 /etc/my.env
在最后一行添加:default-time-zone='+8:00'
重启