kafka eagle 踩坑windows安装

使用场景:安装kafka eagle windows环境,一直没有反应,报如下错:

The KE_HOME environment variable is not defined correctly

说一直找不到KE_HOME文件路径,直接cmd,输入命令查找%KE_HOME%也报一样的错

总结了下应该是配置环境变量的问题,以下是我的环境变量配置(自认为没有问题,有问题可踢我):

 

 然后一直启动不成功,后面,既然使用%KE_HOME%找不到指定文件,那么我就使用的手动修改,具体操作如下,使用我这种方式,可以不用配置环境变量。

第一,下载kafka-eagle-web,然后解压

 

第二,进入你的解压目录,进入conf文件夹,修改system-config.properties配置文件

######################################
# multi zookeeper&kafka cluster list
######################################
# 配置 zk,我这里是单节点,集群的话配置如下面 cluster2 所示
kafka.eagle.zk.cluster.alias=cluster1
cluster1.zk.list=localhost:2191
#cluster2.zk.list=xdn10:2181,xdn11:2181,xdn12:2181
 
######################################
# zk client thread limit
######################################
kafka.zk.limit.size=25
 
######################################
# kafka eagle webui port
######################################
kafka.eagle.webui.port=8048
 
######################################
# kafka offset storage
######################################
cluster1.kafka.eagle.offset.storage=kafka
#cluster2.kafka.eagle.offset.storage=zk
 
######################################
# enable kafka metrics
######################################
# 开启图表监控,将 false 变为 true
kafka.eagle.metrics.charts=true
kafka.eagle.sql.fix.error=false
 
######################################
# kafka sql topic records max
######################################
kafka.eagle.sql.topic.records.max=5000
 
######################################
# alarm email configure
######################################
kafka.eagle.mail.enable=false
kafka.eagle.mail.sa=alert_sa@163.com
kafka.eagle.mail.username=alert_sa@163.com
kafka.eagle.mail.password=mqslimczkdqabbbh
kafka.eagle.mail.server.host=smtp.163.com
kafka.eagle.mail.server.port=25

 
######################################
# delete kafka topic token
######################################
kafka.eagle.topic.token=keadmin
 
######################################
# kafka sasl authenticate
######################################
cluster1.kafka.eagle.sasl.enable=false
cluster1.kafka.eagle.sasl.protocol=SASL_PLAINTEXT
cluster1.kafka.eagle.sasl.mechanism=PLAIN
cluster1.kafka.eagle.sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required username="admin" password="kafka-eagle";

######################################
# kafka mysql jdbc driver address
# 数据存储数据配置  mysql/sqlite 以下为mysql配置
######################################
kafka.eagle.driver=com.mysql.cj.jdbc.Driver
kafka.eagle.url=jdbc:mysql://localhost:3306/ke?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull&serverTimezone=UTC
kafka.eagle.username=root
kafka.eagle.password=root123456

第三,最重要的一步来了,使用环境变量找不到指定文件的,那么则不需要配置环境变量,直接手动指定。

进入E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\bin 目录下,右键编辑ke.bat

将所有应用环境变量的地方,替换成你的路径(解压路径)。

比如说:我的 KE_HOME 值为:E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5

则我的ke.bat文件中所有包含   %KE_HOME%的地方,全部替换成  E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5,你的安装路径则替换成自己的。

最后替换后的结果如下,不要替换漏了或者错了。

@echo off

rem ---------------------------------------------------------------------------
rem Start script for the KE Server
rem ---------------------------------------------------------------------------

echo KE Service check ...

setlocal

if exist "%JAVA_HOME%" goto okKafkaEagke
echo Error: The JAVA_HOME environment variable is not defined correctly.
echo Error: This environment variable is needed to run this program.
goto end

:okKafkaEagke
if exist "E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5" goto okHome
echo Error: The KE_HOME environment variable is not defined correctly.
echo Error: This environment variable is needed to run this program.
goto end

:okHome

if exist E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke (
    rem Delete ke dir menu.
    rd /s /q E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke
)

if exist E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\work (
    rem Delete tomcat work dir menu.
    rd /s /q %KE_HOME%\kms\work
)

md E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke
cd E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke
rem echo Current Path :: %cd%
%JAVA_HOME%\bin\jar -xvf E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke.war

ping /n 2 127.1 >nul

cd E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5
SET CLSNAME=org.smartloli.kafka.eagle.plugin.server.TomcatServerListen

setlocal enabledelayedexpansion
for %%i in (E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\lib\dom*.jar,%KE_HOME%\kms\webapps\ke\WEB-INF\lib\log4j*.jar,%KE_HOME%\kms\webapps\ke\WEB-INF\lib\slf4j*.jar,%KE_HOME%\kms\webapps\ke\WEB-INF\lib\kafka-eagle*.jar) do (
  set CLSPATH=!CLSPATH!;%%i
)
rem echo %CLSPATH%
%JAVA_HOME%\bin\java -classpath %CLSPATH% %CLSNAME% >> E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\logs\ke.out

echo Kafka Eagle system monitor port successful...

ping /n 3 127.1 >nul

if exist E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\classes\*.properties (
  rd /s /q E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\classes\*.properties
)
copy E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\conf\*.properties E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\classes\

ping /n 3 127.1 >nul
set CATALINA_HOME=E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms
call  E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\bin\startup.bat

:end

根据自己的ke.bat文件进行修改。

最后启动,ctrl+shift+右键,打开powerShell,输入命令ke,然后会弹出一个tomcat窗口,最后解决一下报错信息,就可以啦。

数据库文件:

SET FOREIGN_KEY_CHECKS=0;

-- ----------------------------
-- Table structure for ke_alarm_clusters
-- ----------------------------
DROP TABLE IF EXISTS `ke_alarm_clusters`;
CREATE TABLE `ke_alarm_clusters` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `type` varchar(255) DEFAULT NULL,
  `cluster` varchar(255) DEFAULT NULL,
  `server` varchar(255) DEFAULT NULL,
  `alarm_group` varchar(255) DEFAULT NULL,
  `alarm_times` int(11) DEFAULT NULL,
  `alarm_max_times` int(11) DEFAULT NULL,
  `alarm_level` varchar(255) DEFAULT NULL,
  `is_normal` varchar(255) DEFAULT NULL,
  `is_enable` varchar(255) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `modify` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_alarm_config
-- ----------------------------
DROP TABLE IF EXISTS `ke_alarm_config`;
CREATE TABLE `ke_alarm_config` (
  `cluster` varchar(255) DEFAULT NULL,
  `alarm_group` varchar(255) DEFAULT NULL,
  `alarm_type` varchar(255) DEFAULT NULL,
  `alarm_url` varchar(255) DEFAULT NULL,
  `http_method` varchar(255) DEFAULT NULL,
  `alarm_address` varchar(255) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `modify` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_alarm_consumer
-- ----------------------------
DROP TABLE IF EXISTS `ke_alarm_consumer`;
CREATE TABLE `ke_alarm_consumer` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `lag` bigint(20) DEFAULT NULL,
  `alarm_group` varchar(255) DEFAULT NULL,
  `alarm_times` int(11) DEFAULT NULL,
  `alarm_max_times` int(11) DEFAULT NULL,
  `alarm_level` varchar(255) DEFAULT NULL,
  `is_normal` varchar(255) DEFAULT NULL,
  `is_enable` varchar(255) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `modify` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_connect_config
-- ----------------------------
DROP TABLE IF EXISTS `ke_connect_config`;
CREATE TABLE `ke_connect_config` (
  `id` bigint(20) NOT NULL AUTO_INCREMENT,
  `cluster` varchar(255) DEFAULT NULL,
  `connect_uri` varchar(255) DEFAULT NULL,
  `version` varchar(255) DEFAULT NULL,
  `alive` varchar(255) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `modify` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_consumer_bscreen
-- ----------------------------
DROP TABLE IF EXISTS `ke_consumer_bscreen`;
CREATE TABLE `ke_consumer_bscreen` (
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `logsize` bigint(20) DEFAULT NULL,
  `difflogsize` bigint(20) DEFAULT NULL,
  `offsets` bigint(255) DEFAULT NULL,
  `diffoffsets` bigint(255) DEFAULT NULL,
  `lag` bigint(255) DEFAULT NULL,
  `timespan` bigint(20) DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_consumer_group
-- ----------------------------
DROP TABLE IF EXISTS `ke_consumer_group`;
CREATE TABLE `ke_consumer_group` (
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `status` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_consumer_group_summary
-- ----------------------------
DROP TABLE IF EXISTS `ke_consumer_group_summary`;
CREATE TABLE `ke_consumer_group_summary` (
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic_number` int(11) DEFAULT NULL,
  `coordinator` varchar(255) DEFAULT NULL,
  `active_topic` int(11) DEFAULT NULL,
  `active_thread_total` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_logsize
-- ----------------------------
DROP TABLE IF EXISTS `ke_logsize`;
CREATE TABLE `ke_logsize` (
  `cluster` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `logsize` bigint(20) DEFAULT NULL,
  `diffval` bigint(20) DEFAULT NULL,
  `timespan` bigint(20) DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_metrics
-- ----------------------------
DROP TABLE IF EXISTS `ke_metrics`;
CREATE TABLE `ke_metrics` (
  `cluster` varchar(255) DEFAULT NULL,
  `broker` varchar(255) DEFAULT NULL,
  `type` varchar(255) DEFAULT NULL,
  `key` varchar(255) DEFAULT NULL,
  `value` varchar(255) DEFAULT NULL,
  `timespan` bigint(20) DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_metrics_offline
-- ----------------------------
DROP TABLE IF EXISTS `ke_metrics_offline`;
CREATE TABLE `ke_metrics_offline` (
  `cluster` varchar(255) DEFAULT NULL,
  `key` varchar(255) DEFAULT NULL,
  `one` varchar(255) DEFAULT NULL,
  `mean` varchar(255) DEFAULT NULL,
  `five` varchar(255) DEFAULT NULL,
  `fifteen` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_p_role
-- ----------------------------
DROP TABLE IF EXISTS `ke_p_role`;
CREATE TABLE `ke_p_role` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `role_name` varchar(255) DEFAULT NULL,
  `role_describer` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_resources
-- ----------------------------
DROP TABLE IF EXISTS `ke_resources`;
CREATE TABLE `ke_resources` (
  `resource_id` int(11) NOT NULL AUTO_INCREMENT,
  `name` varchar(255) DEFAULT NULL,
  `url` varchar(255) DEFAULT NULL,
  `parentId` int(11) DEFAULT NULL,
  PRIMARY KEY (`resource_id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_role_resource
-- ----------------------------
DROP TABLE IF EXISTS `ke_role_resource`;
CREATE TABLE `ke_role_resource` (
  `role_id` int(11) DEFAULT NULL,
  `resource_id` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_sql_history
-- ----------------------------
DROP TABLE IF EXISTS `ke_sql_history`;
CREATE TABLE `ke_sql_history` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `cluster` varchar(255) DEFAULT NULL,
  `username` varchar(255) DEFAULT NULL,
  `host` varchar(255) DEFAULT NULL,
  `ksql` varchar(255) DEFAULT NULL,
  `status` varchar(255) DEFAULT NULL,
  `spend_time` bigint(20) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_topic_offsets
-- ----------------------------
DROP TABLE IF EXISTS `ke_topic_offsets`;
CREATE TABLE `ke_topic_offsets` (
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `logsize` double DEFAULT NULL,
  `offsets` varchar(255) DEFAULT NULL,
  `lag` varchar(255) DEFAULT NULL,
  `timespan` datetime DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_topic_rank
-- ----------------------------
DROP TABLE IF EXISTS `ke_topic_rank`;
CREATE TABLE `ke_topic_rank` (
  `cluster` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `tkey` varchar(255) DEFAULT NULL,
  `tvalue` bigint(20) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_users
-- ----------------------------
DROP TABLE IF EXISTS `ke_users`;
CREATE TABLE `ke_users` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `rtxno` int(11) DEFAULT NULL,
  `username` varchar(255) DEFAULT NULL,
  `password` varchar(255) DEFAULT NULL,
  `email` varchar(255) DEFAULT NULL,
  `realname` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB AUTO_INCREMENT=2 DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_user_role
-- ----------------------------
DROP TABLE IF EXISTS `ke_user_role`;
CREATE TABLE `ke_user_role` (
  `user_id` int(11) DEFAULT NULL,
  `role_id` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;


INSERT INTO `ke`.`ke_users` (`id`, `rtxno`, `username`, `password`, `email`, `realname`) VALUES ('1', '1000', 'admin', '123456', 'admin@email.com', 'Administrator');

  • 4
    点赞
  • 8
    收藏
    觉得还不错? 一键收藏
  • 3
    评论
你好!要在Docker中安装Kafka Eagle,可以按照以下步骤进行操作: 1. 首先,在你的机器上安装Docker和Docker Compose。你可以根据你的操作系统类型,按照官方文档进行安装。 2. 创建一个新的文件夹,并在该文件夹中创建一个名为`docker-compose.yml`的文件。 3. 打开`docker-compose.yml`文件,并添加以下内容: ```yaml version: '2' services: zookeeper: image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" kafka: image: wurstmeister/kafka:2.12-2.4.0 ports: - "9092:9092" environment: KAFKA_ADVERTISED_HOST_NAME: localhost KAFKA_CREATE_TOPICS: "test_topic:1:1" KAFKA_AUTO_CREATE_TOPICS_ENABLE: 'false' KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 eagle: image: smartloli/kafka-eagle:latest ports: - "8048:8048" - "9093:9093" environment: KE_CFG_CLUSTER_ALIAS: "localhost" KE_CFG_ZK_ADDRESS: "zookeeper:2181" KE_CFG_KAFKA_ADDRESS: "kafka:9092" ``` 4. 保存并关闭`docker-compose.yml`文件。 5. 打开终端或命令提示符,进入到包含`docker-compose.yml`文件的文件夹。 6. 运行以下命令启动Docker容器: ``` docker-compose up -d ``` 7. Docker将会下载所需的镜像并启动容器。等待一段时间,直到容器完全启动。 8. 一旦容器启动完成,你可以在浏览器中访问`http://localhost:8048`来打开Kafka Eagle的Web界面。 这样,你就成功安装Kafka Eagle,并可以使用它来管理和监控Kafka集群了。希望对你有帮助!如有任何问题,欢迎继续提问。
评论 3
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值