kafka eagle 踩坑windows安装

最新推荐文章于 2024-05-01 09:48:51 发布

嘤嘤樱桃小丸子

最新推荐文章于 2024-05-01 09:48:51 发布

阅读量3.1k

点赞数 4

分类专栏：工具类文章标签： windows kafka

本文链接：https://blog.csdn.net/qq_43163943/article/details/120288206

版权

工具类专栏收录该内容

16 篇文章 0 订阅

订阅专栏

使用场景：安装kafka eagle windows环境，一直没有反应，报如下错：

The KE_HOME environment variable is not defined correctly

说一直找不到KE_HOME文件路径，直接cmd，输入命令查找%KE_HOME%也报一样的错

总结了下应该是配置环境变量的问题，以下是我的环境变量配置（自认为没有问题，有问题可踢我）：

然后一直启动不成功，后面，既然使用%KE_HOME%找不到指定文件，那么我就使用的手动修改，具体操作如下，使用我这种方式，可以不用配置环境变量。

第一，下载kafka-eagle-web，然后解压

第二，进入你的解压目录，进入conf文件夹，修改system-config.properties配置文件

######################################
# multi zookeeper&kafka cluster list
######################################
# 配置 zk,我这里是单节点,集群的话配置如下面 cluster2 所示
kafka.eagle.zk.cluster.alias=cluster1
cluster1.zk.list=localhost:2191
#cluster2.zk.list=xdn10:2181,xdn11:2181,xdn12:2181
 
######################################
# zk client thread limit
######################################
kafka.zk.limit.size=25
 
######################################
# kafka eagle webui port
######################################
kafka.eagle.webui.port=8048
 
######################################
# kafka offset storage
######################################
cluster1.kafka.eagle.offset.storage=kafka
#cluster2.kafka.eagle.offset.storage=zk
 
######################################
# enable kafka metrics
######################################
# 开启图表监控,将 false 变为 true
kafka.eagle.metrics.charts=true
kafka.eagle.sql.fix.error=false
 
######################################
# kafka sql topic records max
######################################
kafka.eagle.sql.topic.records.max=5000
 
######################################
# alarm email configure
######################################
kafka.eagle.mail.enable=false
kafka.eagle.mail.sa=alert_sa@163.com
kafka.eagle.mail.username=alert_sa@163.com
kafka.eagle.mail.password=mqslimczkdqabbbh
kafka.eagle.mail.server.host=smtp.163.com
kafka.eagle.mail.server.port=25

 
######################################
# delete kafka topic token
######################################
kafka.eagle.topic.token=keadmin
 
######################################
# kafka sasl authenticate
######################################
cluster1.kafka.eagle.sasl.enable=false
cluster1.kafka.eagle.sasl.protocol=SASL_PLAINTEXT
cluster1.kafka.eagle.sasl.mechanism=PLAIN
cluster1.kafka.eagle.sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required username="admin" password="kafka-eagle";

######################################
# kafka mysql jdbc driver address
# 数据存储数据配置  mysql/sqlite 以下为mysql配置
######################################
kafka.eagle.driver=com.mysql.cj.jdbc.Driver
kafka.eagle.url=jdbc:mysql://localhost:3306/ke?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull&serverTimezone=UTC
kafka.eagle.username=root
kafka.eagle.password=root123456

第三，最重要的一步来了，使用环境变量找不到指定文件的，那么则不需要配置环境变量，直接手动指定。

进入E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\bin 目录下，右键编辑ke.bat

将所有应用环境变量的地方，替换成你的路径（解压路径）。

比如说：我的 KE_HOME 值为：E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5

则我的ke.bat文件中所有包含 %KE_HOME%的地方，全部替换成 E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5，你的安装路径则替换成自己的。

最后替换后的结果如下，不要替换漏了或者错了。

@echo off

rem ---------------------------------------------------------------------------
rem Start script for the KE Server
rem ---------------------------------------------------------------------------

echo KE Service check ...

setlocal

if exist "%JAVA_HOME%" goto okKafkaEagke
echo Error: The JAVA_HOME environment variable is not defined correctly.
echo Error: This environment variable is needed to run this program.
goto end

:okKafkaEagke
if exist "E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5" goto okHome
echo Error: The KE_HOME environment variable is not defined correctly.
echo Error: This environment variable is needed to run this program.
goto end

:okHome

if exist E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke (
    rem Delete ke dir menu.
    rd /s /q E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke
)

if exist E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\work (
    rem Delete tomcat work dir menu.
    rd /s /q %KE_HOME%\kms\work
)

md E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke
cd E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke
rem echo Current Path :: %cd%
%JAVA_HOME%\bin\jar -xvf E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke.war

ping /n 2 127.1 >nul

cd E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5
SET CLSNAME=org.smartloli.kafka.eagle.plugin.server.TomcatServerListen

setlocal enabledelayedexpansion
for %%i in (E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\lib\dom*.jar,%KE_HOME%\kms\webapps\ke\WEB-INF\lib\log4j*.jar,%KE_HOME%\kms\webapps\ke\WEB-INF\lib\slf4j*.jar,%KE_HOME%\kms\webapps\ke\WEB-INF\lib\kafka-eagle*.jar) do (
  set CLSPATH=!CLSPATH!;%%i
)
rem echo %CLSPATH%
%JAVA_HOME%\bin\java -classpath %CLSPATH% %CLSNAME% >> E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\logs\ke.out

echo Kafka Eagle system monitor port successful...

ping /n 3 127.1 >nul

if exist E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\classes\*.properties (
  rd /s /q E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\classes\*.properties
)
copy E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\conf\*.properties E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\classes\

ping /n 3 127.1 >nul
set CATALINA_HOME=E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms
call  E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\bin\startup.bat

:end

根据自己的ke.bat文件进行修改。

最后启动，ctrl+shift+右键，打开powerShell，输入命令ke，然后会弹出一个tomcat窗口，最后解决一下报错信息，就可以啦。

数据库文件：

SET FOREIGN_KEY_CHECKS=0;

-- ----------------------------
-- Table structure for ke_alarm_clusters
-- ----------------------------
DROP TABLE IF EXISTS `ke_alarm_clusters`;
CREATE TABLE `ke_alarm_clusters` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `type` varchar(255) DEFAULT NULL,
  `cluster` varchar(255) DEFAULT NULL,
  `server` varchar(255) DEFAULT NULL,
  `alarm_group` varchar(255) DEFAULT NULL,
  `alarm_times` int(11) DEFAULT NULL,
  `alarm_max_times` int(11) DEFAULT NULL,
  `alarm_level` varchar(255) DEFAULT NULL,
  `is_normal` varchar(255) DEFAULT NULL,
  `is_enable` varchar(255) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `modify` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_alarm_config
-- ----------------------------
DROP TABLE IF EXISTS `ke_alarm_config`;
CREATE TABLE `ke_alarm_config` (
  `cluster` varchar(255) DEFAULT NULL,
  `alarm_group` varchar(255) DEFAULT NULL,
  `alarm_type` varchar(255) DEFAULT NULL,
  `alarm_url` varchar(255) DEFAULT NULL,
  `http_method` varchar(255) DEFAULT NULL,
  `alarm_address` varchar(255) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `modify` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_alarm_consumer
-- ----------------------------
DROP TABLE IF EXISTS `ke_alarm_consumer`;
CREATE TABLE `ke_alarm_consumer` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `lag` bigint(20) DEFAULT NULL,
  `alarm_group` varchar(255) DEFAULT NULL,
  `alarm_times` int(11) DEFAULT NULL,
  `alarm_max_times` int(11) DEFAULT NULL,
  `alarm_level` varchar(255) DEFAULT NULL,
  `is_normal` varchar(255) DEFAULT NULL,
  `is_enable` varchar(255) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `modify` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_connect_config
-- ----------------------------
DROP TABLE IF EXISTS `ke_connect_config`;
CREATE TABLE `ke_connect_config` (
  `id` bigint(20) NOT NULL AUTO_INCREMENT,
  `cluster` varchar(255) DEFAULT NULL,
  `connect_uri` varchar(255) DEFAULT NULL,
  `version` varchar(255) DEFAULT NULL,
  `alive` varchar(255) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `modify` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_consumer_bscreen
-- ----------------------------
DROP TABLE IF EXISTS `ke_consumer_bscreen`;
CREATE TABLE `ke_consumer_bscreen` (
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `logsize` bigint(20) DEFAULT NULL,
  `difflogsize` bigint(20) DEFAULT NULL,
  `offsets` bigint(255) DEFAULT NULL,
  `diffoffsets` bigint(255) DEFAULT NULL,
  `lag` bigint(255) DEFAULT NULL,
  `timespan` bigint(20) DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_consumer_group
-- ----------------------------
DROP TABLE IF EXISTS `ke_consumer_group`;
CREATE TABLE `ke_consumer_group` (
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `status` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_consumer_group_summary
-- ----------------------------
DROP TABLE IF EXISTS `ke_consumer_group_summary`;
CREATE TABLE `ke_consumer_group_summary` (
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic_number` int(11) DEFAULT NULL,
  `coordinator` varchar(255) DEFAULT NULL,
  `active_topic` int(11) DEFAULT NULL,
  `active_thread_total` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_logsize
-- ----------------------------
DROP TABLE IF EXISTS `ke_logsize`;
CREATE TABLE `ke_logsize` (
  `cluster` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `logsize` bigint(20) DEFAULT NULL,
  `diffval` bigint(20) DEFAULT NULL,
  `timespan` bigint(20) DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_metrics
-- ----------------------------
DROP TABLE IF EXISTS `ke_metrics`;
CREATE TABLE `ke_metrics` (
  `cluster` varchar(255) DEFAULT NULL,
  `broker` varchar(255) DEFAULT NULL,
  `type` varchar(255) DEFAULT NULL,
  `key` varchar(255) DEFAULT NULL,
  `value` varchar(255) DEFAULT NULL,
  `timespan` bigint(20) DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_metrics_offline
-- ----------------------------
DROP TABLE IF EXISTS `ke_metrics_offline`;
CREATE TABLE `ke_metrics_offline` (
  `cluster` varchar(255) DEFAULT NULL,
  `key` varchar(255) DEFAULT NULL,
  `one` varchar(255) DEFAULT NULL,
  `mean` varchar(255) DEFAULT NULL,
  `five` varchar(255) DEFAULT NULL,
  `fifteen` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_p_role
-- ----------------------------
DROP TABLE IF EXISTS `ke_p_role`;
CREATE TABLE `ke_p_role` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `role_name` varchar(255) DEFAULT NULL,
  `role_describer` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_resources
-- ----------------------------
DROP TABLE IF EXISTS `ke_resources`;
CREATE TABLE `ke_resources` (
  `resource_id` int(11) NOT NULL AUTO_INCREMENT,
  `name` varchar(255) DEFAULT NULL,
  `url` varchar(255) DEFAULT NULL,
  `parentId` int(11) DEFAULT NULL,
  PRIMARY KEY (`resource_id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_role_resource
-- ----------------------------
DROP TABLE IF EXISTS `ke_role_resource`;
CREATE TABLE `ke_role_resource` (
  `role_id` int(11) DEFAULT NULL,
  `resource_id` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_sql_history
-- ----------------------------
DROP TABLE IF EXISTS `ke_sql_history`;
CREATE TABLE `ke_sql_history` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `cluster` varchar(255) DEFAULT NULL,
  `username` varchar(255) DEFAULT NULL,
  `host` varchar(255) DEFAULT NULL,
  `ksql` varchar(255) DEFAULT NULL,
  `status` varchar(255) DEFAULT NULL,
  `spend_time` bigint(20) DEFAULT NULL,
  `created` varchar(255) DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_topic_offsets
-- ----------------------------
DROP TABLE IF EXISTS `ke_topic_offsets`;
CREATE TABLE `ke_topic_offsets` (
  `cluster` varchar(255) DEFAULT NULL,
  `group` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `logsize` double DEFAULT NULL,
  `offsets` varchar(255) DEFAULT NULL,
  `lag` varchar(255) DEFAULT NULL,
  `timespan` datetime DEFAULT NULL,
  `tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_topic_rank
-- ----------------------------
DROP TABLE IF EXISTS `ke_topic_rank`;
CREATE TABLE `ke_topic_rank` (
  `cluster` varchar(255) DEFAULT NULL,
  `topic` varchar(255) DEFAULT NULL,
  `tkey` varchar(255) DEFAULT NULL,
  `tvalue` bigint(20) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_users
-- ----------------------------
DROP TABLE IF EXISTS `ke_users`;
CREATE TABLE `ke_users` (
  `id` int(11) NOT NULL AUTO_INCREMENT,
  `rtxno` int(11) DEFAULT NULL,
  `username` varchar(255) DEFAULT NULL,
  `password` varchar(255) DEFAULT NULL,
  `email` varchar(255) DEFAULT NULL,
  `realname` varchar(255) DEFAULT NULL,
  PRIMARY KEY (`id`)
) ENGINE=InnoDB AUTO_INCREMENT=2 DEFAULT CHARSET=utf8;

-- ----------------------------
-- Table structure for ke_user_role
-- ----------------------------
DROP TABLE IF EXISTS `ke_user_role`;
CREATE TABLE `ke_user_role` (
  `user_id` int(11) DEFAULT NULL,
  `role_id` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;


INSERT INTO `ke`.`ke_users` (`id`, `rtxno`, `username`, `password`, `email`, `realname`) VALUES ('1', '1000', 'admin', '123456', 'admin@email.com', 'Administrator');

嘤嘤樱桃小丸子

关注

4
点赞
踩
8

收藏

觉得还不错? 一键收藏
3
评论
kafka eagle 踩坑windows安装

使用场景：安装kafka eagle windows环境，一直没有反应，报如下错：The KE_HOME environment variable is not defined correctly说一直找不到KE_HOME文件路径，直接cmd，输入命令查找%KE_HOME%也报一样的错总结了下应该是配置环境变量的问题，以下是我的环境变量配置（自认为没有问题，有问题可踢我）：然后一直启动不成功，后面，既然使用%KE_HOME%找不到指定文件，那么我就使用的手动修改，具体操作如下，..
复制链接

扫一扫

专栏目录