Druid MiddleManager Config 设置（默认只允许2个任务）

2019独角兽企业重金招聘Python工程师标准>>>

1、Druid版本是imply-2.2.3

2、问题：开启3个kafka任务时，只有2个任务正常运行

3、通过http://192.168.2.41:8090/console.html 查看任务情况。

Remote Workers

Show 102550100 entries

Search all columns: 

worker host	worker ip	worker capacity	worker version	currCapacityUsed	availabilityGroups	runningTasks	lastCompletedTaskTime
antrol41:8091	antrol41	2	0	2	["index_kafka_wikiticker_test_e00ff216527816d","index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc"]	["index_kafka_hyper_unique_order_3225f7c0fd887ac_geemblei","index_kafka_wikiticker_test_e00ff216527816d_eboaaloo","index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc_eeeidnge"]	2017-07-17T05:27:17.199Z

Showing 1 to 1 of 1 entries

发现worker capacity 只有2个，标识只能同时运行2个任务。故此3个kafka任务，只能有2个运行。

4、调整worker capacity. 任务管理是通过 MiddleManager 节点进行管理，需调整，MiddleManager中得参数。（需注意启动时使用的配置文件）本人环境启动使用的配置文件路径：

./conf-quickstart/druid/middleManager/runtime.properties

调整参数：druid.worker.capacity=3 druid.processing.numTheads=3

 

5、重启MiddleManager 节点。（kill -9 pid） 环境自动重启启动，大家有更好的启动方式可以告知下。

6、效果。

 

Running Tasks

Show 102550100 entries

Search all columns: 

id	createdTime	queueInsertionTime	location host	location port	more
index_kafka_hyper_unique_order_3225f7c0fd887ac_geemblei	2017-07-17T05:27:17.236Z	2017-07-17T05:27:17.236Z	antrol41	8100	payloadstatuslog (all)log (last 8kb)kill
index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc_eeeidnge	2017-07-17T05:27:17.233Z	2017-07-17T05:27:17.234Z	antrol41	8101	payloadstatuslog (all)log (last 8kb)kill
index_kafka_wikiticker_test_e00ff216527816d_eboaaloo	2017-07-17T05:27:22.323Z	2017-07-17T05:27:22.473Z	antrol41	8102	payloadstatuslog (all)log (last 8kb)kill

 

Remote Workers

Show 102550100 entries

Search all columns: 

worker host	worker ip	worker capacity	worker version	currCapacityUsed	availabilityGroups	runningTasks	lastCompletedTaskTime
antrol41:8091	antrol41	3	0	3	["index_kafka_hyper_unique_order_3225f7c0fd887ac","index_kafka_wikiticker_test_e00ff216527816d","index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc"]	["index_kafka_hyper_unique_order_3225f7c0fd887ac_geemblei","index_kafka_wikiticker_test_e00ff216527816d_eboaaloo","index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc_eeeidnge"]	2017-07-17T05:27:17.199Z

Showing 1 to 1 of 1 entries

转载于:https://my.oschina.net/u/3247419/blog/1438933