topic partition leader rebalance

最新推荐文章于 2022-07-03 16:56:25 发布

woloqun

最新推荐文章于 2022-07-03 16:56:25 发布

阅读量1.2k

点赞数

分类专栏： kafka 文章标签： topic leader rebalance

本文链接：https://blog.csdn.net/woloqun/article/details/104018353

版权

kafka 专栏收录该内容

8 篇文章 0 订阅

订阅专栏

leader rebalance之前，有好几个分区的leader都在broker1上

[root@es1 ~]# kafka-topics.sh --describe --zookeeper localhost:2181 --topic resshows_test
Topic:resshows_test  PartitionCount:6    ReplicationFactor:2 Configs:retention.ms=345600000,cleanup.policy=delete
    Topic: resshows_test Partition: 0    Leader: 1   Replicas: 1,2   Isr: 1,2
    Topic: resshows_test Partition: 1    Leader: 2   Replicas: 2,3   Isr: 2,3
    Topic: resshows_test Partition: 2    Leader: 1   Replicas: 3,1   Isr: 1,3
    Topic: resshows_test Partition: 3    Leader: 1   Replicas: 1,3   Isr: 1,3
    Topic: resshows_test Partition: 4    Leader: 1   Replicas: 2,1   Isr: 1,2
    Topic: resshows_test Partition: 5    Leader: 3   Replicas: 3,2   Isr: 2,3

编写rebalance文件
vi resshows_test.json

{"partitions":[{"topic":"resshows_test","partition": 0},{"topic":"resshows_test","partition": 1},{"topic":"resshows_test","partition": 2},{"topic":"resshows_test","partition": 3},{"topic":"resshows_test","partition": 4},{"topic":"resshows_test","partition": 5}]}

leader重新均衡

kafka-preferred-replica-election.sh --zookeeper localhost:2181 --path-to-json-file resshows_test.json

均衡之后

[root@es1 ~]# kafka-topics.sh --describe --zookeeper localhost:2181 --topic resshows_test
Topic:resshows_test  PartitionCount:6    ReplicationFactor:2 Configs:retention.ms=345600000,cleanup.policy=delete
    Topic: resshows_test Partition: 0    Leader: 1   Replicas: 1,2   Isr: 1,2
    Topic: resshows_test Partition: 1    Leader: 2   Replicas: 2,3   Isr: 2,3
    Topic: resshows_test Partition: 2    Leader: 3   Replicas: 3,1   Isr: 1,3
    Topic: resshows_test Partition: 3    Leader: 1   Replicas: 1,3   Isr: 1,3
    Topic: resshows_test Partition: 4    Leader: 2   Replicas: 2,1   Isr: 1,2
    Topic: resshows_test Partition: 5    Leader: 3   Replicas: 3,2   Isr: 2,3