kafka partition increase & reassignment

–Topic increase
/opt/tools/kafka_2.11-0.11.0.3/bin/kafka-topics.sh --zookeeper 10.170.52.166:2181 --create --topic flightReserved --replication-factor 1 --partitions 1
/opt/tools/kafka_2.11-0.11.0.3/bin/kafka-topics.sh --zookeeper 10.170.52.166:2181 --alter --topic flightReserved --replication-factor 1 --partitions 2
/opt/tools/kafka_2.11-0.11.0.3/bin/kafka-topics.sh --zookeeper 10.170.52.166:2181 --describe |grep flightReserved

–Partition reassignment
./kafka-reassign-partitions.sh --generate --zookeeper 10.170.52.166:2181 --topics-to-move-json-file test.json --broker-list “1,2”
test.json
{“topics”:
[{“topic”: “flightReserved”}],
“version”:1
}

Save the result to reassginment.json
{“version”:1,“partitions”:[{“topic”:“flightReserved”,“partition”:2,“replicas”:[1]},{“topic”:“flightReserved”,“partition”:5,“replicas”:[2]},{“topic”:“flightReserved”,“partition”:4,“replicas”:[1]},{“topic”:“flightReserved”,“partition”:1,“replicas”:[2]},{“topic”:“flightReserved”,“partition”:3,“replicas”:[2]},{“topic”:“flightReserved”,“partition”:0,“replicas”:[1]}]}

./kafka-reassign-partitions.sh --zookeeper 10.170.52.166:2181 --reassignment-json-file reassginment.json --execute
./kafka-reassign-partitions.sh --zookeeper 10.170.52.166:2181 --reassignment-json-file reassginment.json --verify

–modify replication
increase-replication-factor.json
{“version”:1,
“partitions”:[
{“topic”:“flightReserved”,“partition”:0,“replicas”:[1,2]}
]}
./kafka-reassign-partitions.sh --zookeeper 10.170.52.166:2181 --reassignment-json-file increase-replication-factor.json --execute
/opt/tools/kafka_2.11-0.11.0.3/bin/kafka-topics.sh --zookeeper 10.170.52.166:2181 --describe |grep flightReserved

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值