kafka相关命令

topic相关

创建topic

kafka-topics.sh --bootstrap-server ${kafkaAddress} --create --topic ${topicName} --partitions ${partipartions} --replication-factor ${replication}

查看topic

kafka-topics.sh --bootstrap-server ${kafkaAddress} --topic ${topicName} --describe

查看topic集合

kafka-topics.sh --bootstrap-server ${kafkaAddress} --list

删除topic

kafka-topics.sh --bootstrap-server ${kafkaAddress} --delete  --topic ${topicName}

消费topic

kafka-console-consumer.sh --bootstrap-server ${kafkaAddress} --topic ${topicName} --from-beginning

查看kafka consumer group 消费情

kafka-consumer-groups.sh --describe --bootstrap-server ${kafkaAddress} --group ${groupName}

截图

已经创建的topic修改partipartions 和 replication-factor 数量

修改partitions数量

kafka-topics.sh --bootstrap-server ${kafkaAddress} --topic ${topicName} --alter --partitions 4

创建increase-replication-factor.json in config,配置各分区replication-factor位置

{
  "version": 1,
  "partitions": [
    {
      "topic": "${topicName}",
      "partition": 0,
      "replicas": [
        0,
        1
      ]
    },
    {
      "topic": "${topicName}",
      "partition": 1,
      "replicas": [
        1,
        2
      ]
    },
    {
      "topic": "${topicName}",
      "partition": 2,
      "replicas": [
        2,
        3
      ]
    },
    {
      "topic": "${topicName}",
      "partition": 3,
      "replicas": [
        3,
        0
      ]
    }
  ]
}

更新replication-factor

kafka-reassign-partitions.sh --bootstrap-server ${kafkaAddress} --reassignment-json-file config/increase-replication-factor.json --execute