大数据环境运维

大数据环境运维

[TOC]

1. kafka运维汇总

1.1 topic的Leader: none或-1 导致生产消费均超时

• 现象

# bin/kafka-topics.sh --describe  --zookeeper localhost:2181 --topic HUMAN_SNAP_INFO

Topic:HUMAN_SNAP_INFO   PartitionCount:10       ReplicationFactor:1     Configs:
        Topic: HUMAN_SNAP_INFO  Partition: 0    Leader: none    Replicas: 0     Isr: 
        Topic: HUMAN_SNAP_INFO  Partition: 1    Leader: none    Replicas: 0     Isr: 
        Topic: HUMAN_SNAP_INFO  Partition: 2    Leader: none    Replicas: 0     Isr: 
        Topic: HUMAN_SNAP_INFO  Partition: 3    Leader: none    Replicas: 0     Isr: 
        Topic: HUMAN_SNAP_INFO  Partition: 4    Leader: none    Replicas: 0     Isr: 
        Topic: HUMAN_SNAP_INFO  Partition: 5    Leader: none    Replicas: 0     Isr: 
        Topic: HUMAN_SNAP_INFO  Partition: 6    Leader: none    Replicas: 0     Isr: 
        Topic: HUMAN_SNAP_INFO  Partition: 7    Leader: none    Replicas: 0     Isr: 
        Topic: HUMAN_SNAP_INFO  Partition: 8    Leader: none    Replicas: 0     Isr: 
        Topic: HUMAN_SNAP_INFO  Partition: 9    Leader: none    Replicas: 0     Isr:

• 解决方案

bin/zkCli.sh -server hdh109
rmr /controller

• 原因

转载于:https://my.oschina.net/ibobby/blog/3102261