跟我学Kafka之Controller控制器详解

      

作者｜小程

编辑｜包包

我们的kafka源码分享已经进行过很多期了，主要的内容也都分享的差不多了，那么在今后的分享中，主要集中在kafka性能优化和使用。

    

     

Kafka集群中的其中一个Broker会被选举为Controller，主要负责Partition管理和副本状态管理，也会执行类似于重分配Partition之类的管理任务。如果当前的Controller失败，会从其他正常的Broker中重新选举Controller。

进入KafkaController.scala文件看到如下代码：

class KafkaController(val config : KafkaConfig, zkClient: ZkClient, val brokerState: BrokerState) extends Logging with KafkaMetricsGroup {	
  this.logIdent = "[Controller " + config.brokerId + "]: "	
  private var isRunning = true	
  private val stateChangeLogger = KafkaController.stateChangeLogger	
  val controllerContext = new ControllerContext(zkClient, config.zkSessionTimeoutMs)	
  val partitionStateMachine = new PartitionStateMachine(this)	
  val replicaStateMachine = new ReplicaStateMachine(this)	
  private val controllerElector = new ZookeeperLeaderElector(controllerContext, ZkUtils.ControllerPath, onControllerFailover,	
    onControllerResignation, config.brokerId)	
  // have a separate scheduler for the controller to be able to start and stop independently of the	
  // kafka server	
  private val autoRebalanceScheduler = new KafkaScheduler(1)	
  var deleteTopicManager: TopicDeletionManager = null	
  val offlinePartitionSelector = new OfflinePartitionLeaderSelector(controllerContext, config)	
  private val reassignedPartitionLeaderSelector = new ReassignedPartitionLeaderSelector(controllerContext)	
  private val preferredReplicaPartitionLeaderSelector = new PreferredReplicaPartitionLeaderSelector(controllerContext)	
  private val controlledShutdownPartitionL