Kafka源码
123 黑曼巴
黑曼巴
展开
-
Kafka核心源码解析 - KafkaApis源码解析
KafkaApis负责处理所有请求,转发到相应到方法1.KafkaApis初始化/* start processing requests */apis = new KafkaApis(socketServer.requestChannel, replicaManager, adminManager, groupCoordinator, transactionCoordinator, kafkaController, zkClient, config.brokerId, config原创 2020-06-18 00:01:31 · 420 阅读 · 0 评论 -
Kafka核心源码解析 - SocketServer源码解析
1.初始化和启动 SocketServervar socketServer: SocketServer = null。。。// Create and start the socket server acceptor threads so that the bound port is known.// Delay starting processors until the end of the initialization sequence to ensure// that credentials原创 2020-06-17 23:47:11 · 295 阅读 · 0 评论 -
Kafka核心源码解析 - LogManager源码解析
1.LogManager初始化与启动var logManager: LogManager = null...//这里省略部分代码逻辑//logManager = LogManager(config, initialOfflineDirs, zkClient, brokerState, kafkaScheduler, time, brokerTopicStats, logDirFailureChannel)logManager.startup()1.1.LogManager初始化object原创 2020-06-17 23:01:36 · 244 阅读 · 0 评论 -
Kafka核心源码解析 - KafkaController源码解析
在进入源码解析之前,我先来介绍一些KafkaController在Kafka集群中的作用。(1)负责监听zookeeper上所有的元数据变更请求;(2)负责topic的partition迁移任务分发;KafkaServer类中初始化,并启动KafkaControllervar kafkaController: KafkaController = null...//这里省略部分代码逻辑//当broker节点启动时,会在KafkaServer的startup方法中初始化kafkaControlle原创 2020-06-17 22:26:42 · 414 阅读 · 0 评论 -
Kafka源码解析 - 副本迁移任务提交流程
1.副本迁移脚本#这里省略了脚本参数bin/kafka-reassign-partitions.sh2.副本迁移任务提交流程解析原创 2020-06-16 23:12:49 · 277 阅读 · 0 评论 -
kafka源码编译及开发环境搭建
1.安装gradle1.gradle各版本下载跟路径 https://services.gradle.org/distributions/2.我们这里下载和kafka 2.3.1版本匹配的gradle版本,5.4.1 https://services.gradle.org/distributions/gradle-5.4.1-bin.zip3.解压 cd /users/yyj/soft tar xvzf gradle-5.4.1-bin.zip4.配置gradle环境原创 2020-06-16 22:45:01 · 8598 阅读 · 0 评论