Kafka Mirrormaker(支持多机房数据mirror)

1 在异地机房安装kafka,从现有服务器上copy zk和kafka软件到新的服务器上,修改配置文件主要修改的参数

server.properties

broker.id

 zookeeper.connect

如果配置认证需要这么写:

listeners=SASL_PLAINTEXT://0.0.0.0:9092
advertised.listeners=SASL_PLAINTEXT://x.x.x.x:9092  (kafka对外提供服务的ip)
security.inter.broker.protocol=SASL_PLAINTEXT 
sasl.enabled.mechanisms=PLAIN 
sasl.mechanism.inter.broker.protocol=PLAIN 
authorizer.class.name=kafka.security.auth.SimpleAclAuthorizer
allow.everyone.if.no.acl.found=true

一个完整的kafka配置文件样例:

broker.id=2
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/data/kafka-sec/data
num.partitions=32
default.replication.factor=2
num.replica.fetchers=3
num.recovery.threads.per.data.dir=3
offsets.topic.replication.factor=3
transaction.state.log.replication.factor=3
transaction.state.log.min.isr=1
message.max.bytes=20971520
replica.fetch.max.bytes=21971520
fetch.message.max.bytes=21971520
log.retention.hours=72
offsets.retention.minutes=315360000
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
zookeeper.connect=x.x.x.x:12181,x.x.x.x:12181,x.x.x.x:12181/kafka
zookeeper.connection.timeout.ms=6000
group.initial.rebalance.delay.ms=0
listeners=SASL_PLAINTEXT://0.0.0.0:19092
advertised.listeners=SASL_PLAINTEXT://x.x.x.x:19092
security.inter.broker