环境搭建_NIFI集群

环境：准备三台NIFI单实例的机器

IP	系统
192.168.186.130	Center OS 7
192.168.186.131	Center OS 7
192.168.186.132	Center OS 7

注： NiFi有集成的Zookeeper， 可以不在单独安装， 而是通过NiFi配置启用内置zookeeper服务

1.3个节点都配置conf/zookeeper.properties

vim conf/zookeeper.properties

clientPort=2188
initLimit=10
autopurge.purgeInterval=24
syncLimit=5
tickTime=2000
dataDir=./state/zookeeper
autopurge.snapRetainCount=30

server.1=192.168.186.130:3888:4888
server.2=192.168.186.131:3888:4888
server.3=192.168.186.132:3888:4888

2./nifi/nifi-1.11.4下创建文件

mkdir state
mkdir state/zookeeper
echo 1 > state/zookeeper/myid #根据节点创造不通的myid 1 2 3 。。为例

3.配置/nifi/nifi-1.11.4/conf/nifi.properties文件

vim /nifi/nifi-1.11.4/conf/nifi.properties

nifi.state.management.embedded.zookeeper.start=true

# web properties #
nifi.web.war.directory=./lib
nifi.web.http.host=192.168.186.130
#nifi.web.http.host=192.168.186.131
#nifi.web.http.host=192.168.186.132
nifi.web.http.port=8082
nifi.web.http.network.interface.default=
nifi.web.jetty.working.directory=./work/jetty
nifi.web.jetty.threads=200
nifi.web.max.header.size=16 KB
nifi.web.proxy.context.path=
nifi.web.proxy.host=

# cluster node properties (only configure for cluster nodes) #
nifi.cluster.is.node=true
nifi.cluster.node.address=192.168.186.130 
#nifi.cluster.node.address=192.168.186.131 
#nifi.cluster.node.address=192.168.186.132 
nifi.cluster.node.protocol.port=9998
nifi.cluster.flow.election.max.wait.time=20 sec
nifi.cluster.flow.election.max.candidates=1

# zookeeper properties, used for cluster management #
nifi.zookeeper.connect.string=192.168.186.130:2188,192.168.186.131:2188,192.168.186.132:2188
nifi.zookeeper.connect.timeout=3 secs
nifi.zookeeper.session.timeout=3 secs
nifi.zookeeper.root.node=/nifi

4.配置conf/state-management.xml

vim conf/state-management.xml

<cluster-provider>
<id>zk-provider</id>
<class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>
<property name="Connect String">192.168.186.130:2188,192.168.186.131:2188,192.168.186.132:2188</property>
<property name="Root Node">/nifi</property>
<property name="Session Timeout">10 seconds</property>
<property name="Access Control">Open</property>
</cluster-provider>

相关命令

bin/nifi.sh start  #启动命令
bin/nifi.sh stop   #关闭命令
bin/nifi.sh status #查看运行状态