flink-1.14.3 集群部署

1 资源准备

4台服务器：1个master、3个worker
jdk环境
flink二进制包：flink-1.14.3-bin-scala_2.11.tgz

2 基础环境准备

2.1 jdk安装

2.1 ssh免密

ssh-keygen -t rsa
一路按回车即可
cd ~/.ssh
cp id_rsa.pub authorized_keys
ssh-copy-id yq-ai-001
ssh-copy-id yq-ai-002
ssh-copy-id yq-ai-003
ssh-copy-id yq-ai-004

2.3 修改/etc/hosts文件

172.17.2.143 yq-ai-001
172.17.2.144 yq-ai-002
172.17.2.145 yq-ai-003
172.17.2.146 yq-ai-004

2.4 配置环境变量

export FLINK_HOME=/u-data/flink/flink-1.14.3
export PATH=$PATH:$FLINK_HOME/bin

3 flink部署

3.1 master节点修改配置文件

vim masters
yq-ai-001:8081

vim workers 
yq-ai-002
yq-ai-003
yq-ai-004

vim flink-conf.yaml
#指向 master 节点 jobmanager
jobmanager.rpc.address: yq-ai-001
taskmanager.numberOfTaskSlots: 16

vim flink-1.14.3/conf/flink-conf.yaml 
env.ssh.opts: -p 3333

3.2 scp到work节点

3.3 启动集群

./bin/start-cluster.sh