Flink集群安装部署

Flink集群安装部署

前期准备：hadoop完全分布式集群

下载flink安装包

wget -g https://archive.apache.org/dist/flink/flink-1.14.0/flink-1.14.0-bin-scala_2.12.tgz

解压flink安装包

tar -zxvf flink-1.14.0-bin-scala_2.11.tgz -C /usr/local/src/

给文件夹改个简单点的名字

mv /usr/local/src/flink-1.14.0/ /usr/local/src/flink

编辑/etc/profile文件

添加如下配置

vim /etc/profile

#flink
export FLINK_HOME=/usr/local/src/flink
export PATH=$PATH:$FLINK_HOME/bin

修改flink-conf.yaml文件

vim /usr/local/src/flink/conf/

25E7%25BE%25A4%25E5%25AE%2589%25E8%25A3%2585%25E9%2583%25A8%25E7%25BD%25B2.assets%2Fimage-20240528224143748.png&pos_id=img-mj7qhnmO-1716908630740)

修改flink配置文件中的master和workers文件

vim /usr/local/src/flink/conf/masters
master:8081
vim /usr/local/src/flink/conf/workers
slave1
slave2

把配置好的flink文件夹分发给slave1和slave2

scp -r /usr/local/src/flink/ root@slave1:/usr/local/src/
scp -r /usr/local/src/flink/ root@slave2:/usr/local/src/

把/etc/profile文件分发给slave1和slave2

scp -r /etc/profile slave1:/etc/profile
scp -r /etc/profile slave2:/etc/profile

使环境变量生效

source /etc/profile

启动flink standalone集群后，可以使用flink client向该集群master节点提交任务

flink run -m master:8081 /usr/local/src/flink/examples/batch/WordCount.jar