Flink Standalone环境的搭建

1、下载文件:flink-1.11.2-bin-scala_2.12.tgz
https://archive.apache.org/dist/flink/flink-1.11.2/

2、上传文件

上传文件到两台机器:10.101.93.156 、10.101.93.131


2、解压文件: tar -xvf flink-1.11.2-bin-scala_2.12.tgz

3、配置文件:
把10.101.93.156配置为master
把10.101.93.131配置为worker 

两台机器配置一模一样:
$ vi flink-1.11.2/conf/flink-conf.yaml
jobmanager.rpc.address: 10.101.93.156
flink-1.11.2/conf/workers
$ vi flink-1.11.2/conf/workers 
10.101.93.131
4、启动flink (在master 节点的主机上操作)
[host-10-101-93-156-vm bin]$ ./start-cluster.sh 
Starting cluster.
Starting standalonesession daemon on host host-10-101-93-156-vm.
Starting taskexecutor daemon on host host-10-101-93-131-vm.


检查进程是否启动:

[host-10-101-93-156-vm bin]$ ps -ef |grep flink
aucd      3532     1  3 14:48 pts/0    00:00:19 /usr/java/jdk1.8.0_131//bin/java -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456 -Dlog.file=/home/aucd/flink/flink-1.11.2/log/flink-aucd-standalonesession-0-host-10-101-93-156-vm.log -Dlog4j.configuration=file:/home/aucd/flink/flink-1.11.2/conf/log4j.properties -Dlog4j.configurationFile=file:/home/aucd/flink/flink-1.11.2/conf/log4j.properties -Dlogback.configurationFile=file:/home/aucd/flink/flink-1.11.2/conf/logback.xml -classpath /home/aucd/flink/flink-1.11.2/lib/flink-csv-1.11.2.jar:/home/aucd/flink/flink-1.11.2/lib/flink-json-1.11.2.jar:/home/aucd/flink/flink-1.11.2/lib/flink-shaded-zookeeper-3.4.14.jar:/home/aucd/flink/flink-1.11.2/lib/flink-table_2.12-1.11.2.jar:/home/aucd/flink/flink-1.11.2/lib/flink-table-blink_2.12-1.11.2.jar:/home/aucd/flink/flink-1.11.2/lib/log4j-1.2-api-2.12.1.jar:/home/aucd/flink/flink-1.11.2/lib/log4j-api-2.12.1.jar:/home/aucd/flink/flink-1.11.2/lib/log4j-core-2.12.1.jar:/home/aucd/flink/flink-1.11.2/lib/log4j-slf4j-impl-2.12.1.jar:/home/aucd/flink/flink-1.11.2/lib/flink-dist_2.12-1.11.2.jar::: org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint --configDir /home/aucd/flink/flink-1.11.2/conf --executionMode cluster

[host-10-101-93-131-vm conf]$ ps -ef | grep flink
aucd      7147     1  3 14:49 ?        00:00:19 /usr/java/jdk1.8.0_251/bin/java -XX:+UseG1GC -Xmx536870902 -Xms536870902 -XX:MaxDirectMemorySize=268435458 -XX:MaxMetaspaceSize=268435456 -Dlog.file=/home/aucd/flink/flink-1.11.2/log/flink-aucd-taskexecutor-4-yuanlelin-duzhimin-normal-host-10-101-93-131-vm.log -Dlog4j.configuration=file:/home/aucd/flink/flink-1.11.2/conf/log4j.properties -Dlog4j.configurationFile=file:/home/aucd/flink/flink-1.11.2/conf/log4j.properties -Dlogback.configurationFile=file:/home/aucd/flink/flink-1.11.2/conf/logback.xml -classpath /home/aucd/flink/flink-1.11.2/lib/flink-csv-1.11.2.jar:/home/aucd/flink/flink-1.11.2/lib/flink-json-1.11.2.jar:/home/aucd/flink/flink-1.11.2/lib/flink-shaded-zookeeper-3.4.14.jar:/home/aucd/flink/flink-1.11.2/lib/flink-table_2.12-1.11.2.jar:/home/aucd/flink/flink-1.11.2/lib/flink-table-blink_2.12-1.11.2.jar:/home/aucd/flink/flink-1.11.2/lib/log4j-1.2-api-2.12.1.jar:/home/aucd/flink/flink-1.11.2/lib/log4j-api-2.12.1.jar:/home/aucd/flink/flink-1.11.2/lib/log4j-core-2.12.1.jar:/home/aucd/flink/flink-1.11.2/lib/log4j-slf4j-impl-2.12.1.jar:/home/aucd/flink/flink-1.11.2/lib/flink-dist_2.12-1.11.2.jar::: org.apache.flink.runtime.taskexecutor.TaskManagerRunner --configDir /home/aucd/flink/flink-1.11.2/conf -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=134217730b -D taskmanager.memory.network.min=134217730b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=536870920b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=402653174b -D taskmanager.memory.task.off-heap.size=0b

5、打开Flink Dashboard
[host-10-101-93-156-vm conf]$ vi flink-conf.yaml
rest.port: 8081
rest.address: 10.101.93.156
重启flink 集群
浏览器输入:http://10.101.93.156:8081

  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值