FLINK部署(linux)
1.文件下载
2.文件解压并启动
tar -zxvf flink-1.10.1-bin-scala_2.12.tgz
./start-cluster.sh
Starting cluster.
Starting standalonesession daemon on host localhost.localdomain.
Starting taskexecutor daemon on host localhost.localdomain.
在启动flink之前,需要安装Java的环境,并配置Java的环境变量,建议配置当前用户的环境变量。
vi .bash_profile文件中,加入JAVA_HOME和PATH俩个变量。
3.查看进程
[wm@localhost flink-1.10.1]$ jps
bash: jps: 未找到命令...
[wm@localhost flink-1.10.1]$ rpm -qa|grep -i jdk
java-1.7.0-openjdk-headless-1.7.0.261-2.6.22.2.el7_8.x86_64
copy-jdk-configs-3.3-10.el7_5.noarch
java-1.8.0-openjdk-headless-1.8.0.262.b10-1.el7.x86_64
java-1.8.0-openjdk-1.8.0.262.b10-1.el7.x86_64
java-1.7.0-openjdk-1.7.0.261-2.6.22.2.el7_8.x86_64
[wm@localhost flink-1.10.1]$ yum list *openjdk-devel*
已加载插件:fastestmirror, langpacks
Determining fastest mirrors
* base: mirrors.nju.edu.cn
* extras: mirrors.nju.edu.cn
* updates: ftp.sjtu.edu.cn
可安装的软件包
java-1.6.0-openjdk-devel.x86_64 1:1.6.0.41-1.13.13.1.el7_3 base
java-1.7.0-openjdk-devel.x86_64 1:1.7.0.261-2.6.22.2.el7_8 base
java-1.8.0-openjdk-devel.i686 1:1.8.0.362.b08-1.el7_9 updates
java-1.8.0-openjdk-devel.x86_64 1:1.8.0.362.b08-1.el7_9 updates
java-11-openjdk-devel.i686 1:11.0.18.0.10-1.el7_9 updates
java-11-openjdk-devel.x86_64 1:11.0.18.0.10-1.el7_9 updates
[wm@localhost flink-1.10.1]$ jps
bash: jps: 未找到命令...
[wm@localhost flink-1.10.1]$ yum install java-1.8.0-openjdk-devel.x86_64
已加载插件:fastestmirror, langpacks
您需要 root 权限执行此命令。
[wm@localhost flink-1.10.1]$ su yum install java-1.8.0-openjdk-devel.x86_64
su: user yum does not exist
[wm@localhost flink-1.10.1]$ su
密码:
[root@localhost flink-1.10.1]# yum install java-1.8.0-openjdk-devel.x86_64
已加载插件:fastestmirror, langpacks
Loading mirror speeds from cached hostfile
* base: mirrors.bupt.edu.cn
* extras: mirrors.bupt.edu.cn
* updates: mirrors.bupt.edu.cn
正在解决依赖关系
--> 正在检查事务
---> 软件包 java-1.8.0-openjdk-devel.x86_64.1.1.8.0.362.b08-1.el7_9 将被 安装
--> 正在处理依赖关系 java-1.8.0-openjdk(x86-64) = 1:1.8.0.362.b08-1.el7_9,它被软件包 1:java-1.8.0-openjdk-devel-1.8.0.362.b08-1.el7_9.x86_64 需要
--> 正在检查事务
---> 软件包 java-1.8.0-openjdk.x86_64.1.1.8.0.262.b10-1.el7 将被 升级
---> 软件包 java-1.8.0-openjdk.x86_64.1.1.8.0.362.b08-1.el7_9 将被 更新
--> 正在处理依赖关系 java-1.8.0-openjdk-headless(x86-64) = 1:1.8.0.362.b08-1.el7_9,它被软件包 1:java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64 需要
--> 正在检查事务
---> 软件包 java-1.8.0-openjdk-headless.x86_64.1.1.8.0.262.b10-1.el7 将被 升级
---> 软件包 java-1.8.0-openjdk-headless.x86_64.1.1.8.0.362.b08-1.el7_9 将被 更新
--> 正在处理依赖关系 tzdata-java >= 2022g,它被软件包 1:java-1.8.0-openjdk-headless-1.8.0.362.b08-1.el7_9.x86_64 需要
--> 正在检查事务
---> 软件包 tzdata-java.noarch.0.2020a-1.el7 将被 升级
---> 软件包 tzdata-java.noarch.0.2023c-1.el7 将被 更新
--> 解决依赖关系完成
依赖关系解决
============================================================================================================================================
Package 架构 版本 源 大小
============================================================================================================================================
正在安装:
java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b08-1.el7_9 updates 9.8 M
为依赖而更新:
java-1.8.0-openjdk x86_64 1:1.8.0.362.b08-1.el7_9 updates 317 k
java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b08-1.el7_9 updates 33 M
tzdata-java noarch 2023c-1.el7 updates 186 k
事务概要
============================================================================================================================================
安装 1 软件包
升级 ( 3 依赖软件包)
总计:43 M
总下载量:9.8 M
Is this ok [y/d/N]: y
Downloading packages:
警告:/var/cache/yum/x86_64/7/updates/packages/java-1.8.0-openjdk-devel-1.8.0.362.b08-1.el7_9.x86_64.rpm: 头V3 RSA/SHA256 Signature, 密钥 ID f4a80eb5: NOKEY
java-1.8.0-openjdk-devel-1.8.0.362.b08-1.el7_9.x86_64.rpm 的公钥尚未安装
java-1.8.0-openjdk-devel-1.8.0.362.b08-1.el7_9.x86_64.rpm | 9.8 MB 00:00:17
从 file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 检索密钥
导入 GPG key 0xF4A80EB5:
用户ID : "CentOS-7 Key (CentOS 7 Official Signing Key) <security@centos.org>"
指纹 : 6341 ab27 53d7 8a78 a7c2 7bb1 24c6 a8a7 f4a8 0eb5
软件包 : centos-release-7-9.2009.0.el7.centos.x86_64 (@anaconda)
来自 : /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
是否继续?[y/N]:y
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
正在更新 : tzdata-java-2023c-1.el7.noarch 1/7
正在更新 : 1:java-1.8.0-openjdk-headless-1.8.0.362.b08-1.el7_9.x86_64 2/7
warning: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/blacklisted.certs created as /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/blacklisted.certs.rpmnew
warning: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/java.policy created as /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/java.policy.rpmnew
warning: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/java.security created as /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/java.security.rpmnew
restored /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/blacklisted.certs.rpmnew to /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/blacklisted.certs
restored /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/java.policy.rpmnew to /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/java.policy
restored /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/java.security.rpmnew to /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre/lib/security/java.security
正在更新 : 1:java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64 3/7
正在安装 : 1:java-1.8.0-openjdk-devel-1.8.0.362.b08-1.el7_9.x86_64 4/7
清理 : 1:java-1.8.0-openjdk-1.8.0.262.b10-1.el7.x86_64 5/7
清理 : 1:java-1.8.0-openjdk-headless-1.8.0.262.b10-1.el7.x86_64 6/7
清理 : tzdata-java-2020a-1.el7.noarch 7/7
验证中 : 1:java-1.8.0-openjdk-headless-1.8.0.362.b08-1.el7_9.x86_64 1/7
验证中 : 1:java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64 2/7
验证中 : tzdata-java-2023c-1.el7.noarch 3/7
验证中 : 1:java-1.8.0-openjdk-devel-1.8.0.362.b08-1.el7_9.x86_64 4/7
验证中 : 1:java-1.8.0-openjdk-headless-1.8.0.262.b10-1.el7.x86_64 5/7
验证中 : 1:java-1.8.0-openjdk-1.8.0.262.b10-1.el7.x86_64 6/7
验证中 : tzdata-java-2020a-1.el7.noarch 7/7
已安装:
java-1.8.0-openjdk-devel.x86_64 1:1.8.0.362.b08-1.el7_9
作为依赖被升级:
java-1.8.0-openjdk.x86_64 1:1.8.0.362.b08-1.el7_9 java-1.8.0-openjdk-headless.x86_64 1:1.8.0.362.b08-1.el7_9
tzdata-java.noarch 0:2023c-1.el7
完毕!
[root@localhost flink-1.10.1]# jps
59680 StandaloneSessionClusterEntrypoint
59984 TaskManagerRunner
61093 Jps
当用jps查看进程出现未找到命令,执行Java -version,发现有jdk并配置了环境变量,执行rmp -qa | grep -i jdk命令查看已经安装的包,发现有jdk,安装openjdk-devel的包,执行命令yum list *openjdk-devel*.再执行yum install java-1.8.0-openjdk-devel.x86_64
3.访问ui界面
在物理机采用虚拟机的ip加端口号的形式无法访问该页面,但是在物理机可以ping通虚拟机的ip,因此怀疑虚拟机的防火防没有关闭。
1、命令行界面输入“systemctl status firewalld.service”
2、可以查看得到“active(running)”,表示防火墙已经被打开了。
3、然后输入 systemctl stop firewalld.service 命令,关闭防火墙。
4、在输入命令 systemctl status firewalld.service,下方出现disavtive(dead),说明防火墙已经关闭。
5、输入命令“systemctl disable firewalld.service”就可以永久关闭防火墙。
4.上传job
将工程打包成jar包,上传到ui页面对应的位置
entry class是启动类的入口,program arguments是启动的参数配置,parallelism是并行的数,并行数的优先级代码局部的>代码里全局的 >ui界面的>conf文件的,show plan 可以看到代码的过程。