flink
机智的大脚猴
这个作者很懒,什么都没留下…
展开
-
入坑Flink - Flink on Yarn提交任务异常
入坑Flink - Flink on Yarn提交任务异常在通过 flink run -m yarn-cluster 提交任务过程中任务一直created查看jobManager日志发现jar包冲突2021-01-25 16:43:51,735 INFO org.apache.flink.yarn.YarnResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job原创 2021-01-25 17:53:00 · 1826 阅读 · 0 评论 -
NoClassDefFoundError: org/apache/flink/runtime/state/StateBackend
jar包冲突引起的… …Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/flink/runtime/state/StateBackend at org.apache.flink.streaming.api.scala.StreamExecutionEnvironment$.getExecutionEnv...原创 2019-09-04 16:42:39 · 4371 阅读 · 0 评论 -
入坑Flink - Flink源码编译
准备工作参考官网:https://ci.apache.org/projects/flink/flink-docs-release-1.8/flinkDev/building.html1、jdkjava version "1.8.0_171"Java(TM) SE Runtime Environment (build 1.8.0_171-b11)Java HotSpot(TM) 64-B...原创 2019-09-20 22:09:50 · 2240 阅读 · 4 评论 -
入坑Flink - Flink安装部署(单机模式)
1、Flink单机模式1、将编译后的包拷贝到安装目录cp -r flink-dist/target/flink-1.8.2-bin/flink-1.8.2/ /opt/platform/2、改变文件所属chown -R dc:dc flink-1.8.23、修改默认端口号(conf/flink-conf.yaml )# The RPC port where the JobManag...原创 2019-09-29 16:01:03 · 3425 阅读 · 1 评论 -
入坑Flink - Flink On YARN
将flink脚本提交到Yarn集群有2种方式1、Start a long-running Flink cluster on YARN1、启动FlinkCluster:./bin/yarn-session.sh -jm 1024m -tm 4096m2、提交flink程序到FlinkCluster./bin/flink run ./examples/batch/WordCount.jar ...原创 2019-09-29 16:38:42 · 240 阅读 · 1 评论