Flink1.11通过java代码方式运行Application模式遇到的问题及解决方案:
1.flink-yarn_2.11-1.11.0.jar与maven导入jar包冲突
pom找到对应的dependency进行exclusion即可
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-yarn_${scala.binary.version}</artifactId>
<version>${flink.version}</version>
<exclusions>
<exclusion>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-yarn-common</artifactId>
</exclusion>
</exclusions>
</dependency>
2.Flink1.11无法找到本地导入的core-site
org.apache.hadoop.conf.Configuration conf = new org.apache.hadoop.conf.Configuration();
conf.addResource(new Path("core-site.xml"));
FileSystem fs = FileSystem.get(conf);
3.flink启动报错:
Exception in thread "main" java.net.ConnectException: Call From caiyong/127.0.1.1 to localhost:8020 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
修改core-site.xml中fs.defaultFS的value为HDFS namenode的路径:端口号即可
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://ip:port</value>
</property>
</configuration>