Flink 1.13.0 集成hive 问题整理

最新推荐文章于 2022-08-11 11:50:17 发布
最新推荐文章于 2022-08-11 11:50:17 发布
阅读量1.7k 收藏 4
点赞数 2
分类专栏： flink 文章标签： hive 大数据 java
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/yswhfd/article/details/119061104
版权

文章目录

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf

Flink 1.13.0 集成 Hive 的时候，执行报错 Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf
解决方法在pom.xml 中添加下面的配置：

	    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-mapreduce-client-core</artifactId>
      <version>${hive.version}</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-common</artifactId>
      <version>${hive.version}</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-mapreduce-client-common</artifactId>
      <version>${hive.version}</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-mapreduce-client-jobclient</artifactId>
      <version>${hive.version}</version>
    </dependency>

Caused by: java.lang.ClassCastException: org.codehaus.janino.CompilerFactory cannot be cast to org.codehaus.commons.compiler.ICompilerFactory

在 $FLINK_HOME/conf/flink-conf.yaml中 添加classloader.resolve-order: parent-first

Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Unable to instantiate java compiler
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	... 10 more
Caused by: java.lang.IllegalStateException: Unable to instantiate java compiler
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.compile(JaninoRelMetadataProvider.java:428) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.load3(JaninoRelMetadataProvider.java:374) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.lambda$static$0(JaninoRelMetadataProvider.java:109) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.CacheLoader$FunctionToCacheLoader.load(CacheLoader.java:165) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3529) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2278) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2155) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2045) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache.get(LocalCache.java:3951) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.create(JaninoRelMetadataProvider.java:469) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.revise(JaninoRelMetadataProvider.java:481) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.RelMetadataQueryBase.revise(RelMetadataQueryBase.java:95) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.RelMetadataQuery.getPulledUpPredicates(RelMetadataQuery.java:784) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.rules.ReduceExpressionsRule$FilterReduceExpressionsRule.onMatch(ReduceExpressionsRule.java:151) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.AbstractRelOptPlanner.fireRule(AbstractRelOptPlanner.java:333) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.applyRule(HepPlanner.java:542) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.applyRules(HepPlanner.java:407) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.executeInstruction(HepPlanner.java:243) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepInstruction$RuleInstance.execute(HepInstruction.java:127) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.executeProgram(HepPlanner.java:202) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.findBestExp(HepPlanner.java:189) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkHepProgram.optimize(FlinkHepProgram.scala:69) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkHepRuleSetProgram.optimize(FlinkHepRuleSetProgram.scala:87) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.Iterator$class.foreach(Iterator.scala:891) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.AbstractIterable.foreach(Iterable.scala:54) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:77) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:279) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:163) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1518) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeQueryOperation(TableEnvironmentImpl.java:791) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1225) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:730) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at com.gwm.core.SmallFileMerge$.main(SmallFileMerge.scala:58) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at com.gwm.core.SmallFileMerge.main(SmallFileMerge.scala) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	... 10 more
Caused by: java.lang.ClassCastException: org.codehaus.janino.CompilerFactory cannot be cast to org.codehaus.commons.compiler.ICompilerFactory
	at org.codehaus.commons.compiler.CompilerFactoryFactory.getCompilerFactory(CompilerFactoryFactory.java:129) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.codehaus.commons.compiler.CompilerFactoryFactory.getDefaultCompilerFactory(CompilerFactoryFactory.java:79) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.compile(JaninoRelMetadataProvider.java:426) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.load3(JaninoRelMetadataProvider.java:374) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.lambda$static$0(JaninoRelMetadataProvider.java:109) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.CacheLoader$FunctionToCacheLoader.load(CacheLoader.java:165) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3529) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2278) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2155) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2045) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache.get(LocalCache.java:3951) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.create(JaninoRelMetadataProvider.java:469) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.revise(JaninoRelMetadataProvider.java:481) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.RelMetadataQueryBase.revise(RelMetadataQueryBase.java:95) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.metadata.RelMetadataQuery.getPulledUpPredicates(RelMetadataQuery.java:784) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.rel.rules.ReduceExpressionsRule$FilterReduceExpressionsRule.onMatch(ReduceExpressionsRule.java:151) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.AbstractRelOptPlanner.fireRule(AbstractRelOptPlanner.java:333) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.applyRule(HepPlanner.java:542) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.applyRules(HepPlanner.java:407) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.executeInstruction(HepPlanner.java:243) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepInstruction$RuleInstance.execute(HepInstruction.java:127) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.executeProgram(HepPlanner.java:202) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.calcite.plan.hep.HepPlanner.findBestExp(HepPlanner.java:189) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkHepProgram.optimize(FlinkHepProgram.scala:69) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkHepRuleSetProgram.optimize(FlinkHepRuleSetProgram.scala:87) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.Iterator$class.foreach(Iterator.scala:891) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.AbstractIterable.foreach(Iterable.scala:54) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:77) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:279) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:163) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1518) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeQueryOperation(TableEnvironmentImpl.java:791) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1225) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:730) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at com.gwm.core.SmallFileMerge$.main(SmallFileMerge.scala:58) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at com.gwm.core.SmallFileMerge.main(SmallFileMerge.scala) ~[flink_sql-1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.11-1.13.1.jar:1.13.1]
	... 10 more

Exception in thread “main” java.lang.NoSuchMethodError: org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;

pom 文件中添加依赖

	  <dependency>
          <groupId>commons-cli</groupId>
          <artifactId>commons-cli</artifactId>
          <version>1.4</version>
      </dependency>

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;
	at org.apache.flink.runtime.entrypoint.parser.CommandLineOptions.<clinit>(CommandLineOptions.java:27)
	at org.apache.flink.runtime.entrypoint.DynamicParametersConfigurationParserFactory.options(DynamicParametersConfigurationParserFactory.java:43)
	at org.apache.flink.runtime.entrypoint.DynamicParametersConfigurationParserFactory.getOptions(DynamicParametersConfigurationParserFactory.java:50)
	at org.apache.flink.runtime.entrypoint.parser.CommandLineParser.parse(CommandLineParser.java:42)
	at org.apache.flink.runtime.entrypoint.ClusterEntrypointUtils.parseParametersOrExit(ClusterEntrypointUtils.java:63)
	at org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint.main(YarnApplicationClusterEntryPoint.java:86)
Jhon_yh
关注
  • 2
    点赞
  • 踩
  • 4
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
flink 1.14.4 集成 hive 3.12 的依赖包
03-22
flink 集成 hive 所需要的依赖包，包括 antlr-runtime-3.5.2.jar flink-connector-hive_2.12-1.14.4.jar flink-shaded-hadoop-3-3.1.1.7.2.9.0-173-9.0.jar flink-sql-connector-hive-3.1.2_2.12-1.14.4.jar hive-...
java.lang.ClassNotFoundException org.apache.hadoop.mapred.JobConf
m0_67402341的博客
04-19 3688
场景：spark local模式调试代码时运行时 hadoop 错误 原因： 引用的 hadoop-mapreduce-client-core hadoop-common hadoop-mapreduce-client-common hadoop-mapreduce-client-jobclient 版本不一致 解决方案： 换版本 或者使用CDH
The application contains no execute() calls.
Jhon_yh的博客
12-03 2194
The application contains no execute() calls. 没有调用 execute() 方法。 2021-12-03 09:20:31 [flink-akka.actor.default-dispatcher-4] WARN ApplicationDispatcherBootstrap:169 - Application failed unexpectedly: java.util.concurrent.CompletionException: org.apache.fl
hive启动报错 java.lang.ClassNotFoundException: org.apache.hadoop.mapred.MRVersion
weixin_30794499的博客
04-04 2836
[hadoop@hadoop001 hive-1.1.0-cdh5.7.0]$ hivewhich: no hbase in (/home/hadoop/app/hive-1.1.0-cdh5.7.0/bin:/home/hadoop/app/hadoop-2.8.1/bin:/usr/java/jdk1.8.0_45/bin:/bin:/usr/local/bin:/bin:/usr/bin:/...
Flink1.13集成Hive1.1.0
liuwei0376的专栏
06-02 1552
Flink1.13集成Hive1.1.0
flink1.14.3集成hive-hbase
平平无奇小码农~
02-14 1774
1、下载flink1.14 2、配置 配置系统环境变量/etc/profile和flink的配置文件flink-conf.yaml /etc/profile 增加配置如下(这里默认jdk，haodoop都配置好)： #flink config export FLINK_HOME=/opt/module/flink-1.14.3 export HADOOP_CLASSPATH=`hadoop classpath` export PATH=$PATH:$FLINK_HOME/bin flink-conf.ya
flink 运维中遇到的问题
h952520296的博客
03-03 8551
1. Java.lang.IllegalStateException: No Executor found. Please make sure to export the HADOOP_CLASSPATH environment variable or have hadoop in your classpath. For more information refer to the "Deployment" section of the official Apache Flink documentation.
Flink集成hive
02-28
### Flink集成Hive知识点详解 #### 一、Flink与Hive集成概述 Apache Flink 是一个用于处理无界和有界数据流的开源流处理框架，它提供了丰富的API来构建复杂的数据处理管道。而Apache Hive则为用户提供了一种SQL的...
flink1.12.0集成或者连接hive3.1.2的依赖包
04-16
将 Flink 与 Hive 集成，可以充分利用 Flink 的实时处理能力与 Hive 的数据仓库功能，实现高效的数据分析。 标题提到的是 Flink 1.12.0 版本与 Hive 3.1.2 版本的集成，这是一个常见的需求，因为这两大组件的结合...
CDH6.2.0集成flink1.13.0
03-28
CDH6.2.0集成flink1.13.0包含（FLINK_ON_YARN-1.13.0.jar、FLINK-1.13.0-BIN-SCALA_2.11-el7.parcel、FLINK-1.13.0-BIN-SCALA_2.11-el7.parcel.sha、manifest.json）
flink-connector-hive-2.12-1.13.1.jar
最新发布
03-15
flink-connector-hive_2.12-1.13.1.jar 是 Apache Flink 的一个 Hive 连接器 JAR 包，用于在 Flink 中与 Apache Hive 集成。这里面的数字 2.12 和 1.13.1 分别表示了这个 JAR 包所依赖的 Scala 和 Flink 的版本。 ...
ClassCastException: org.codehaus.janino.CompilerFactory cannot be cast to org.codehaus.commons.compi
z1012890225的专栏
04-27 3069
使用flink on yarn方式提交Flink sql，抛出如下异常 org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Unable to instantiate java compiler at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:3
flinksql 提交jar包报错
java_boss_的博客
08-11 1146
flink 提交flinksql任务报错：java.lang.ClassCastException: org.codehaus.janino.CompilerFactory cannot be cast to org.codehaus.commons.compiler.ICompilerFactory
Flink：问题及解决:ClassNotFoundException: org.apache.hadoop.security.UserGroupInformation
Joseph25的博客
04-26 3079
此问题是因为flink 执行环境下缺少相关jar: 可以在lib 下补充以下jar 包 aws-java-sdk-s3-1.11.1030.jar flink-shaded-hadoop-2-uber-3.1.1.3.0.1.0-187-10.0.jar hadoop-aws-3.1.0.jar(3.1.0是你自己hadoop版本号) ...
flijnk异常Caused by: java.lang.ClassCastException: org.codehaus.janino.CompilerFactory cannot be cast ...
微信公众号：大数据从业者
08-06 1951
详细报错日志 org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Unable to instantiate java compiler at org.apache.flink.client.program.PackagedProgram.callMai...
flink1.14.0中集成hive3.1.2
硅谷工具人
10-06 2063
不想看太多的话，直接拉到第二部分操作步骤： 1. 是解决过程： 在flink1.14.0中已经移除sql-client-defaults.yml配置文件了。 参考地址：https://issues.apache.org/jira/browse/FLINK-21454 于是我顺着这个issue找到了FLIP-163这个链接。 https://cwiki.apache.org/confluen......
Flink实践：Flink1.11连接Hive2.3.6
Yuan_CSDF的博客
07-02 4309
1.先记录在实践过程中出现的不少问题： 1、在maven项目一种引入hive-exec2.3.6的包，会出现如下问题： Could not find artifact org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde的解决方法 需要在maven的setting.xml中添加如下镜像： </mirror> <mirror> <id>aliyunmaven</...
Flink cdc2.x mysql维表关联 (Flink 1.13 DataStream)
Jhon_yh的博客
12-06 4872
Flink cdc mysql维表关联需求背景模拟场景 需求背景 无论是实时还是离线场景，都离不开维表的关联。 痛点： 维表更新 ·离线处理还好，更新之后重新处理一下我们的业务逻辑即可。 ·但是流式/实时场景中，码表的更新，意味着有关联不上的数据，cdc诞生之前，我们可能会将未匹配到的数据写到‘未识别’的分区中，再跑一次离线任务关联未匹配到的数据，但是这种处理对于实时是很不友好的。 模拟场景 现有流式数据 student(id, name, age, clazz_id, clazz_name(需要
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值