flink客户端提交任务报错

1. 通过flink 客户端提交任务 出现一下错误

2. 需要在flink 配置文件flink-conf.yaml中加入 参数就不会报错了

classloader.resolve-order: parent-first

{
“errors”: [
“org.apache.flink.runtime.rest.handler.RestHandlerException: Could not execute application.\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequestKaTeX parse error: Undefined control sequence: \n at position 26: …ndler.java:110)\̲n̲\tat java.util.…UniHandle.tryFire(CompletableFuture.java:797)\n\tat java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)\n\tat java.util.concurrent.CompletableFutureKaTeX parse error: Undefined control sequence: \n at position 45: …ture.java:1595)\̲n̲\tat java.lang.…AsyncSupply.run(CompletableFuture.java:1592)\n\t… 1 more\nCaused by: org.apache.flink.util.FlinkRuntimeException: Could not execute application.\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:88)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70)\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequestKaTeX parse error: Undefined control sequence: \n at position 26: …ndler.java:104)\̲n̲\tat java.util.…AsyncSupply.run(CompletableFuture.java:1590)\n\t… 1 more\nCaused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Unable to instantiate java compiler\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)\n\tat org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)\n\tat org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84)\n\t… 4 more\nCaused by: java.lang.IllegalStateException: Unable to instantiate java compiler\n\tat org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.compile(JaninoRelMetadataProvider.java:428)\n\tat org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.load3(JaninoRelMetadataProvider.java:374)\n\tat org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.lambda$staticKaTeX parse error: Undefined control sequence: \n at position 38: …vider.java:109)\̲n̲\tat org.apache…FunctionToCacheLoader.load(CacheLoader.java:165)\n\tat org.apache.flink.calcite.shaded.com.google.common.cache.LocalCacheKaTeX parse error: Undefined control sequence: \n at position 55: …ache.java:3529)\̲n̲\tat org.apache…Segment.loadSync(LocalCache.java:2278)\n\tat org.apache.flink.calcite.shaded.com.google.common.cache.LocalCacheKaTeX parse error: Undefined control sequence: \n at position 46: …ache.java:2155)\̲n̲\tat org.apache…Segment.get(LocalCache.java:2045)\n\tat org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache.get(LocalCache.java:3951)\n\tat org.apache.flink.calcite.shaded.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)\n\tat org.apache.flink.calcite.shaded.com.google.common.cache.LocalCacheKaTeX parse error: Undefined control sequence: \n at position 44: …ache.java:4958)\̲n̲\tat org.apache…ProjectReduceExpressionsRule.onMatch(ReduceExpressionsRule.java:303)\n\tat org.apache.calcite.plan.AbstractRelOptPlanner.fireRule(AbstractRelOptPlanner.java:333)\n\tat org.apache.calcite.plan.hep.HepPlanner.applyRule(HepPlanner.java:542)\n\tat org.apache.calcite.plan.hep.HepPlanner.applyRules(HepPlanner.java:407)\n\tat org.apache.calcite.plan.hep.HepPlanner.executeInstruction(HepPlanner.java:243)\n\tat org.apache.calcite.plan.hep.HepInstructionKaTeX parse error: Undefined control sequence: \n at position 46: …ction.java:127)\̲n̲\tat org.apache…anonfun$optimizeKaTeX parse error: Undefined control sequence: \n at position 32: …ogram.scala:62)\̲n̲\tat scala.coll…anonfun$foldLeftKaTeX parse error: Undefined control sequence: \n at position 29: …Once.scala:156)\̲n̲\tat scala.coll…anonfun$foldLeft 1 1 1adapted(TraversableOnce.scala:156)\n\tat scala.collection.Iterator.foreach(Iterator.scala:937)\n\tat scala.collection.Iterator.foreachKaTeX parse error: Undefined control sequence: \n at position 21: …ator.scala:937)\̲n̲\tat scala.coll…(IterableLike.scala:69)\n\tat scala.collection.AbstractIterable.foreach(Iterable.scala:54)\n\tat scala.collection.TraversableOnce.foldLeft(TraversableOnce.scala:156)\n\tat scala.collection.TraversableOnce.foldLeft$(TraversableOnce.scala:154)\n\tat scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)\n\tat org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:58)\n\tat org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:161)\n\tat org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)\n\tat org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)\n\tat org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:300)\n\tat org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:183)\n\tat org.apache.flink.table.api.bridge.java.internal.StreamTableEnvironmentImpl.toStreamInternal(StreamTableEnvironmentImpl.java:437)\n\tat org.apache.flink.table.api.bridge.java.internal.StreamTableEnvironmentImpl.toRetractStream(StreamTableEnvironmentImpl.java:539)\n\tat org.apache.flink.table.api.bridge.java.internal.StreamTableEnvironmentImpl.toRetractStream(StreamTableEnvironmentImpl.java:528)\n\tat com.wudl.flink.job.FlinkSqlMysqlToMySql.main(FlinkSqlMysqlToMySql.java:68)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)\n\t… 7 more\nCaused by: java.lang.ClassCastException: org.codehaus.janino.CompilerFactory cannot be cast to org.codehaus.commons.compiler.ICompilerFactory\n\tat org.codehaus.commons.compiler.CompilerFactoryFactory.getCompilerFactory(CompilerFactoryFactory.java:129)\n\tat org.codehaus.commons.compiler.CompilerFactoryFactory.getDefaultCompilerFactory(CompilerFactoryFactory.java:79)\n\tat org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.compile(JaninoRelMetadataProvider.java:426)\n\t… 58 more\n”
]
}

  • 1
    点赞
  • 3
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
Flink中,我们可以使用多种方式提交任务到集群上,以下是其中常用的两种方式: 1. 使用Flink Web UI提交任务Flink提供了一个Web UI,我们可以通过该界面方便地提交任务到集群上。具体步骤如下: 1. 打开Flink Web UI,地址为 `http://<flink-master>:8081`,其中 `<flink-master>` 是Flink集群的Master节点的IP地址或主机名。 2. 点击页面右上角的 "Submit new Job" 按钮,进入任务提交界面。 3. 在任务提交界面中,选择要提交任务Jar包,填写任务相关参数(例如并行度、任务名称等),然后点击 "Submit" 按钮即可。 2. 使用Flink命令行工具提交任务Flink还提供了一个命令行工具 `flink run`,我们可以通过该工具在命令行中提交任务到集群上。具体步骤如下: 1. 在Flink集群的任意节点上打开终,输入以下命令进入Flink安装目录: ``` cd <flink-install-dir> ``` 其中 `<flink-install-dir>` 是Flink的安装目录。 2. 使用以下命令提交任务: ``` ./bin/flink run -c <job-class> <job-jar> [options] ``` 其中: - `<job-class>` 是Flink应用程序的主类名。 - `<job-jar>` 是Flink应用程序的Jar包路径。 - `[options]` 是可选参数,可以指定任务相关的参数,例如并行度、任务名称等。 例如,如果我们要提交一个名为 `WordCount` 的Flink应用程序,其主类为 `com.example.WordCount`,Jar包路径为 `/path/to/WordCount.jar`,并行度为4,可以使用以下命令提交任务: ``` ./bin/flink run -c com.example.WordCount -p 4 /path/to/WordCount.jar ``` 以上是两种常用的提交Flink任务到集群的方式,可以根据实际需求选择。

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值