使用Azkaban过程中遇到的非常见问题以及解决办法

本文档详细记录了在使用Azkaban3.9过程中遇到的启动错误、hive任务报错及UI无法访问等问题。包括变量未找到、jar包冲突和方法找不到等,提供了具体的解决步骤,如修改配置文件、替换jar包版本以及调整启动脚本等。
摘要由CSDN通过智能技术生成

使用azkaban3.9遇到的问题

启动azkaban并且安装插件遇到的问题

启动azkaban报错1:

Could not find variable substitution for variable(s) [jobtype.classpath->hadoop.classpath]

错误信息:

1) Error injecting constructor, azkaban.jobtype.JobTypeManagerException: azkaban.jobtype.JobTypeManagerException: azkaban.jobtype.JobTypeManagerException: Failed to get jobtype propertiesCould not find variable substitution for variable(s) [jobtype.classpath->hadoop.classpath]
  at azkaban.execapp.FlowRunnerManager.<init>(FlowRunnerManager.java:180)
  at azkaban.execapp.FlowRunnerManager.class(FlowRunnerManager.java:109)
  while locating azkaban.execapp.FlowRunnerManager
    for the 3rd parameter of azkaban.execapp.AzkabanExecutorServer.<init>(AzkabanExecutorServer.java:107)
  at azkaban.execapp.AzkabanExecutorServer.class(AzkabanExecutorServer.java:80)
  while locating azkaban.execapp.AzkabanExecutorServer
    for the 2nd parameter of azkaban.soloserver.AzkabanSingleServer.<init>(AzkabanSingleServer.java:51)
  while locating azkaban.soloserver.AzkabanSingleServer
​
1 error
        at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1028)
        at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1054)
        at azkaban.soloserver.AzkabanSingleServer.start(AzkabanSingleServer.java:105)
        at azkaban.soloserver.AzkabanSingleServer.main(AzkabanSingleServer.java:58)
Caused by: azkaban.jobtype.JobTypeManagerException: azkaban.jobtype.JobTypeManagerException: azkaban.jobtype.JobTypeManagerException: Failed to get jobtype propertiesCould not find variable substitution for variable(s) [jobtype.classpath->hadoop.classpath]
        at azkaban.jobtype.JobTypeManager.loadPlugins(JobTypeManager.java:66)
        at azkaban.jobtype.JobTypeManager.<init>(JobTypeManager.java:51)
        at azkaban.execapp.FlowRunnerManager.<init>(FlowRunnerManager.java:227)
        at azkaban.execapp.FlowRunnerManager$$FastClassByGuice$$f5329b23.newInstance(<generated>)
        at com.google.inject.internal.DefaultConstructionProxyFactory$FastClassProxy.newInstance(DefaultConstructionProxyFactory.java:89)
        at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:111)
        at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90)
        at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268)
        at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
        at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
        at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
        at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194)
        at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
        at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
        at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
        at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110)
        at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90)
        at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268)
        at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
        at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
        at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
        at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194)
        at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
        at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
        at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
        at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110)
        at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90)
        at com.google
  • 3
    点赞
  • 7
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值