Azkaban two server mode模式运行的一个坑

现象描述

运行一个job产生报错：

01-03-2018 12:59:01 CST foo ERROR - Job run failed!
azkaban.utils.UndefinedPropertyException: Missing required property 'azkaban.native.lib'
    at azkaban.utils.Props.getString(Props.java:421)
    at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:234)
    at azkaban.execapp.JobRunner.runJob(JobRunner.java:748)
    at azkaban.execapp.JobRunner.doRun(JobRunner.java:591)
    at azkaban.execapp.JobRunner.run(JobRunner.java:552)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
01-03-2018 12:59:01 CST foo ERROR - Missing required property 'azkaban.native.lib' cause: null

解决方案

官网描述：

$>cd /opt/app/azkaban-exec-server-0.1.0-SNAPSHOT/
$>mkdir -p plugins/jobtypes
$>cd plugins/jobtypes
$>cp /opt/source/azkaban-3.38.0/az-exec-util/src/main/c/execute-as-user.c .
$>gcc execute-as-user.c -o execute-as-user
$>sudo chown root execute-as-user
$>sudo chmod 6050 execute-as-user

$>vi commonprivate.properties
  execute-as-user=false
  azkaban.native.lib=/opt/app/azkaban-exec-server-0.1.0-SNAPSHOT/plugins/jobtypes

再度运行，依然报错：

01-03-2018 14:40:04 CST foo ERROR - Failed to change current working directory ownership. Error code: 1
01-03-2018 14:40:04 CST foo ERROR - Job run failed!
java.lang.Exception: Failed to change current working directory ownership. Error code: 1
    at azkaban.jobExecutor.ProcessJob.handleError(ProcessJob.java:428)
    at azkaban.jobExecutor.ProcessJob.assignUserFileOwnership(ProcessJob.java:407)
    at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:247)
    at azkaban.execapp.JobRunner.runJob(JobRunner.java:748)
    at azkaban.execapp.JobRunner.doRun(JobRunner.java:591)
    at azkaban.execapp.JobRunner.run(JobRunner.java:552)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
01-03-2018 14:40:04 CST foo ERROR - Failed to change current working directory ownership. Error code: 1 cause: null

通过这段报错依然无法定位问题，通过控制台打印的日志信息发现：

2018/03/01 14:38:24.451 +0800 INFO [ExecuteAsUser] Command: [touch, /opt/app/azkaban-exec-server-0.1.0-SNAPSHOT/executions/1/user_can_write]
user does not exist: ruoze2018/03/01 14:38:24.458 +0800 INFO [ExecuteAsUser] Command: [chown, ruoze:azkaban, /opt/app/azkaban-exec-server-0.1.0-SNAPSHOT/executions/1]
Changing user: user: root, uid: 0, gid: 0
user command starting from: chown
chown: invalid user: `ruoze:azkaban'

发现问题所在，创建用户ruoze和组azkaban，之后重新执行foo，成功运行