azkaban配置任务失败重试

最新推荐文章于 2025-07-03 11:56:08 发布

原创最新推荐文章于 2025-07-03 11:56:08 发布 · 8k 阅读

9 ·

CC 4.0 BY-SA版权

文章标签：

#azkaban

azkaban 专栏收录该内容

3 篇文章

订阅专栏

本文介绍了如何在Azkaban中配置任务，包括创建spring.job和summer.job，其中summer.sh设定为故意失败。当任务失败时，Azkaban会自动触发重试机制，从flow的日志中可以观察到重试过程的相关信息。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

retries=1  ##失败的job的自动重试的次数
retry.backoff=10000  ##重试的间隔（毫秒）

创建spring.job

type=command
command=echo "spring start... now is : ${azkaban.flow.start.year}-${azkaban.flow.start.month}-${azkaban.flow.start.day}"
retries=1
retry.backoff=10000

创建summer.job 这里的summer.sh可以直接报错

type=command
dependencies=spring
command=sh summer.sh ${azkaban.job.attempt}  #job重试次数，从0开始增加
retries=3
retry.backoff=10000

打成zip包上传测试即可
在flow可以看到任务重试的日志

18-11-2019 17:26:09 CST summer INFO - Assigned executor : sz-pg-entps-dev-034.tendcloud.com:12321
18-11-2019 17:26:09 CST summer INFO - Running execid:28 flow:summer project:2 version:12
18-11-2019 17:26:09 CST summer INFO - Updating initial flow directory.
18-11-2019 17:26:09 CST summer INFO - Fetching job and shared properties.
18-11-2019 17:26:09 CST summer INFO - Starting flows
18-11-2019 17:26:09 CST summer INFO - Running flow 'summer'.
18-11-2019 17:26:09 CST summer INFO - Configuring Azkaban metrics tracking for jobrunner object
18-11-2019 17:26:09 CST summer INFO - Submitting job 'spring' to run.
18-11-2019 17:26:09 CST summer INFO - Created file appender for job spring
18-11-2019 17:26:09 CST summer INFO - Attached file appender for job spring
18-11-2019 17:26:09 CST summer INFO - Job Started: spring
18-11-2019 17:26:09 CST summer INFO - No attachment file for job spring written.
18-11-2019 17:26:09 CST summer INFO - Job spring finished with status SUCCEEDED in 0 seconds
18-11-2019 17:26:09 CST summer INFO - Configuring Azkaban metrics tracking for jobrunner object
18-11-2019 17:26:09 CST summer INFO - Submitting job 'summer' to run.
18-11-2019 17:26:09 CST summer INFO - Created file appender for job summer
18-11-2019 17:26:09 CST summer INFO - Attached file appender for job summer
18-11-2019 17:26:09 CST summer INFO - Job Started: summer
18-11-2019 17:26:09 CST summer INFO - No attachment file for job summer written.
18-11-2019 17:26:09 CST summer INFO - Job summer finished with status FAILED in 0 seconds
18-11-2019 17:26:09 CST summer INFO - Job 'summer' will be retried. Attempt 0 of 2
18-11-2019 17:26:09 CST summer INFO - Configuring Azkaban metrics tracking for jobrunner object
18-11-2019 17:26:09 CST summer INFO - Submitting job 'summer' to run.
18-11-2019 17:26:09 CST summer INFO - Created file appender for job summer
18-11-2019 17:26:09 CST summer INFO - Attached file appender for job summer
18-11-2019 17:26:19 CST summer INFO - Job Started: summer
18-11-2019 17:26:19 CST summer INFO - No attachment file for job summer written.
18-11-2019 17:26:19 CST summer INFO - Job summer finished with status FAILED in 0 seconds
18-11-2019 17:26:19 CST summer INFO - Job 'summer' will be retried. Attempt 1 of 2
18-11-2019 17:26:19 CST summer INFO - Configuring Azkaban metrics tracking for jobrunner object
18-11-2019 17:26:19 CST summer INFO - Submitting job 'summer' to run.
18-11-2019 17:26:19 CST summer INFO - Created file appender for job summer
18-11-2019 17:26:19 CST summer INFO - Attached file appender for job summer
18-11-2019 17:26:29 CST summer INFO - Job Started: summer
18-11-2019 17:26:29 CST summer INFO - No attachment file for job summer written.
18-11-2019 17:26:29 CST summer INFO - Job summer finished with status FAILED in 0 seconds
18-11-2019 17:26:29 CST summer INFO - Job 'summer' has run out of retry attempts
18-11-2019 17:26:29 CST summer INFO - Setting summer to FAILED_FINISHING
18-11-2019 17:26:29 CST summer INFO - Setting flow '' status to FAILED in 20 seconds
18-11-2019 17:26:29 CST summer INFO - Finishing up flow. Awaiting Termination
18-11-2019 17:26:29 CST summer INFO - Finished Flow
18-11-2019 17:26:29 CST summer INFO - Setting end time for flow 28 to 1574069189314