oozie 客户端常用命令

Oozie工作流操作指南

最新推荐文章于 2022-04-14 17:49:43 发布

转载最新推荐文章于 2022-04-14 17:49:43 发布 · 1.7w 阅读

oozie 专栏收录该内容

1 篇文章

订阅专栏

本文档详细介绍了Apache Oozie工作流引擎的各种操作命令，包括提交、执行、挂起、杀死作业等，并提供了使用这些命令的具体示例。此外还涵盖了如何验证XML文件、提交Pig和MapReduce作业等内容。

1.提交作业，作业进入PREP状态
oozie job -oozie http://localhost:11000/oozie -config job.properties -submit
job: 14-20090525161321-oozie-joe

2.执行已提交的作业

oozie job -oozie

http://localhost:11000/oozie -start 14-20090525161321-oozie-joe

3.直接运行作业
oozie job -oozie http://localhost:11000/oozie -config job.properties -run

4.挂起作业，挂起前状态（RUNNING , RUNNIINGWITHERROR or PREP状态）
workflow job will be in SUSPENDED status.

5.杀死作业
oozie job -oozie http://localhost:11000/oozie -kill 14-20090525161321-oozie-joe

6.改变作业参数，不能修改killed状态的作业
oozie job -oozie http://localhost:11000/oozie -change 14-20090525161321-oozie-joe -value endtime=2011-12-01T05:00Z;concurrency=100;2011-10-01T05:00Z

7.重新运行作业
oozie job -oozie http://localhost:11000/oozie -config job.properties -rerun 14-20090525161321-oozie-joe
000000-130817230824019-oozie-ceny-W
Rerunning a Coordinator Action or Multiple Actions
$oozie job -rerun <coord_Job_id> [-nocleanup] [-refresh]
[-action 1, 3-4, 7-40] (-action or -date is required to rerun.)
[-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z]
Rerunning a Bundle Job
oozie job -rerun <bundle_Job_id> [-nocleanup] [-refresh]
[-coordinator c1, c3, c4] (-coordinator or -date is required to rerun.)
[-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z]
(if neither -coordinator nor -date is given, the exception will be thrown.)

8.检查作业状态
oozie job -oozie http://localhost:11000/oozie -info 14-20090525161321-oozie-joe

oozie job -oozie http://localhost:11000/oozie -info 0000001-111219170928042-oozie-para-W@mr-node -verbose

9.查看日志
oozie job -oozie http://localhost:11000/oozie -log 14-20090525161321-oozie-joe
oozie job -log <coord_job_id> [-action 1, 3-4, 7-40] (-action is optional.)

10.检查xml文件是否合规
oozie validate myApp/workflow.xml

11.提交pig作业
oozie pig -oozie http://localhost:11000/oozie -file pigScriptFile -config job.properties -X -param_file params

12.提交MR作业
oozie mapreduce -oozie http://localhost:11000/oozie -config job.properties

usage:
      the env variable 'OOZIE_URL' is used as default value for the '-oozie' option
      the env variable 'OOZIE_TIMEZONE' is used as default value for the '-timezone' option
      custom headers for Oozie web services can be specified using '-Dheader:NAME=VALUE'      oozie help : display usage
.
      oozie version : show client version
.
      oozie job <OPTIONS> : job operations
                -action <arg>         coordinator rerun on action ids (requires -rerun); coordinator log retrieval on action ids (requires -log)
                -auth <arg>           select authentication type [SIMPLE|KERBEROS]
                -change <arg>         change a coordinator/bundle job
                -config <arg>         job configuration file '.xml' or '.properties'
                -D <property=value>   set/override value for given property
                -date <arg>           coordinator/bundle rerun on action dates (requires -rerun)
                -definition <arg>     job definition
                -doas <arg>           doAs user, impersonates as the specified user
                -dryrun               Dryrun a workflow (since 3.3.2) or coordinator (since 2.0) job without actually executing it
                -info <arg>           info of a job
                -kill <arg>           kill a job
                -len <arg>            number of actions (default TOTAL ACTIONS, requires -info)
                -localtime            use local time (same as passing your time zone to -timezone).
                                      Overrides -timezone option
                -log <arg>            job log
                -nocleanup            do not clean up output-events of the coordinator rerun actions
                                      (requires -rerun)
                -offset <arg>         job info offset of actions (default '1', requires -info)
                -oozie <arg>          Oozie URL
                -refresh              re-materialize the coordinator rerun actions (requires -rerun)
                -rerun <arg>          rerun a job (coordinator requires -action or -date; bundle requires -coordinator or -date)
                -resume <arg>         resume a job
                -run                  run a job
                -start <arg>          start a job
                -submit               submit a job
                -suspend <arg>        suspend a job
                -timezone <arg>       use time zone with the specified ID (default GMT).
                                      See 'oozie info -timezones' for a list
                -value <arg>          new endtime/concurrency/pausetime value for changing a
                                      coordinator job; new pausetime value for changing a bundle job
                -verbose              verbose mode
.
      oozie jobs <OPTIONS> : jobs status
                 -auth <arg>          select authentication type [SIMPLE|KERBEROS]
                 -doas <arg>          doAs user, impersonates as the specified user.
                 -filter <arg>        user=<U>;name=<N>;group=<G>;status=<S>;...
                 -jobtype <arg>       job type ('Supported in Oozie-2.0 or later versions ONLY - coordinator' or 'wf' (default))
                 -len <arg>           number of jobs (default '100')
                 -localtime           use local time (same as passing your time zone to -timezone). Overrides -timezone option
                 -offset <arg>        jobs offset (default '1')
                 -oozie <arg>         Oozie URL
                 -timezone <arg>      use time zone with the specified ID (default GMT). See 'oozie info -timezones' for a list
                 -verbose             verbose mode
.
      oozie admin <OPTIONS> : admin operations
                  -auth <arg>         select authentication type [SIMPLE|KERBEROS]
                  -doas <arg>         doAs user, impersonates as the specified user.
                  -oozie <arg>        Oozie URL
                  -queuedump          show Oozie server queue elements
                  -status             show the current system status
                  -systemmode <arg>   Supported in Oozie-2.0 or later versions ONLY. Change oozie
                                      system mode [NORMAL|NOWEBSERVICE|SAFEMODE]
                  -version            show Oozie server build version
.
      oozie validate <ARGS> : validate a workflow XML file
.
      oozie sla <OPTIONS> : sla operations (Supported in Oozie-2.0 or later)
                -auth <arg>           select authentication type [SIMPLE|KERBEROS]
                -len <arg>            number of results (default '100', max limited by oozie server setting which defaults to '1000')
                -offset <arg>         start offset (default '0')
                -oozie <arg>          Oozie URL
                -filter <arg>         jobid=<JobID/ActionID>\;appname=<Application Name>
.
      oozie pig <OPTIONS> -X <ARGS> : submit a pig job, everything after '-X' are pass-through parameters to pig
                -auth <arg>           select authentication type [SIMPLE|KERBEROS]
                -doas <arg>           doAs user, impersonates as the specified user.
                -config <arg>         job configuration file '.properties'
                -D <property=value>   set/override value for given property
                -file <arg>           Pig script
                -oozie <arg>          Oozie URL
.
      oozie info <OPTIONS> : get more detailed info about specific topics
                -timezones   display a list of available time zones