1. 程式人生 > >oozie 常用命令

oozie 常用命令

3.3 ued submit operation -s clean up sim killed require

1.驗證wokflow.xml
oozie validate /appcom/apps/hduser0401/mbl_webtrends/workflow.xml 

2.提交作業,作業進入PREP狀態
oozie job -oozie http://localhost:11000/oozie -config job.properties -submit
job: 14-20090525161321-oozie-joe


3.執行已提交的作業

oozie job -oozie

http://localhost:11000/oozie -start 14-20090525161321-oozie-joe

查看oozie服務狀態:

oozie admin -oozie http://localhost:11000/oozie -status

4.直接運行作業
oozie job -oozie http://localhost:11000/oozie -config job.properties -run

#-D job_start=2016-11-10T02:00+0800 -- 起始日期(當天)
#-D job_end=2016-11-11T02:00+0800 -- 結束日期(當天+1)

5.掛起作業,掛起前狀態(RUNNING , RUNNIINGWITHERROR or PREP狀態)
workflow job will be in SUSPENDED status.

6.殺死作業
oozie job -oozie http://localhost:11000/oozie -kill 14-20090525161321-oozie-joe

7.改變作業參數,不能修改killed狀態的作業
oozie job -oozie http://localhost:11000/oozie -change 14-20090525161321-oozie-joe -value endtime=2011-12-01T05:00Z;concurrency=100;2011-10-01T05:00Z

8.重新運行作業
oozie job -oozie http://localhost:11000/oozie -config job.properties -rerun 14-20090525161321-oozie-joe
000000-130817230824019-oozie-ceny-W
Rerunning a Coordinator Action or Multiple Actions
$oozie job -rerun <coord_Job_id> [-nocleanup] [-refresh]
[-action 1, 3-4, 7-40] (-action or -date is required to rerun.)
[-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z]
Rerunning a Bundle Job
oozie job -rerun <bundle_Job_id> [-nocleanup] [-refresh]
[-coordinator c1, c3, c4] (-coordinator or -date is required to rerun.)
[-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z]
(if neither -coordinator nor -date is given, the exception will be thrown.)

9.檢查作業狀態
oozie job -oozie http://localhost:11000/oozie -info 14-20090525161321-oozie-joe

oozie job -oozie http://localhost:11000/oozie -info [email protected] -verbose

10.查看日誌
oozie job -oozie http://localhost:11000/oozie -log 14-20090525161321-oozie-joe
oozie job -log <coord_job_id> [-action 1, 3-4, 7-40] (-action is optional.)

11.提交pig作業
oozie pig -oozie http://localhost:11000/oozie -file pigScriptFile -config job.properties -X -param_file params

12.提交MR作業
oozie mapreduce -oozie http://localhost:11000/oozie -config job.properties

usage:
the env variable ‘OOZIE_URL‘ is used as default value for the ‘-oozie‘ option
the env variable ‘OOZIE_TIMEZONE‘ is used as default value for the ‘-timezone‘ option
custom headers for Oozie web services can be specified using ‘-Dheader:NAME=VALUE‘ oozie help : display usage
.
oozie version : show client version
.
oozie job <OPTIONS> : job operations
-action <arg> coordinator rerun on action ids (requires -rerun); coordinator log retrieval on action ids (requires -log)
-auth <arg> select authentication type [SIMPLE|KERBEROS]
-change <arg> change a coordinator/bundle job
-config <arg> job configuration file ‘.xml‘ or ‘.properties‘
-D <property=value> set/override value for given property
-date <arg> coordinator/bundle rerun on action dates (requires -rerun)
-definition <arg> job definition
-doas <arg> doAs user, impersonates as the specified user
-dryrun Dryrun a workflow (since 3.3.2) or coordinator (since 2.0) job without actually executing it
-info <arg> info of a job
-kill <arg> kill a job
-len <arg> number of actions (default TOTAL ACTIONS, requires -info)
-localtime use local time (same as passing your time zone to -timezone).
Overrides -timezone option
-log <arg> job log
-nocleanup do not clean up output-events of the coordinator rerun actions
(requires -rerun)
-offset <arg> job info offset of actions (default ‘1‘, requires -info)
-oozie <arg> Oozie URL
-refresh re-materialize the coordinator rerun actions (requires -rerun)
-rerun <arg> rerun a job (coordinator requires -action or -date; bundle requires -coordinator or -date)
-resume <arg> resume a job
-run run a job
-start <arg> start a job
-submit submit a job
-suspend <arg> suspend a job
-timezone <arg> use time zone with the specified ID (default GMT).
See ‘oozie info -timezones‘ for a list
-value <arg> new endtime/concurrency/pausetime value for changing a
coordinator job; new pausetime value for changing a bundle job
-verbose verbose mode
.
oozie jobs <OPTIONS> : jobs status
-auth <arg> select authentication type [SIMPLE|KERBEROS]
-doas <arg> doAs user, impersonates as the specified user.
-filter <arg> user=<U>;name=<N>;group=<G>;status=<S>;...
-jobtype <arg> job type (‘Supported in Oozie-2.0 or later versions ONLY - coordinator‘ or ‘wf‘ (default))
-len <arg> number of jobs (default ‘100‘)
-localtime use local time (same as passing your time zone to -timezone). Overrides -timezone option
-offset <arg> jobs offset (default ‘1‘)
-oozie <arg> Oozie URL
-timezone <arg> use time zone with the specified ID (default GMT). See ‘oozie info -timezones‘ for a list
-verbose verbose mode
.
oozie admin <OPTIONS> : admin operations
-auth <arg> select authentication type [SIMPLE|KERBEROS]
-doas <arg> doAs user, impersonates as the specified user.
-oozie <arg> Oozie URL
-queuedump show Oozie server queue elements
-status show the current system status
-systemmode <arg> Supported in Oozie-2.0 or later versions ONLY. Change oozie
system mode [NORMAL|NOWEBSERVICE|SAFEMODE]
-version show Oozie server build version
.
oozie validate <ARGS> : validate a workflow XML file
.
oozie sla <OPTIONS> : sla operations (Supported in Oozie-2.0 or later)
-auth <arg> select authentication type [SIMPLE|KERBEROS]
-len <arg> number of results (default ‘100‘, max limited by oozie server setting which defaults to ‘1000‘)
-offset <arg> start offset (default ‘0‘)
-oozie <arg> Oozie URL
-filter <arg> jobid=<JobID/ActionID>\;appname=<Application Name>
.
oozie pig <OPTIONS> -X <ARGS> : submit a pig job, everything after ‘-X‘ are pass-through parameters to pig
-auth <arg> select authentication type [SIMPLE|KERBEROS]
-doas <arg> doAs user, impersonates as the specified user.
-config <arg> job configuration file ‘.properties‘
-D <property=value> set/override value for given property
-file <arg> Pig script
-oozie <arg> Oozie URL
.
oozie info <OPTIONS> : get more detailed info about specific topics
-timezones display a list of available time zones

oozie 常用命令