Hue集成Oozie
修改hue配置文件hue.ini
[liboozie]
# The URL where the Oozie service runs on.
#This is required in order for
# users to submit jobs. Empty value disables the config check.
oozie_url=http://node-1:11000/oozie
# Requires FQDN in oozie_url if enabled
## security_enabled=false
# Location on HDFS where the
#workflows/coordinator are deployed when submitted.
remote_deployement_dir=/user/root/oozie_works
[oozie]
# Location on local FS where the examples are stored.
# local_data_dir=/export/servers/oozie-4.1.0-cdh5.14.0/examples/apps
# Location on local FS where the data for the examples is stored.
# sample_data_dir=/export/servers/oozie-4.1.0-cdh5.14.0/examples/input-data
# Location on HDFS where the oozie examples and workflows are stored.
# Parameters are $TIME and $USER, e.g. /user/$USER/hue/workspaces/workflow-$TIME
# remote_data_dir=/user/root/oozie_works/examples/apps
# Maximum of Oozie workflows or coodinators to retrieve in one API call.
oozie_jobs_count=100
# Use Cron format for defining the frequency of a Coordinator instead of the old frequency number/unit.
enable_cron_scheduling=true
# Flag to enable the saved Editor queries to be dragged and dropped into a workflow.
enable_document_action=true
# Flag to enable Oozie backend filtering instead of doing it at the page level in Javascript. Requires Oozie 4.3+.
enable_oozie_backend_filtering=true
# Flag to enable the Impala action.
enable_impala_action=true
[filebrowser]
# Location on local filesystem where the uploaded archives are temporary stored.
archive_upload_tempdir=/tmp
# Show Download Button for HDFS file browser.
show_download_button=true
# Show Upload Button for HDFS file browser.
show_upload_button=true
# Flag to enable the extraction of a uploaded archive in HDFS.
enable_extract_uploaded_archive=true
启动hue、oozie
启动hue进程
- cd /export/servers/hue-3.9.0-cdh5.14.0
- build/env/bin/supervisor
启动oozie进程
- cd /export/servers/oozie-4.1.0-cdh5.14.0
- bin/oozied.sh start
页面访问hue
- http://node-1:8888/
使用hue配置oozie调度
hue提供了页面鼠标拖拽的方式配置oozie调度
利用hue调度shell脚本
打开工作流调度页面 :
利用hue调度hive脚本
在HDFS上创建一个hive sql脚本程序文件。
打开workflow页面,拖拽hive2图标到指定位置
利用hue调度MapReduce程序
利用Hue配置定时调度任务
在hue中,也可以针对workflow配置定时调度任务,具体操作如下:
一定要注意时区的问题,否则调度就出错了。保存之后就可以提交定时任务。
点击进去,可以看到定时任务的详细信息。