HUE整合hdfs,hive,oozie

最新推荐文章于 2022-04-07 18:05:26 发布

吗达拉

最新推荐文章于 2022-04-07 18:05:26 发布

阅读量697

点赞数

本文链接：https://blog.csdn.net/weixin_42656794/article/details/84316252

版权

hue整合hdfs以及yarn
1更改所有hadoop节点的core-site.xml配置

 <property>
	<name>hadoop.proxyuser.root.hosts</name>
	<value>*</value>
</property>
<property>
	<name>hadoop.proxyuser.root.groups</name>
	<value>*</value>
</property>

2更改所有hadoop节点的hdfs-site.xml

<property>
	  <name>dfs.webhdfs.enabled</name>
	  <value>true</value>
</property>

3重启集群
4配置hue与hdfs集成修改hue.ini

[[hdfs_clusters]]
    [[[default]]]
fs_defaults=
webhdfs_url=
hadoop_hdfs_home=
hadoop_bin=
hadoop_conf_dir=
5配置和yarn的集成
[[yarn_clusters]]
    [[[default]]]
      resourcemanager_host=node
      resourcemanager_port=8032
      submit_to=True
      resourcemanager_api_url=http://node:8088
      history_server_api_url=http://node:19888

Hue与hive的集成
修改hue.ini

[beeswax]
  hive_server_host=hive所在的主机
  hive_server_port=10000
  hive_conf_dir=hive配置文件的路径
  server_conn_timeout=120
  auth_username=root
  auth_password=123456
[metastore]
  #允许使用hive创建数据库表等操作
  enable_new_create_table=true

注意：
hue集成hive必须要启动hiveserver2的服务
在hive/bin下启动hiveserver2

hue整合oozie
修改hue的配置文件hue.ini

[liboozie]
  # The URL where the Oozie service runs on. This is required in order for
  # users to submit jobs. Empty value disables the config check.
  oozie_url=http://node03.hadoop.com:11000/oozie

  # Requires FQDN in oozie_url if enabled
  ## security_enabled=false

  # Location on HDFS where the workflows/coordinator are deployed when submitted.
  remote_deployement_dir=/user/root/oozie_works

[oozie]
  # Location on local FS where the examples are stored.
  # local_data_dir=/export/servers/oozie-4.1.0-cdh5.14.0/examples/apps

  # Location on local FS where the data for the examples is stored.
  # sample_data_dir=/export/servers/oozie-4.1.0-cdh5.14.0/examples/input-data

  # Location on HDFS where the oozie examples and workflows are stored.
  # Parameters are $TIME and $USER, e.g. /user/$USER/hue/workspaces/workflow-$TIME
  # remote_data_dir=/user/root/oozie_works/examples/apps

  # Maximum of Oozie workflows or coodinators to retrieve in one API call.
  oozie_jobs_count=100

  # Use Cron format for defining the frequency of a Coordinator instead of the old frequency number/unit.
  enable_cron_scheduling=true

  # Flag to enable the saved Editor queries to be dragged and dropped into a workflow.
  enable_document_action=true

  # Flag to enable Oozie backend filtering instead of doing it at the page level in Javascript. Requires Oozie 4.3+.
  enable_oozie_backend_filtering=true

  # Flag to enable the Impala action.
  enable_impala_action=true

[filebrowser]
  # Location on local filesystem where the uploaded archives are temporary stored.
  archive_upload_tempdir=/tmp

  # Show Download Button for HDFS file browser.
  show_download_button=true

  # Show Upload Button for HDFS file browser.
  show_upload_button=true

  # Flag to enable the extraction of a uploaded archive in HDFS.
  enable_extract_uploaded_archive=true

启动 hue
启动oozie