1 简介
HUE=Hadoop User Experience(Hadoop用户体验),直白来说就一个开源的Apache Hadoop UI系统,由Cloudera
Desktop演化而来,最后Cloudera公司将其贡献给Apache基金会的Hadoop社区,它是基于Python Web框架Django实现
的。通过使用HUE我们可以在浏览器端的Web控制台上与Hadoop集群进行交互来分析处理数据。
2 安装
2.1 帮助文档
http://archive.cloudera.com/cdh5/cdh/5/hue‐3.9.0‐cdh5.5.6/manual.html
2.2 安装
介绍
HUE 在编译时有两种方式:
1.通过maven、ant编译
2.通过python编译(在centos6.5因为自身python为2.6.6版本和hue编译需要2.7版本会有一点小冲突,故采用1)两种方式都是在hue目录下 make apps,只是第一种方式要先配置maven、ant的环境而已
注意:不要使用root 用户安装
安装maven和ant
-
创建一个非root账户并使用到新账号登录(在集群中任意一台机器安装
useradd goodera
2 上传安装ant和maven -
ant
[root@cdh001 soft]# tar -zxvf apache-ant-1.8.1-bin.tar.gz -C /opt/app/ -
maven
[root@cdh001 soft]# tar -zxvf apache-maven-3.3.9-bin.tar.gz -C /opt/app/
3 重命名ant和maven
[root@cdh001 app]# mv apache-ant-1.8.1/ ant
[root@cdh001 app]# mv apache-maven-3.3.9/ maven
4 配置环境变量
vim /etc/profile
#maven environment
export MAVEN_HOME=/opt/app/maven
export PATH=
M
A
V
E
N
H
O
M
E
/
b
i
n
:
MAVEN_HOME/bin:
MAVENHOME/bin:PATH
#ant environment
export ANT_HOME=/opt/app/ant
export PATH=
A
N
T
H
O
M
E
/
b
i
n
:
ANT_HOME/bin:
ANTHOME/bin:PATH
source /etc/profile
5 检验是否安装成功
[root@cdh001 app]# ant -v
Apache Ant version 1.8.1 compiled on April 30 2010
Trying the default build file: build.xml
Buildfile: build.xml does not exist!
Build failed
[root@cdh001 app]# mvn -v
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-11T00:41:47+08:00)
Maven home: /opt/app/maven
Java version: 1.8.0_144, vendor: Oracle Corporation
Java home: /opt/app/jdk/jre
Default locale: en_US, platform encoding: UTF-8
OS name: “linux”, version: “2.6.32-642.el6.x86_64”, arch: “amd64”, family: “unix”
3 安装hue
3.1 安装依赖
yum -y install asciidoc cyrus-sasl-devel cyrus-sasl-gssapi cyrus-sasl-plain gcc gcc-c++ krb5-devel libffi-devel libtidy libxml2-devel libxslt-devel make mysql mysql-devel openldap-devel python-devel sqlite-devel openssl-devel gmp-devel
3.2 安装hue
[root@cdh001 soft]# tar -zxvf hue-3.9.0-cdh5.7.6.tar.gz -C /opt/app
切换到hue的根目录
[root@cdh001 hue-3.9.0-cdh5.7.6]# make apps
编译时间有点长,稍等一会儿…
3.3 修改hue/desktop/conf/hue.ini
[desktop]
# Set this to a random string, the longer the better.
# This is used for secure hashing in the session store.
secret_key=jFE93j;2[290-eiw.KEiwN2s3['d;/.q[eIW^y#e=+Iei*@Mn<qW5o
# Execute this script to produce the Django secret key. This will be used when
# `secret_key` is not set.
## secret_key_script=
# Webserver listens on this address and port
http_host=cdh001
http_port=8888
# Time zone name
time_zone=Asia/Shanghai
3.4 启动
[root@cdh001 hue-3.9.0-cdh5.7.6]# build/env/bin/supervisor
报错:
Traceback (most recent call last):
File "build/env/bin/supervisor", line 9, in <module>
load_entry_point('desktop==3.9.0', 'console_scripts', 'supervisor')()
File "/opt/app/hue-3.9.0-cdh5.7.6/desktop/core/src/desktop/supervisor.py", line 319, in main
setup_user_info()
File "/opt/app/hue-3.9.0-cdh5.7.6/desktop/core/src/desktop/supervisor.py", line 257, in setup_user_info
desktop.lib.daemon_utils.get_uid_gid(SETUID_USER, SETGID_GROUP)
File "/opt/app/hue-3.9.0-cdh5.7.6/desktop/core/src/desktop/lib/daemon_utils.py", line 45, in get_uid_gid
raise KeyError("Couldn't get user id for user %s" % (username,))
KeyError: "Couldn't get user id for user hue"
原因:
不能使用root用户启动,切换到普通用户启动即可。
3.5 给hue目录授予普通用户goodera权限
[root@cdh001 hue-3.9.0-cdh5.7.6]# chown -R goodera /opt/app/hue-3.9.0-cdh5.7.6/
3.6 切换成goodera用户再启动
[root@cdh001 hue-3.9.0-cdh5.7.6]# su goodera
[goodera@cdh001 hue-3.9.0-cdh5.7.6]$ build/env/bin/supervisor
3.7 查看网页
用户名需要自定义