Hue: common errors solution 1

1. when click a job in 'Job Browser' panle,  the log of the job doesn't appare



 R: Hadoop2.x has the ablity to aggregate logs from cluster nodes and purge the old logs. My problem is rooted at wrong vm guest clock(namenode runs on my local host while the other three datanodes run on

 centos6.4 vms ). I save all VMs when log out, and exit the local host system. Next time,  the VM  guests have wrong time when resumed to live.

 A: option 1:  synchronize the time in guests

date && hwclock --hctosys && date

     option 2: change hadoop configurations  (mapred-site.xml)

                    mapreduce.jobhistory.max-age-ms

                    mapreduce.jobhistory.cleaner.interval-ms

 

2.When check a file in hdfs through 'File Browser',there is a error



 

when I first login Hue UI, I used 'hue' as the username althrough I added 'zhaohj' as a superuser and logined with this name. Hue still use 'hue' to as its identity. Meanwhile, the core-site.xml of hadoop is :



The root cause is wrong configurations.

A: the correct configuration fragements likes . The 'zhaohj' is the name who login hue server.

--core-site.xml

<property>
  <name>hadoop.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>hadoop.proxyuser.hue.groups</name>
  <value>zhaohj</value>
</property>
--hdfs-site.xml

<property>
  <name>dfs.webhdfs.enabled</name>
  <value>true</value>
</property>

<property>
   <name>dfs.permissions.enabled</name>
   <value>true</value>
</property>

<property>
   <name>dfs.web.ugi</name>
   <value>zhaohj</value>
</property>
--httpfs-site.xml

<property>
  <name>httpfs.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>httpfs.proxyuser.hue.groups</name>
  <value>zhaohj</value>
</property>

 

3. The oozie is running, when I click WorkFlows, there appares a error

An error occurred with Oozie.

User [hue] not defined as proxyuser

A:Hue submits MapReduce jobs to Oozie as the logged in user. You need to configure Oozie to accept the hue user to be a proxyuser. Specify this in your oozie-site.xml (even in a non-secure cluster), and restart Oozie:

<property>
    <name>oozie.service.ProxyUserService.proxyuser.hue.hosts</name>
    <value>*</value>
</property>
<property>
    <name>oozie.service.ProxyUserService.proxyuser.hue.groups</name>
    <value>*</value>
</property>

http://archive.cloudera.com/cdh4/cdh/4/hue-2.0.0-cdh4.0.1/manual.html

 

4. When I submit a sqoop job from "Job Designer", produce errors:



 

I check the sqoop comands and comfired that all are correct. At last, I found that there have to one just only one space between two parametes.

eg.

--table       user     //will lead to syntax error 
--table user          //yes

 

 5.when submit a sqoop job (using mysql to store hive metastore and hue/oozie data )

 

 A: to restart mysql is adopted.

 

 

 

 

 

 

 

 

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值