1. when run oozie examples, there is a error
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/CommandNotFound/util.py", line 24, in crash_guard
callback()
File "/usr/lib/command-not-found", line 69, in main
enable_i18n()
File "/usr/lib/command-not-found", line 40, in enable_i18n
locale.setlocale(locale.LC_ALL, '')
File "/usr/lib/python3.3/locale.py", line 541, in setlocale
return _setlocale(category, locale)
locale.Error: unsupported locale setting
A:
---------
ubuntu:
#locale
#locale -a
#vi /etc/default/locale
LANG="en_AU.UTF-8"
LANGUAGE="en_AU:en"
LC_CTYPE="en_AU.UTF-8"
LC_NUMERIC="en_AU.UTF-8"
LC_TIME="en_AU.UTF-8"
LC_COLLATE=en_AU.UTF-8
LC_MONETARY="en_AU.UTF-8"
LC_MESSAGES=en_AU.UTF-8
LC_PAPER="en_AU.UTF-8"
LC_NAME="en_AU.UTF-8"
LC_ADDRESS="en_AU.UTF-8"
LC_TELEPHONE="en_AU.UTF-8"
LC_MEASUREMENT="en_AU.UTF-8"
LC_IDENTIFICATION="en_AU.UTF-8"
#source /etc/default/locale
2 Jobtracker [192.168.122.1:2015] not allowed, not in Oozies whitelist
add the configure entity to oozie-site.xml
<property>
<name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name>
<value>192.168.122.1:2015</value>
<description>
Whitelisted job tracker for Oozie service.
</description>
</property>
3.org.apache.oozie.action.ActionExecutorException: JA008: File /home/zhaohj/hadoop/oozie-4.0.1/oozie-server/temp/oozie-zhj3452223772011438615.dir/java-launcher.jar does not exist
4.PID file found but no matching process was found
A:delete contents of oozie-server/temp and oozie-server/work, then get the pid of oozied by ps -ef |grep oozie, kill -s -9 pidofoozied. Restart oozlie
5.when run pig example, error appears
ERROR 2998: Unhandled internal error. org/joda/time/ReadableInstant
java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.PigMain not found
sharelib is not created correctly.
6.
Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
The root cause is that the sharelib is not correct. see oozie document
IMPORTANT: It is strongly recommend to use a Bigtop distribution if using Hadoop 2.x because the Oozie sharelibs built from the tarball distribution will not work with it.
In oozie4.0.1, pig action just support Hadoop 1.x,so produce No.6 error
- in Hadoop 1.x: JobContext is a class
- in Hadoop 2.x: JobContext is an interface
A: This issue takes me about one week to deal with. It's panic experience through googing and baiduing without any useful information except that the problem is concerned with sharelib.
The follwoing steps are adopted by me to fix this :
a. backups all jars in share/lib/pig
b. delete share/lib/pig in hdfs
c. compile pig-0.12.0 to support hadoop2.3.0
d. copy all jars except hadoop*.jar in pig-0.12.0/build/ivy/lib/Pig to oozie-4.0.1/share/lib/pig
f. copy pig-0.12.0.jar pig-0.12.1-withouthadoop.jar to share/lib/pig
d. copy oozie-sharelib-pig-4.0.1.jar from backuped jars in share/lib/pig
f. update share to hdfs by
oozie-setup.sh sharelib upgrade -fs hdfs://192.168.122.1:2014 -locallib share/
7.when I delete sharelib and upgrade it, error appears
Exception occured: [Server IPC version 9 cannot communicate with client version 4]
A:due to mistake, I compile oozie-4.0.1 target with MR1 not YARN. Recompile it against YARN, fix the problem.