参考：http://jyd.me/nosql/oozie-classnotfoundexception-solution/
http://shiyanjun.cn/archives/684.html
如果出现以下错误：
1 | java.lang.ClassNotFoundException: org.apache.hadoop.tools.DistCp |
2 | java.lang.NoClassDefFoundError: org/apache/pig/Main |
3 | java.lang.ClassNotFoundException: org.apache.pig.Main |
4 | java.lang.NoClassDefFoundError: org/apache/sqoop/Sqoop |
5 | java.lang.ClassNotFoundException: org.apache.sqoop.Sqoop |
6 | java.lang.NoClassDefFoundError: org/apache/hadoop/hive/cli/CliDriver |
7 | java.lang.ClassNotFoundException: org.apache.hadoop.hive.cli.CliDriver |
8 | java.lang.ClassNotFoundException: Class org.apache.hadoop.streaming.PipeMapRunner not found |
怎么解决呢？当然是加入对应的包啦~~
运行Oozie的job，Oozie要怎么找到所需要的类呢？
有两种方式来添加jar包。
先看下Oozie workflow的目录。
1 | $ sudo -u oozie hadoop fs -ls examples/apps/demo/ |
3 | -rw-r--r-- 1 oozie supergroup 930 2012-12-14 13:23 examples/apps/demo/id.pig |
4 | -rw-r--r-- 1 oozie supergroup 1020 2012-12-14 13:23 examples/apps/demo/job.properties |
5 | drwxr-xr-x - oozie supergroup 0 2012-12-14 13:23 examples/apps/demo/lib |
6 | -rw-r--r-- 1 oozie supergroup 6136 2012-12-14 13:23 examples/apps/demo/workflow.xml |
其中workflow.xml和job.properties是必须要有的，id.pig则是跟job有关的pig脚本，这里可以无视。
关键是lib文件夹，这个文件夹可有可无，如果有，oozie则会自动把lib下面的jar包加到workflow的classpath里面去。
这样通过oozie运行的任务就能找到jar包啦~
以上这种方式是最简单的方式。
另外，我们也可以在job.properties文件里面使用oozie.libpath来指定其它的HDFS目录（可以指定多个目录，通过逗号分隔）。
通过oozie.libpath来指定jar包目录的好处就是，多个workflow可以共用jar包。
现在说第二种方式，通过ShareLib。
像 DistCp, Streaming, Pig, Sqoop, and Hive之类Action，需要额外的Jar包才能运行。
使用ShareLib的方式很像oozie.libpath，不一样的是，它是为上面说的那些特殊的action和他们对应的JARs而准备的。
CDH 4.1.2的ShareLib目录如下：
3 | drwxr-xr-x share/lib/distcp |
4 | -rw-r--r-- share/lib/distcp/hadoop-tools-2.0.0-mr1-cdh4.1.2.jar |
5 | drwxr-xr-x share/lib/hive |
6 | -rw-r--r-- share/lib/hive/JavaEWAH-0.3.2.jar |
7 | -rw-r--r-- share/lib/hive/antlr-2.7.7.jar |
8 | -rw-r--r-- share/lib/hive/antlr-3.0.1.jar |
9 | -rw-r--r-- share/lib/hive/antlr-runtime-3.0.1.jar |
10 | -rw-r--r-- share/lib/hive/avro-ipc-1.7.1.cloudera.2.jar |
11 | -rw-r--r-- share/lib/hive/avro-mapred-1.7.1.cloudera.2.jar |
12 | -rw-r--r-- share/lib/hive/commons-beanutils-1.7.0.jar |
13 | -rw-r--r-- share/lib/hive/commons-beanutils-core-1.8.0.jar |
14 | -rw-r--r-- share/lib/hive/commons-collections-3.2.1.jar |
15 | -rw-r--r-- share/lib/hive/commons-compress-1.4.1.jar |
16 | -rw-r--r-- share/lib/hive/commons-configuration-1.6.jar |
17 | -rw-r--r-- share/lib/hive/commons-dbcp-1.4.jar |
18 | -rw-r--r-- share/lib/hive/commons-digester-1.8.jar |
19 | -rw-r--r-- share/lib/hive/commons-pool-1.5.4.jar |
20 | -rw-r--r-- share/lib/hive/datanucleus-connectionpool-2.0.3.jar |
21 | -rw-r--r-- share/lib/hive/datanucleus-core-2.0.3.jar |
22 | -rw-r--r-- share/lib/hive/datanucleus-enhancer-2.0.3.jar |
23 | -rw-r--r-- share/lib/hive/datanucleus-rdbms-2.0.3.jar |
24 | -rw-r--r-- share/lib/hive/derby-10.6.1.0.jar |
25 | -rw-r--r-- share/lib/hive/guava-11.0.2.jar |
26 | -rw-r--r-- share/lib/hive/haivvreo-1.0.7-cdh-4.jar |
27 | -rw-r--r-- share/lib/hive/hive-builtins-0.9.0-cdh4.1.2.jar |
28 | -rw-r--r-- share/lib/hive/hive-cli-0.9.0-cdh4.1.2.jar |
29 | -rw-r--r-- share/lib/hive/hive-common-0.9.0-cdh4.1.2.jar |
30 | -rw-r--r-- share/lib/hive/hive-contrib-0.9.0-cdh4.1.2.jar |
31 | -rw-r--r-- share/lib/hive/hive-exec-0.9.0-cdh4.1.2.jar |
32 | -rw-r--r-- share/lib/hive/hive-metastore-0.9.0-cdh4.1.2.jar |
33 | -rw-r--r-- share/lib/hive/hive-serde-0.9.0-cdh4.1.2.jar |
34 | -rw-r--r-- share/lib/hive/hive-service-0.9.0-cdh4.1.2.jar |
35 | -rw-r--r-- share/lib/hive/hive-shims-0.9.0-cdh4.1.2.jar |
36 | -rw-r--r-- share/lib/hive/httpclient-4.0.1.jar |
37 | -rw-r--r-- share/lib/hive/httpcore-4.0.1.jar |
38 | -rw-r--r-- share/lib/hive/jackson-core-asl-1.8.8.jar |
39 | -rw-r--r-- share/lib/hive/jackson-mapper-asl-1.8.8.jar |
40 | -rw-r--r-- share/lib/hive/jdo2-api-2.3-ec.jar |
41 | -rw-r--r-- share/lib/hive/jetty-util-6.1.26.cloudera.2.jar |
42 | -rw-r--r-- share/lib/hive/jline-0.9.94.jar |
43 | -rw-r--r-- share/lib/hive/json-20090211.jar |
44 | -rw-r--r-- share/lib/hive/jsr305-1.3.9.jar |
45 | -rw-r--r-- share/lib/hive/jta-1.1.jar |
46 | -rw-r--r-- share/lib/hive/libfb303-0.7.0.jar |
47 | -rw-r--r-- share/lib/hive/libthrift-0.7.0.jar |
48 | -rw-r--r-- share/lib/hive/netty-3.4.0.Final.jar |
49 | -rw-r--r-- share/lib/hive/servlet-api-2.5-20081211.jar |
50 | -rw-r--r-- share/lib/hive/stringtemplate-3.1-b1.jar |
51 | -rw-r--r-- share/lib/hive/xz-1.0.jar |
52 | drwxr-xr-x share/lib/mapreduce-streaming |
53 | -rw-r--r-- share/lib/mapreduce-streaming/commons-cli-1.2.jar |
54 | -rw-r--r-- share/lib/mapreduce-streaming/commons-codec-1.4.jar |
55 | -rw-r--r-- share/lib/mapreduce-streaming/commons-el-1.0.jar |
56 | -rw-r--r-- share/lib/mapreduce-streaming/commons-httpclient-3.1.jar |
57 | -rw-r--r-- share/lib/mapreduce-streaming/commons-logging-1.1.jar |
58 | -rw-r--r-- share/lib/mapreduce-streaming/commons-net-3.1.jar |
59 | -rw-r--r-- share/lib/mapreduce-streaming/core-3.1.1.jar |
60 | -rw-r--r-- share/lib/mapreduce-streaming/hadoop-core-2.0.0-mr1-cdh4.1.2.jar |
61 | -rw-r--r-- share/lib/mapreduce-streaming/hadoop-streaming-2.0.0-mr1-cdh4.1.2.jar |
62 | -rw-r--r-- share/lib/mapreduce-streaming/hsqldb-1.8.0.7.jar |
63 | -rw-r--r-- share/lib/mapreduce-streaming/jackson-core-asl-1.8.8.jar |
64 | -rw-r--r-- share/lib/mapreduce-streaming/jackson-mapper-asl-1.8.8.jar |
65 | -rw-r--r-- share/lib/mapreduce-streaming/jasper-compiler-5.5.23.jar |
66 | -rw-r--r-- share/lib/mapreduce-streaming/jasper-runtime-5.5.23.jar |
67 | -rw-r--r-- share/lib/mapreduce-streaming/jets3t-0.6.1.jar |
68 | -rw-r--r-- share/lib/mapreduce-streaming/jetty-6.1.14.jar |
69 | -rw-r--r-- share/lib/mapreduce-streaming/jetty-util-6.1.26.cloudera.2.jar |
70 | -rw-r--r-- share/lib/mapreduce-streaming/jsp-api-2.1.jar |
71 | -rw-r--r-- share/lib/mapreduce-streaming/log4j-1.2.16.jar |
72 | -rw-r--r-- share/lib/mapreduce-streaming/oro-2.0.8.jar |
73 | -rw-r--r-- share/lib/mapreduce-streaming/servlet-api-2.5-6.1.14.jar |
74 | -rw-r--r-- share/lib/mapreduce-streaming/servlet-api-2.5.jar |
75 | -rw-r--r-- share/lib/mapreduce-streaming/xmlenc-0.52.jar |
76 | drwxr-xr-x share/lib/oozie |
77 | -rw-r--r-- share/lib/oozie/json-simple-1.1.jar |
78 | drwxr-xr-x share/lib/pig |
79 | -rw-r--r-- share/lib/pig/activation-1.1.jar |
80 | -rw-r--r-- share/lib/pig/antlr-2.7.7.jar |
81 | -rw-r--r-- share/lib/pig/antlr-runtime-3.4.jar |
82 | -rw-r--r-- share/lib/pig/commons-beanutils-1.7.0.jar |
83 | -rw-r--r-- share/lib/pig/commons-beanutils-core-1.8.0.jar |
84 | -rw-r--r-- share/lib/pig/commons-collections-3.2.1.jar |
85 | -rw-r--r-- share/lib/pig/commons-configuration-1.6.jar |
86 | -rw-r--r-- share/lib/pig/commons-digester-1.8.jar |
87 | -rw-r--r-- share/lib/pig/commons-io-2.1.jar |
88 | -rw-r--r-- share/lib/pig/guava-11.0.2.jar |
89 | -rw-r--r-- share/lib/pig/hbase-0.92.1-cdh4.1.2.jar |
90 | -rw-r--r-- share/lib/pig/high-scale-lib-1.1.1.jar |
91 | -rw-r--r-- share/lib/pig/hsqldb-1.8.0.7.jar |
92 | -rw-r--r-- share/lib/pig/httpclient-4.0.1.jar |
93 | -rw-r--r-- share/lib/pig/httpcore-4.0.1.jar |
94 | -rw-r--r-- share/lib/pig/jaxb-api-2.2.2.jar |
95 | -rw-r--r-- share/lib/pig/jline-0.9.94.jar |
96 | -rw-r--r-- share/lib/pig/joda-time-1.6.jar |
97 | -rw-r--r-- share/lib/pig/jruby-complete-1.6.5.jar |
98 | -rw-r--r-- share/lib/pig/jsch-0.1.42.jar |
99 | -rw-r--r-- share/lib/pig/jsr305-1.3.9.jar |
100 | -rw-r--r-- share/lib/pig/jython-2.5.0.jar |
101 | -rw-r--r-- share/lib/pig/libthrift-0.7.0.jar |
102 | -rw-r--r-- share/lib/pig/metrics-core-2.1.2.jar |
103 | -rw-r--r-- share/lib/pig/pig-0.10.0-cdh4.1.2.jar |
104 | -rw-r--r-- share/lib/pig/protobuf-java-2.4.0a.jar |
105 | -rw-r--r-- share/lib/pig/stax-api-1.0.1.jar |
106 | -rw-r--r-- share/lib/pig/stringtemplate-3.2.1.jar |
107 | -rw-r--r-- share/lib/sharelib.properties |
108 | drwxr-xr-x share/lib/sqoop |
109 | -rw-r--r-- share/lib/sqoop/avro-ipc-1.7.1.cloudera.2.jar |
110 | -rw-r--r-- share/lib/sqoop/avro-mapred-1.7.1.cloudera.2.jar |
111 | -rw-r--r-- share/lib/sqoop/commons-beanutils-1.7.0.jar |
112 | -rw-r--r-- share/lib/sqoop/commons-beanutils-core-1.8.0.jar |
113 | -rw-r--r-- share/lib/sqoop/commons-configuration-1.6.jar |
114 | -rw-r--r-- share/lib/sqoop/commons-digester-1.8.jar |
115 | -rw-r--r-- share/lib/sqoop/commons-io-2.1.jar |
116 | -rw-r--r-- share/lib/sqoop/guava-11.0.2.jar |
117 | -rw-r--r-- share/lib/sqoop/hbase-0.92.1-cdh4.1.2.jar |
118 | -rw-r--r-- share/lib/sqoop/high-scale-lib-1.1.1.jar |
119 | -rw-r--r-- share/lib/sqoop/hsqldb-1.8.0.7.jar |
120 | -rw-r--r-- share/lib/sqoop/httpclient-4.0.1.jar |
121 | -rw-r--r-- share/lib/sqoop/httpcore-4.0.1.jar |
122 | -rw-r--r-- share/lib/sqoop/jsr305-1.3.9.jar |
123 | -rw-r--r-- share/lib/sqoop/libthrift-0.7.0.jar |
124 | -rw-r--r-- share/lib/sqoop/metrics-core-2.1.2.jar |
125 | -rw-r--r-- share/lib/sqoop/netty-3.4.0.Final.jar |
126 | -rw-r--r-- share/lib/sqoop/servlet-api-2.5-20081211.jar |
127 | -rw-r--r-- share/lib/sqoop/sqoop-1.4.1-cdh4.1.2.jar |
就如你所看到的，上面那些action各自依赖很多jar，每个action都有自己对应的文件夹，这样oozie就可以仅仅使用对应acion所需要的jar包，而不是把所有的jar包都包含进去。
其实，这么做是必须的。因为不是所有的action使用相同甚至是兼容的包。比如Hive action使用antlr-runtime-3.0.1.jar， 而用antlr-runtime-3.4.jar的时候将会运行失败，但是后者却是Pig action所需要的。
默认情况下，ShareLib必须放在HDFS上运行Oozie web server用户的目录下。不需要和提交oozie job的用户相同。对了，sharelib的压缩文件就在oozie的目录下~
在oozie-site.xml里面的oozie.service.WorkflowAppService.system.libpath可以指定ShareLib的位置，默认是/user/${user.name}/share/lib,其中${user.name}就是运行oozie服务的用户。详细的配置可以参考http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/4.2.0/CDH4-Installation-Guide/cdh4ig_topic_17_6.html
对了，因为cloudera的CDH4支持MRv1和YARN，所以必须用对应的sharelib包才行。
要让一个workflow使用ShareLib，只需要在job.properties里面加入oozie.use.system.libpath=true就行啦~。
Overriding the ShareLib
这个暂时没用到，就不翻译了。
In CDH 4.1.0 and later (or Oozie 3.3.0 and later), you can override the ShareLib location at the action, job, and server levels. This allows users or admins to support multiple versions or a patched version of an action at the same time. The property is calledoozie.action.sharelib.for.actiontype, where actiontype is the name of the action type (e.g. Pig, Sqoop); you would set its value to the name of a subfolder in the ShareLib. To set it at the action level you would put the property in that action’s<configuration>; to set it at the job level, you would put the property in that job’s job.properties; and to set it at the server level, you would put the property in oozie-site.xml.
For example, Oozie currently ships ready for Pig 0.10.x, but suppose you also want to be able to use Pig 0.9.x in the same workflow. The share/lib/pig folder is for Pig 0.10.x, but if you add a new folder with the Pig 0.9.x JARs, say share/lib/pig-9, you can put the following in the <configuration> element for the Pig 0.9.x action:
<property>
<name>oozie.action.sharelib.for.pig</name>
<value>pig-9<value>
</property>
Oozie will continue to use share/lib/pig for the Pig 0.10.x action but will use share/lib/pig-9 for the Pig 0.9.x action.
参考：http://blog.cloudera.com/blog/2012/12/how-to-use-the-sharelib-in-apache-oozie/
5187
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
