[Hadoop][2017-06-27] lzo.lzocodec not found

在编译 Demo 时报错  hadoop jar WordCount.jar WordCount /input /output 

注意:/input /output    /表示绝对路径, 不加为相对路径 


此问题, 解决之道

hadoop-lzo-0.4.20-SNAPSHOT.jar   此文件, 需要放入hadoop所有节点上, NameNode & DataNode


菜鸟基本的错误,google根本不到。。。


原始报错信息如下:


17/06/27 15:18:01 INFO mapreduce.Job: Task Id : attempt_1498546574227_0003_m_000001_1001, Status : FAILED Error: java.lang.RuntimeException: Error in configuring object 

at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:112) 

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:78) 

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136) 

at org.apache.hadoop.mapred.JobConf.getInputFormat(JobConf.java:689) 

at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.(MapTask.java:169) 

at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432) 

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) 

at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) 

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) 

at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: java.lang.reflect.InvocationTargetException 

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 

at java.lang.reflect.Method.invoke(Method.java:498) 

at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109) 

... 11 more 

Caused by: java.lang.IllegalArgumentException: Compression codec com.hadoop.compression.lzo.LzoCodec not found. 

at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:139) 

at org.apache.hadoop.io.compress.CompressionCodecFactory.(CompressionCodecFactory.java:179) 

at org.apache.hadoop.mapred.TextInputFormat.configure(TextInputFormat.java:45)

 ... 16 more 

Caused by: java.lang.ClassNotFoundException: Class com.hadoop.compression.lzo.LzoCodec not found 

at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2101) 

at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:132) 

... 18 more 

Container killed by the ApplicationMaster. 

Container killed on request. Exit code is 143 

Container exited with a non-zero exit code 143

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值