hadoop jar wc.jar com.map.red.job.WordCountJob

最新推荐文章于 2022-11-21 17:06:50 发布

秉寒-CHO

最新推荐文章于 2022-11-21 17:06:50 发布

阅读量1.2k

点赞数

本文链接：https://blog.csdn.net/haohaixingyun/article/details/51524478

版权

[root@bigdataspark ~]# hadoop jar wc.jar com.map.red.job.WordCountJob
16/05/22 19:20:24 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
16/05/22 19:20:24 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
16/05/22 19:20:24 INFO input.FileInputFormat: Total input paths to process : 1
16/05/22 19:20:25 INFO mapreduce.JobSubmitter: number of splits:1
16/05/22 19:20:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1464397668280_0004
16/05/22 19:20:26 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
16/05/22 19:20:26 INFO impl.YarnClientImpl: Submitted application application_1464397668280_0004
16/05/22 19:20:26 INFO mapreduce.Job: The url to track the job: http://bigdatastorm:8088/proxy/application_1464397668280_0004/
16/05/22 19:20:26 INFO mapreduce.Job: Running job: job_1464397668280_0004
16/05/22 19:20:49 INFO mapreduce.Job: Job job_1464397668280_0004 running in uber mode : false
16/05/22 19:20:49 INFO mapreduce.Job: map 0% reduce 0%
16/05/22 19:21:12 INFO mapreduce.Job: map 100% reduce 0%
16/05/22 19:21:12 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_0, Status : FAILED
Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
   at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
   at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
   at java.security.AccessController.doPrivileged(Native Method)
   at javax.security.auth.Subject.doAs(Subject.java:415)
   at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
   at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
   at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
   ... 8 more

16/05/22 19:21:13 INFO mapreduce.Job: map 0% reduce 0%
16/05/22 19:21:23 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_1, Status : FAILED
Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
   at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
   at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
   at java.security.AccessController.doPrivileged(Native Method)
   at javax.security.auth.Subject.doAs(Subject.java:415)
   at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
   at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
   at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
   ... 8 more

16/05/22 19:21:34 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_2, Status : FAILED
Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
   at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
   at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
   at java.security.AccessController.doPrivileged(Native Method)
   at javax.security.auth.Subject.doAs(Subject.java:415)
   at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
   at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
   at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
   ... 8 more

16/05/22 19:21:45 INFO mapreduce.Job: map 100% reduce 0%
16/05/22 19:21:46 INFO mapreduce.Job: map 100% reduce 100%
16/05/22 19:21:48 INFO mapreduce.Job: Job job_1464397668280_0004 failed with state FAILED due to: Task failed task_1464397668280_0004_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0