hadoop1.2.1运行wordcount报错

最新推荐文章于 2023-12-22 11:38:34 发布
最新推荐文章于 2023-12-22 11:38:34 发布
阅读量964 收藏 2
点赞数 1
分类专栏： hadoop 文章标签： hadoop ubuntu wordcount
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/u010147288/article/details/50118803
版权

安装步骤参见http://www.tuicool.com/articles/NBvMv2
根据上述网站中的步骤安装好hadoop1.2.1，安装过程中一定要细心，文件位置不要随意放。
我就是文件位置设置同上述网站不一样，导致后续执行wordcount不成功，放出日志如下：

Meta VERSION=”1” .
Job JOBID=”job_201511301937_0004” JOBNAME=”word count” USER=”root” SUBMIT_TIME=”1448884207054” JOBCONF=”hdfs://localhost:9000/user/root/home/paomo/tmp/mapred/staging/root/.staging/job_201511301937_0004/job.xml” VIEW_JOB=”” MODIFY_JOB=”” JOB_QUEUE=”default” WORKFLOW_ID=”” WORKFLOW_NAME=”” WORKFLOW_NODE_NAME=”” WORKFLOW_ADJACENCIES=”” WORKFLOW_TAGS=”” .
Job JOBID=”job_201511301937_0004” JOB_PRIORITY=”NORMAL” .
Job JOBID=”job_201511301937_0004” LAUNCH_TIME=”1448884207728” TOTAL_MAPS=”1” TOTAL_REDUCES=”1” JOB_STATUS=”PREP” .
Task TASKID=”task_201511301937_0004_m_000002” TASK_TYPE=”SETUP” START_TIME=”1448884207752” SPLITS=”” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_0” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_0” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000002_0:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_1” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_1” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000002_1:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_2” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_2” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000002_2:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_3” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_3” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000002_3:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
Task TASKID=”task_201511301937_0004_m_000002” TASK_TYPE=”SETUP” TASK_STATUS=”FAILED” FINISH_TIME=”0” ERROR=”Error initializing attempt_201511301937_0004_m_000002_3:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” TASK_ATTEMPT_ID=”” .
Task TASKID=”task_201511301937_0004_m_000001” TASK_TYPE=”CLEANUP” START_TIME=”1448884209118” SPLITS=”” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_0” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_0” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000001_0:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_1” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_1” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000001_1:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_2” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_2” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000001_2:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_3” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_3” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000001_3:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
Task TASKID=”task_201511301937_0004_m_000001” TASK_TYPE=”CLEANUP” TASK_STATUS=”FAILED” FINISH_TIME=”0” ERROR=”Error initializing attempt_201511301937_0004_m_000001_3:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2603)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException: File file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken does not exist.
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” TASK_ATTEMPT_ID=”” .
Job JOBID=”job_201511301937_0004” FINISH_TIME=”1448884210837” JOB_STATUS=”FAILED” FINISHED_MAPS=”0” FINISHED_REDUCES=”0” FAIL_REASON=”JobCleanup Task Failure, Task: task_201511301937_0004_m_000001” .

看到粗体字，仔细想就明白tmp文件没有找到。在网上查阅很多资料，
报错受以下博客的启发http://www.it165.net/pro/html/201501/31366.html
tmp路径的设置在hadoop-1.2.1/conf/core-site.xml文件中，
进到我的安装路径下查看，发现tmp在下列路径中：
tmp路径
而我在core-site.xml中设置为/home/paomo/tmp，后来改成了
core-site中tmp的设置
很明显位置不符合，难怪找不到tmp下生成的文件。因为在运行过程中Job会生成一些临时文件，执行过程中需要用到。一个方法是修改core-site.xml中hadoop.tmp.dir的值为tmp实际存放的位置，如下图：
tmp现在的设置
再重新运行就可以了。输入：bin/hadoop jar hadoop-examples-1.2.1.jar wordcount input output
运行结果如下：
运行结果
终于看到map 100% reduce 100%。
输入bin/hadoop dfs -cat output/part-r-00000，可以查看结果。

泡沫9水灵灵
关注
专栏目录
Hadoop3.2.0运行wordcount程序报错Please check whether your etc/hadoop/mapred-site.xml contains the below
QYHuiiQ
10-12 1421
将修改后的文件同步到集群中的其他节点上，不需要重启集群，重新运行原来自己要执行的程序即可正常执行。
Hadoop的配置及运行WordCount
Dantelian
10-21 690
 一、环境： 计算机Fedora 20、jdk1.7.0_60、Hadoop-2.2.0 二、步骤： 1 JDK及SSH安装配置： 1.1 卸载Fedora自带的OpenJDK，安装Oracle的JDK *由于Hadoop，无法使用OpenJDK，所以的下载安装Oracle的JDK。   1.1.1、以下为卸载再带的OpenJDK：
hadoop执行wordcount错误
weixin_42028941的博客
04-10 307
hadoop执行wordcount报错 Exception in thread “main” java. lang .NoClassDefFoundError: org/ apache/commons/ logging/LogFactory at org. apache . hadoop . conf . Configuration. (Configuration. java:177) at c...
hadoop wordcount出现的错误
疯狂的鸡窝
08-30 874
我配置了两台机器的集群，一台作为主机，一台作为从机，当主机启动wordcont任务时候出现这样的错误 java.io.IOException: Could not obtain block: blk_3096925682732876688_1028 file=/home/hadoop/tmp/mapred/system/job_201308300007_0001/jobToken     
hadoop 伪分布式执行wordcount失败
07-18 488
在执行wordcount时 明显内存和cpu飙升 1核1G的服务器瞬间沦陷 内存不够会导致失败 错误信息如下 Exit code: 1 Stack trace: ExitCodeException exitCode=1: at org.apache.had...
Hadoop，本地测试wordCount程序报错
YellowXiuHui的博客
02-22 649
// 原因是hadoop的环境变量没配置好，可能是杀毒软件误删导致的！ 解决方法： 1.win + r ，输入cmd，敲回车，doc窗口命令输入hadoop，查看版本信息。 2.如果找不到命令，得重新解压hadoop安装包，重新配环境变量！ ...
hadoop学习之wordcount运行错误处理
lxa8008的博客
03-12 1811
学习hadoop第一天，wordcount死活不能运行成功。 报错： security.UserGroupInformation: PriviledgedActionException as:root cause:org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.mapred.JobTrackerNotYetInitialized
Ubuntu下Hadoop1.2.1伪分布模式安装教程
进击的小白菜
10-20 353
1：软件环境准备 1.1 Hadoop：我们使用hadoop Release 1.2.1(stable)版本，下载链接：http://mirrors.ustc.edu.cn/apache/hadoop/common/hadoop-1.2.1/我们选择hadoop-1.2.1-bin.tar.gz文件下载。1.2 Java:Java在这里使用的是jdk1.7版本的，当然也可以使用1.6的，下载链接：
Idea+Maven运行简单的Hadoop WordCount程序
NoBugNoLife的博客
03-20 2973
开发环境 操作系统：Manjora Linux 开发软件：Idea Ultimate 2018.3 Jdk开发环境：1.8（请尽量不要使用超过9以上的，如果环境不是1.8请修改pom.xml里面的toos.jar的版本） Maven版本：maven3.3.9 文章目录开发注意事项 开发注意事项 尽量在Linux或MacOs操作系统上开发，Windows上有可能会出现权限问题 Jdk环境如果不...
hadoop一些常见报错的解决方案
随便记点东西
07-15 4840
hadoop环境配置过程中可能遇到问题的解决方案
hadoop集群测试 Wordcount报错
qq_42282789的博客
02-24 1341
在使用wordcount时，突然报错： Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster Please check whether your etc/hadoop/mapred-site.xml contains the below configuration: <property> <name>yarn.app.mapreduce.am.env<
Hadoop中运行Wordcount出现异常
千年孤寂
06-08 1109
 Hadoop中运行Wordcount出现org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory out already exists的错误提示 解决方案如下：      该错误说明指定的输出路径已经存在，只要删除已经存在的输出路径即可解决问题。     $hadoop dfs -ls 已经存在输
wordcount报错：org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
yangmingtia的博客
11-12 4164
Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://192.168.25.128:9000/export/yang/log.1     at org.apache.hadoop.mapreduce.lib.i...
hadoop3.1.0 java编写wordcount报错 UnsatisfiedLinkError:org.apache.hadoop.io.nativeio.NativeIO$Windows
qq_42392337的博客
08-06 1030
hadoop3.1.0 java编写wordCount demo过程中出现以下报错信息： 2021-08-06 12:59:47,498 INFO [org.apache.commons.beanutils.FluentPropertyBeanIntrospector] - Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration
【Hadoop】在笔记本虚拟机上部署Hadoop集群后运行Wordcount程序报错Connection refused
Louis Lee's Blog
03-02 907
在笔记本虚拟机上部署Hadoop集群后运行Wordcount程序报错Connection refused
Windows上运行第一个wordCount的时候报错Exception in thread “main“ 0: No such file or directory
最新发布
阿年的博客
12-22 618
Windows上运行第一个MapReduce程序-WordCount报错： Exception in thread "main" 0: No such file or directory
运行hadoop wordcount 时候报错解决办法
sinat_15523495的专栏
03-21 1770
在运行hadoop wordcount时候报错 ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused 我网上查到了好多，最后自己source hadoop-env.sh好了，我都想抽自己两巴掌
eclipse下执行wordcount报错 java.lang.ClassNotFoundException
12-07 5327
我用eclipse执行wordcout，报错如下， 网上一般都说是要加job.setJarByClass(WordCount.class);，但我代码里有这句 另外，导出jar到linux下就正常了 13/06/06 17:16:34 WARN mapred.JobClient: No job jar file set.  User classes may not be found. See
执行wordcount报错及解决
qq_62768655的博客
10-10 203
今天在执行wordcount词频统计时报错 执行语句为 hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.3.jar wordcount wcinput wcoutput 报错如下 这表示指定的输入路径 hdfs://hadoop102:8020/user/atguigu/wcinput 不存在 然后我打开hado...
Hadoop 1.2.1 安装与环境配置详解
最后，通过运行`bin/hadoop version`命令验证Hadoop 1.2.1版本已经正确安装并配置。此外，文档还提到了Hadoop的版本控制系统，即Subversion，用于跟踪代码库的更新和版本管理。 在整个过程中，读者可以了解到如何在...
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值