在eclipse中运行Hadoop的worldcount程序时报如下错误:
org.apache.hadoop.security.AccessControlException:Permission denied: user=????, access=WRITE, inode="/456
/output/_temporary/0":root:supergroup:drwxr----x
说没有权限,在shell/虚拟机端给它权限即可:
hdfs dfs -chmod 777 /users
/users
是在hdfs上的文件,需要指定你要操作的文件/目录的名称
以下是部分报错(较全,可以比较下是否报错相同)
2020-06-08 12:53:16,755 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - session.id is deprecated. Instead, use dfs.metrics.session-id
0 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - session.id is deprecated. Instead, use dfs.metrics.session-id
2020-06-08 12:53:16,759 INFO [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
4 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
2020-06-08 12:53:17,425 WARN [main] mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
670 [main] WARN org.apache.hadoop.mapreduce.JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2020-06-08 12:53:17,455 WARN [main] mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
700 [main] WARN org.apache.hadoop.mapreduce.JobResourceUploader - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2020-06-08 12:53:17,526 INFO [main] input.FileInputFormat (FileInputFormat.java:listStatus(283)) - Total input paths to process : 2
771 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 2
2020-06-08 12:53:17,555 INFO [main] mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(198)) - number of splits:2
800 [main] INFO org.apache.hadoop.mapreduce.JobSubmitter - number of splits:2
2020-06-08 12:53:17,663 INFO [main] mapreduce.JobSubmitter (JobSubmitter.java:printTokens(287)) - Submitting tokens for job: job_local1187953555_0001
908 [main] INFO org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_local1187953555_0001
2020-06-08 12:53:17,836 INFO [main] mapreduce.Job (Job.java:submit(1294)) - The url to track the job: http://localhost:8080/
1081 [main] INFO org.apache.hadoop.mapreduce.Job - The url to track the job: http://localhost:8080/
2020-06-08 12:53:17,838 INFO [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
1083 [Thread-3] INFO org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter set in config null
2020-06-08 12:53:17,844 INFO [Thread-3] output.FileOutputCommitter (FileOutputCommitter.java:<init>(100)) - File Output Committer Algorithm version is 1
1089 [Thread-3] INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter - File Output Committer Algorithm version is 1
2020-06-08 12:53:17,846 INFO [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
1091 [Thread-3] INFO org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2020-06-08 12:53:17,876 WARN [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1187953555_0001
org.apache.hadoop.security.AccessControlException: Permission denied: user=????, access=WRITE, inode="/456/output/_temporary/0":root:supergroup:drwxr----x
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190)