环境：
操作系统：Windows10
hadoop : hadoop 2.7.6
IDE ： idea 2020.1
JDK : javac 1.8.0_191
问题：
在idea中使用hadoop本地模式运行一个mapreduce任务，抛出如下异常：
Exception in thread "main" ExitCodeException exitCode=-1073741701:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:815)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:798)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:731)
at org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:489)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:529)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:507)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:305)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:133)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:144)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
at test.WordCount.main(WordCount.java:63)
遇到这个异常之后，在网上找了很多材料，大家都知道hadoop在windows上安装的时候需要在hadoop的安装目录的bin目录下替换hadoop.dll ，winutils.exe这两个文件（hadoop实在32位系统上编译的，因此在64位操作系统上需要添加这两个文件）。虽然我已经替换了，但是发现一个问题，双击winutils.exe文件之后，显示文件无法运行。
问题解决流程
①进而解决winutils.exe文件不能运行的问题：
在360安全卫士中下载DirectX修复工具，运行即可完成对winutils.exe文件的修复
完成以上修复后，再次运行任务，又出现下面的异常：
D:\software\it_software\jdk\jdk\bin\java.exe "-javaagent:D:\software\it_software\idea\idea2020\IntelliJ IDEA 2020.1\lib\idea_rt.jar=51446:D:\software\it_software\idea\idea2020\IntelliJ IDEA 2020.1\bin" -Dfile.encoding=UTF-8 -classpath D:\software\it_software\jdk\jdk\jre\lib\charsets.jar;D:\software\it_software\jdk\jdk\jre\lib\deploy.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\access-bridge-32.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\cldrdata.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\dnsns.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\jaccess.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\jfxrt.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\localedata.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\nashorn.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\sunec.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\sunjce_provider.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\sunmscapi.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\sunpkcs11.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\zipfs.jar;D:\software\it_software\jdk\jdk\jre\lib\javaws.jar;D:\software\it_software\jdk\jdk\jre\lib\jce.jar;D:\software\it_software\jdk\jdk\jre\lib\jfr.jar;D:\software\it_software\jdk\jdk\jre\lib\jfxswt.jar;D:\software\it_software\jdk\jdk\jre\lib\jsse.jar;D:\software\it_software\jdk\jdk\jre\lib\management-agent.jar;D:\software\it_software\jdk\jdk\jre\lib\plugin.jar;D:\software\it_software\jdk\jdk\jre\lib\resources.jar;D:\software\it_software\jdk\jdk\jre\lib\rt.jar;D:\maven_modle\target\classes;D:\mavrepo\org\apache\hadoop\hadoop-common\2.7.6\hadoop-common-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-annotations\2.7.6\hadoop-annotations-2.7.6.jar;D:\mavrepo\com\google\guava\guava\11.0.2\guava-11.0.2.jar;D:\mavrepo\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;D:\mavrepo\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;D:\mavrepo\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;D:\mavrepo\commons-httpclient\commons-httpclient\3.1\commons-httpclient-3.1.jar;D:\mavrepo\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;D:\mavrepo\commons-io\commons-io\2.4\commons-io-2.4.jar;D:\mavrepo\commons-net\commons-net\3.1\commons-net-3.1.jar;D:\mavrepo\commons-collections\commons-collections\3.2.2\commons-collections-3.2.2.jar;D:\mavrepo\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\mavrepo\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;D:\mavrepo\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;D:\mavrepo\org\mortbay\jetty\jetty-sslengine\6.1.26\jetty-sslengine-6.1.26.jar;D:\mavrepo\javax\servlet\jsp\jsp-api\2.1\jsp-api-2.1.jar;D:\mavrepo\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;D:\mavrepo\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;D:\mavrepo\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;D:\mavrepo\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;D:\mavrepo\org\codehaus\jackson\jackson-jaxrs\1.8.3\jackson-jaxrs-1.8.3.jar;D:\mavrepo\org\codehaus\jackson\jackson-xc\1.8.3\jackson-xc-1.8.3.jar;D:\mavrepo\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;D:\mavrepo\asm\asm\3.1\asm-3.1.jar;D:\mavrepo\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;D:\mavrepo\log4j\log4j\1.2.17\log4j-1.2.17.jar;D:\mavrepo\net\java\dev\jets3t\jets3t\0.9.0\jets3t-0.9.0.jar;D:\mavrepo\org\apache\httpcomponents\httpclient\4.1.2\httpclient-4.1.2.jar;D:\mavrepo\org\apache\httpcomponents\httpcore\4.1.2\httpcore-4.1.2.jar;D:\mavrepo\com\jamesmurty\utils\java-xmlbuilder\0.4\java-xmlbuilder-0.4.jar;D:\mavrepo\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;D:\mavrepo\commons-configuration\commons-configuration\1.6\commons-configuration-1.6.jar;D:\mavrepo\commons-digester\commons-digester\1.8\commons-digester-1.8.jar;D:\mavrepo\commons-beanutils\commons-beanutils\1.7.0\commons-beanutils-1.7.0.jar;D:\mavrepo\commons-beanutils\commons-beanutils-core\1.8.0\commons-beanutils-core-1.8.0.jar;D:\mavrepo\org\slf4j\slf4j-api\1.7.10\slf4j-api-1.7.10.jar;D:\mavrepo\org\slf4j\slf4j-log4j12\1.7.10\slf4j-log4j12-1.7.10.jar;D:\mavrepo\org\codehaus\jackson\jackson-core-asl\1.9.13\jackson-core-asl-1.9.13.jar;D:\mavrepo\org\codehaus\jackson\jackson-mapper-asl\1.9.13\jackson-mapper-asl-1.9.13.jar;D:\mavrepo\org\apache\avro\avro\1.7.4\avro-1.7.4.jar;D:\mavrepo\com\thoughtworks\paranamer\paranamer\2.3\paranamer-2.3.jar;D:\mavrepo\org\xerial\snappy\snappy-java\1.0.4.1\snappy-java-1.0.4.1.jar;D:\mavrepo\com\google\protobuf\protobuf-java\2.5.0\protobuf-java-2.5.0.jar;D:\mavrepo\com\google\code\gson\gson\2.2.4\gson-2.2.4.jar;D:\mavrepo\org\apache\hadoop\hadoop-auth\2.7.6\hadoop-auth-2.7.6.jar;D:\mavrepo\org\apache\directory\server\apacheds-kerberos-codec\2.0.0-M15\apacheds-kerberos-codec-2.0.0-M15.jar;D:\mavrepo\org\apache\directory\server\apacheds-i18n\2.0.0-M15\apacheds-i18n-2.0.0-M15.jar;D:\mavrepo\org\apache\directory\api\api-asn1-api\1.0.0-M20\api-asn1-api-1.0.0-M20.jar;D:\mavrepo\org\apache\directory\api\api-util\1.0.0-M20\api-util-1.0.0-M20.jar;D:\mavrepo\org\apache\curator\curator-framework\2.7.1\curator-framework-2.7.1.jar;D:\mavrepo\com\jcraft\jsch\0.1.54\jsch-0.1.54.jar;D:\mavrepo\org\apache\curator\curator-client\2.7.1\curator-client-2.7.1.jar;D:\mavrepo\org\apache\curator\curator-recipes\2.7.1\curator-recipes-2.7.1.jar;D:\mavrepo\com\google\code\findbugs\jsr305\3.0.0\jsr305-3.0.0.jar;D:\mavrepo\org\apache\htrace\htrace-core\3.1.0-incubating\htrace-core-3.1.0-incubating.jar;D:\mavrepo\org\apache\commons\commons-compress\1.4.1\commons-compress-1.4.1.jar;D:\mavrepo\org\tukaani\xz\1.0\xz-1.0.jar;D:\mavrepo\org\apache\hadoop\hadoop-hdfs\2.7.6\hadoop-hdfs-2.7.6.jar;D:\mavrepo\commons-daemon\commons-daemon\1.0.13\commons-daemon-1.0.13.jar;D:\mavrepo\io\netty\netty\3.6.2.Final\netty-3.6.2.Final.jar;D:\mavrepo\io\netty\netty-all\4.0.23.Final\netty-all-4.0.23.Final.jar;D:\mavrepo\xerces\xercesImpl\2.9.1\xercesImpl-2.9.1.jar;D:\mavrepo\xml-apis\xml-apis\1.3.04\xml-apis-1.3.04.jar;D:\mavrepo\org\fusesource\leveldbjni\leveldbjni-all\1.8\leveldbjni-all-1.8.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-core\2.7.6\hadoop-mapreduce-client-core-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-yarn-common\2.7.6\hadoop-yarn-common-2.7.6.jar;D:\mavrepo\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;D:\mavrepo\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;D:\mavrepo\javax\activation\activation\1.1\activation-1.1.jar;D:\mavrepo\com\sun\jersey\jersey-client\1.9\jersey-client-1.9.jar;D:\mavrepo\com\google\inject\guice\3.0\guice-3.0.jar;D:\mavrepo\javax\inject\javax.inject\1\javax.inject-1.jar;D:\mavrepo\aopalliance\aopalliance\1.0\aopalliance-1.0.jar;D:\mavrepo\com\sun\jersey\contribs\jersey-guice\1.9\jersey-guice-1.9.jar;D:\mavrepo\com\google\inject\extensions\guice-servlet\3.0\guice-servlet-3.0.jar;D:\mavrepo\org\apache\hadoop\hadoop-client\2.7.6\hadoop-client-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-app\2.7.6\hadoop-mapreduce-client-app-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-common\2.7.6\hadoop-mapreduce-client-common-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-yarn-client\2.7.6\hadoop-yarn-client-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-yarn-server-common\2.7.6\hadoop-yarn-server-common-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-shuffle\2.7.6\hadoop-mapreduce-client-shuffle-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-yarn-api\2.7.6\hadoop-yarn-api-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-jobclient\2.7.6\hadoop-mapreduce-client-jobclient-2.7.6.jar;D:\mavrepo\junit\junit\4.12\junit-4.12.jar;D:\mavrepo\org\hamcrest\hamcrest-core\1.3\hamcrest-core-1.3.jar;D:\mavrepo\org\apache\zookeeper\zookeeper\3.4.10\zookeeper-3.4.10.jar;D:\mavrepo\jline\jline\0.9.94\jline-0.9.94.jar qf.flow.FlowBeanDriver
20/06/22 21:40:39 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
20/06/22 21:40:39 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
20/06/22 21:40:41 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
20/06/22 21:40:41 WARN mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
20/06/22 21:40:41 INFO input.FileInputFormat: Total input paths to process : 1
20/06/22 21:40:42 INFO mapreduce.JobSubmitter: number of splits:1
20/06/22 21:40:43 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local1871856099_0001
20/06/22 21:40:43 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/usr/local/hadoop/tmp/mapred/staging/root1871856099/.staging/job_local1871856099_0001
Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z
at org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Native Method)
at org.apache.hadoop.io.nativeio.NativeIO$Windows.access(NativeIO.java:609)
at org.apache.hadoop.fs.FileUtil.canRead(FileUtil.java:977)
at org.apache.hadoop.util.DiskChecker.checkAccessByFileMethods(DiskChecker.java:187)
at org.apache.hadoop.util.DiskChecker.checkDirAccess(DiskChecker.java:174)
at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:108)
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:285)
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:344)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:125)
at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:163)
at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:731)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:240)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1758)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
at qf.flow.FlowBeanDriver.main(FlowBeanDriver.java:38)
Process finished with exit code 1
②紧接着在idea中搜索类 NativeIO,进入该类，ctrl + A —> ctrl + C
③然后在java目录中ctrl + V,对创建的NativeIO类中出现的包名异常进行修复，如果修复不能解决（Cannot modify a read-only directory ‘D:\mavrepo\org\apache\hadoop\hadoop-common\2.7.6\hadoop-common-2.7.6.jar!\org\apache\hadoop\io\nativeio’.），就在java目录下手动创建一个一摸一样的包，让然后把NativeIO类拖进此包中
④在NativeIO文件中ctrl + F搜索 access0 ，然后将方法返回值access0(path, desiredAccess.accessRight())修改为true
然后在运行一次,终于出现了令人欣喜的Process finished with exit code 0
到这里问题就解决了，希望能给遇到相同问题的人一些参考。
D:\software\it_software\jdk\jdk\bin\java.exe "-javaagent:D:\software\it_software\idea\idea2020\IntelliJ IDEA 2020.1\lib\idea_rt.jar=55795:D:\software\it_software\idea\idea2020\IntelliJ IDEA 2020.1\bin" -Dfile.encoding=UTF-8 -classpath D:\software\it_software\jdk\jdk\jre\lib\charsets.jar;D:\software\it_software\jdk\jdk\jre\lib\deploy.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\access-bridge-32.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\cldrdata.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\dnsns.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\jaccess.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\jfxrt.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\localedata.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\nashorn.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\sunec.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\sunjce_provider.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\sunmscapi.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\sunpkcs11.jar;D:\software\it_software\jdk\jdk\jre\lib\ext\zipfs.jar;D:\software\it_software\jdk\jdk\jre\lib\javaws.jar;D:\software\it_software\jdk\jdk\jre\lib\jce.jar;D:\software\it_software\jdk\jdk\jre\lib\jfr.jar;D:\software\it_software\jdk\jdk\jre\lib\jfxswt.jar;D:\software\it_software\jdk\jdk\jre\lib\jsse.jar;D:\software\it_software\jdk\jdk\jre\lib\management-agent.jar;D:\software\it_software\jdk\jdk\jre\lib\plugin.jar;D:\software\it_software\jdk\jdk\jre\lib\resources.jar;D:\software\it_software\jdk\jdk\jre\lib\rt.jar;D:\maven_modle\target\classes;D:\mavrepo\org\apache\hadoop\hadoop-common\2.7.6\hadoop-common-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-annotations\2.7.6\hadoop-annotations-2.7.6.jar;D:\mavrepo\com\google\guava\guava\11.0.2\guava-11.0.2.jar;D:\mavrepo\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;D:\mavrepo\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;D:\mavrepo\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;D:\mavrepo\commons-httpclient\commons-httpclient\3.1\commons-httpclient-3.1.jar;D:\mavrepo\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;D:\mavrepo\commons-io\commons-io\2.4\commons-io-2.4.jar;D:\mavrepo\commons-net\commons-net\3.1\commons-net-3.1.jar;D:\mavrepo\commons-collections\commons-collections\3.2.2\commons-collections-3.2.2.jar;D:\mavrepo\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\mavrepo\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;D:\mavrepo\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;D:\mavrepo\org\mortbay\jetty\jetty-sslengine\6.1.26\jetty-sslengine-6.1.26.jar;D:\mavrepo\javax\servlet\jsp\jsp-api\2.1\jsp-api-2.1.jar;D:\mavrepo\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;D:\mavrepo\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;D:\mavrepo\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;D:\mavrepo\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;D:\mavrepo\org\codehaus\jackson\jackson-jaxrs\1.8.3\jackson-jaxrs-1.8.3.jar;D:\mavrepo\org\codehaus\jackson\jackson-xc\1.8.3\jackson-xc-1.8.3.jar;D:\mavrepo\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;D:\mavrepo\asm\asm\3.1\asm-3.1.jar;D:\mavrepo\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;D:\mavrepo\log4j\log4j\1.2.17\log4j-1.2.17.jar;D:\mavrepo\net\java\dev\jets3t\jets3t\0.9.0\jets3t-0.9.0.jar;D:\mavrepo\org\apache\httpcomponents\httpclient\4.1.2\httpclient-4.1.2.jar;D:\mavrepo\org\apache\httpcomponents\httpcore\4.1.2\httpcore-4.1.2.jar;D:\mavrepo\com\jamesmurty\utils\java-xmlbuilder\0.4\java-xmlbuilder-0.4.jar;D:\mavrepo\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;D:\mavrepo\commons-configuration\commons-configuration\1.6\commons-configuration-1.6.jar;D:\mavrepo\commons-digester\commons-digester\1.8\commons-digester-1.8.jar;D:\mavrepo\commons-beanutils\commons-beanutils\1.7.0\commons-beanutils-1.7.0.jar;D:\mavrepo\commons-beanutils\commons-beanutils-core\1.8.0\commons-beanutils-core-1.8.0.jar;D:\mavrepo\org\slf4j\slf4j-api\1.7.10\slf4j-api-1.7.10.jar;D:\mavrepo\org\slf4j\slf4j-log4j12\1.7.10\slf4j-log4j12-1.7.10.jar;D:\mavrepo\org\codehaus\jackson\jackson-core-asl\1.9.13\jackson-core-asl-1.9.13.jar;D:\mavrepo\org\codehaus\jackson\jackson-mapper-asl\1.9.13\jackson-mapper-asl-1.9.13.jar;D:\mavrepo\org\apache\avro\avro\1.7.4\avro-1.7.4.jar;D:\mavrepo\com\thoughtworks\paranamer\paranamer\2.3\paranamer-2.3.jar;D:\mavrepo\org\xerial\snappy\snappy-java\1.0.4.1\snappy-java-1.0.4.1.jar;D:\mavrepo\com\google\protobuf\protobuf-java\2.5.0\protobuf-java-2.5.0.jar;D:\mavrepo\com\google\code\gson\gson\2.2.4\gson-2.2.4.jar;D:\mavrepo\org\apache\hadoop\hadoop-auth\2.7.6\hadoop-auth-2.7.6.jar;D:\mavrepo\org\apache\directory\server\apacheds-kerberos-codec\2.0.0-M15\apacheds-kerberos-codec-2.0.0-M15.jar;D:\mavrepo\org\apache\directory\server\apacheds-i18n\2.0.0-M15\apacheds-i18n-2.0.0-M15.jar;D:\mavrepo\org\apache\directory\api\api-asn1-api\1.0.0-M20\api-asn1-api-1.0.0-M20.jar;D:\mavrepo\org\apache\directory\api\api-util\1.0.0-M20\api-util-1.0.0-M20.jar;D:\mavrepo\org\apache\curator\curator-framework\2.7.1\curator-framework-2.7.1.jar;D:\mavrepo\com\jcraft\jsch\0.1.54\jsch-0.1.54.jar;D:\mavrepo\org\apache\curator\curator-client\2.7.1\curator-client-2.7.1.jar;D:\mavrepo\org\apache\curator\curator-recipes\2.7.1\curator-recipes-2.7.1.jar;D:\mavrepo\com\google\code\findbugs\jsr305\3.0.0\jsr305-3.0.0.jar;D:\mavrepo\org\apache\htrace\htrace-core\3.1.0-incubating\htrace-core-3.1.0-incubating.jar;D:\mavrepo\org\apache\commons\commons-compress\1.4.1\commons-compress-1.4.1.jar;D:\mavrepo\org\tukaani\xz\1.0\xz-1.0.jar;D:\mavrepo\org\apache\hadoop\hadoop-hdfs\2.7.6\hadoop-hdfs-2.7.6.jar;D:\mavrepo\commons-daemon\commons-daemon\1.0.13\commons-daemon-1.0.13.jar;D:\mavrepo\io\netty\netty\3.6.2.Final\netty-3.6.2.Final.jar;D:\mavrepo\io\netty\netty-all\4.0.23.Final\netty-all-4.0.23.Final.jar;D:\mavrepo\xerces\xercesImpl\2.9.1\xercesImpl-2.9.1.jar;D:\mavrepo\xml-apis\xml-apis\1.3.04\xml-apis-1.3.04.jar;D:\mavrepo\org\fusesource\leveldbjni\leveldbjni-all\1.8\leveldbjni-all-1.8.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-core\2.7.6\hadoop-mapreduce-client-core-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-yarn-common\2.7.6\hadoop-yarn-common-2.7.6.jar;D:\mavrepo\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;D:\mavrepo\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;D:\mavrepo\javax\activation\activation\1.1\activation-1.1.jar;D:\mavrepo\com\sun\jersey\jersey-client\1.9\jersey-client-1.9.jar;D:\mavrepo\com\google\inject\guice\3.0\guice-3.0.jar;D:\mavrepo\javax\inject\javax.inject\1\javax.inject-1.jar;D:\mavrepo\aopalliance\aopalliance\1.0\aopalliance-1.0.jar;D:\mavrepo\com\sun\jersey\contribs\jersey-guice\1.9\jersey-guice-1.9.jar;D:\mavrepo\com\google\inject\extensions\guice-servlet\3.0\guice-servlet-3.0.jar;D:\mavrepo\org\apache\hadoop\hadoop-client\2.7.6\hadoop-client-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-app\2.7.6\hadoop-mapreduce-client-app-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-common\2.7.6\hadoop-mapreduce-client-common-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-yarn-client\2.7.6\hadoop-yarn-client-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-yarn-server-common\2.7.6\hadoop-yarn-server-common-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-shuffle\2.7.6\hadoop-mapreduce-client-shuffle-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-yarn-api\2.7.6\hadoop-yarn-api-2.7.6.jar;D:\mavrepo\org\apache\hadoop\hadoop-mapreduce-client-jobclient\2.7.6\hadoop-mapreduce-client-jobclient-2.7.6.jar;D:\mavrepo\junit\junit\4.12\junit-4.12.jar;D:\mavrepo\org\hamcrest\hamcrest-core\1.3\hamcrest-core-1.3.jar;D:\mavrepo\org\apache\zookeeper\zookeeper\3.4.10\zookeeper-3.4.10.jar;D:\mavrepo\jline\jline\0.9.94\jline-0.9.94.jar com.flow.FlowBeanDriver
20/06/23 00:17:49 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
20/06/23 00:17:49 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
20/06/23 00:17:51 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
20/06/23 00:17:51 WARN mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
20/06/23 00:17:52 INFO input.FileInputFormat: Total input paths to process : 1
20/06/23 00:17:52 INFO mapreduce.JobSubmitter: number of splits:1
20/06/23 00:17:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local1090467864_0001
20/06/23 00:17:53 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
20/06/23 00:17:53 INFO mapreduce.Job: Running job: job_local1090467864_0001
20/06/23 00:17:53 INFO mapred.LocalJobRunner: OutputCommitter set in config null
20/06/23 00:17:53 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
20/06/23 00:17:53 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
20/06/23 00:17:53 INFO mapred.LocalJobRunner: Waiting for map tasks
20/06/23 00:17:53 INFO mapred.LocalJobRunner: Starting task: attempt_local1090467864_0001_m_000000_0
20/06/23 00:17:53 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
20/06/23 00:17:53 INFO util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux.
20/06/23 00:17:53 INFO mapred.Task: Using ResourceCalculatorProcessTree : org.apache.hadoop.yarn.util.WindowsBasedProcessTree@c78889
20/06/23 00:17:53 INFO mapred.MapTask: Processing split: file:/D:/input/HTTP_20130313143750.dat:0+2208
20/06/23 00:17:53 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
20/06/23 00:17:53 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
20/06/23 00:17:53 INFO mapred.MapTask: soft limit at 83886080
20/06/23 00:17:53 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
20/06/23 00:17:53 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
20/06/23 00:17:53 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
20/06/23 00:17:53 INFO input.LineRecordReader: Found UTF-8 BOM and skipped it
20/06/23 00:17:53 INFO mapred.LocalJobRunner:
20/06/23 00:17:53 INFO mapred.MapTask: Starting flush of map output
20/06/23 00:17:53 INFO mapred.MapTask: Spilling map output
20/06/23 00:17:53 INFO mapred.MapTask: bufstart = 0; bufend = 525; bufvoid = 104857600
20/06/23 00:17:53 INFO mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214312(104857248); length = 85/6553600
20/06/23 00:17:53 INFO mapred.MapTask: Finished spill 0
20/06/23 00:17:53 INFO mapred.Task: Task:attempt_local1090467864_0001_m_000000_0 is done. And is in the process of committing
20/06/23 00:17:53 INFO mapred.LocalJobRunner: map
20/06/23 00:17:53 INFO mapred.Task: Task 'attempt_local1090467864_0001_m_000000_0' done.
20/06/23 00:17:53 INFO mapred.Task: Final Counters for attempt_local1090467864_0001_m_000000_0: Counters: 17
File System Counters
FILE: Number of bytes read=2367
FILE: Number of bytes written=295542
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Map input records=22
Map output records=22
Map output bytes=525
Map output materialized bytes=575
Input split bytes=103
Combine input records=0
Spilled Records=22
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=30
Total committed heap usage (bytes)=121180160
File Input Format Counters
Bytes Read=2208
20/06/23 00:17:53 INFO mapred.LocalJobRunner: Finishing task: attempt_local1090467864_0001_m_000000_0
20/06/23 00:17:53 INFO mapred.LocalJobRunner: map task executor complete.
20/06/23 00:17:53 INFO mapred.LocalJobRunner: Waiting for reduce tasks
20/06/23 00:17:53 INFO mapred.LocalJobRunner: Starting task: attempt_local1090467864_0001_r_000000_0
20/06/23 00:17:53 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
20/06/23 00:17:53 INFO util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux.
20/06/23 00:17:54 INFO mapred.Task: Using ResourceCalculatorProcessTree : org.apache.hadoop.yarn.util.WindowsBasedProcessTree@e9dd70
20/06/23 00:17:54 INFO mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@55a64a
20/06/23 00:17:54 INFO reduce.MergeManagerImpl: MergerManager: memoryLimit=181665792, maxSingleShuffleLimit=45416448, mergeThreshold=119899424, ioSortFactor=10, memToMemMergeOutputsThreshold=10
20/06/23 00:17:54 INFO reduce.EventFetcher: attempt_local1090467864_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
20/06/23 00:17:54 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local1090467864_0001_m_000000_0 decomp: 571 len: 575 to MEMORY
20/06/23 00:17:54 INFO reduce.InMemoryMapOutput: Read 571 bytes from map-output for attempt_local1090467864_0001_m_000000_0
20/06/23 00:17:54 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 571, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->571
20/06/23 00:17:54 INFO reduce.EventFetcher: EventFetcher is interrupted.. Returning
20/06/23 00:17:54 INFO mapred.LocalJobRunner: 1 / 1 copied.
20/06/23 00:17:54 INFO reduce.MergeManagerImpl: finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
20/06/23 00:17:54 INFO mapred.Merger: Merging 1 sorted segments
20/06/23 00:17:54 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 557 bytes
20/06/23 00:17:54 INFO reduce.MergeManagerImpl: Merged 1 segments, 571 bytes to disk to satisfy reduce memory limit
20/06/23 00:17:54 INFO reduce.MergeManagerImpl: Merging 1 files, 575 bytes from disk
20/06/23 00:17:54 INFO reduce.MergeManagerImpl: Merging 0 segments, 0 bytes from memory into reduce
20/06/23 00:17:54 INFO mapred.Merger: Merging 1 sorted segments
20/06/23 00:17:54 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 557 bytes
20/06/23 00:17:54 INFO mapred.LocalJobRunner: 1 / 1 copied.
20/06/23 00:17:54 INFO Configuration.deprecation: mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords
20/06/23 00:17:54 INFO mapred.Task: Task:attempt_local1090467864_0001_r_000000_0 is done. And is in the process of committing
20/06/23 00:17:54 INFO mapred.LocalJobRunner: 1 / 1 copied.
20/06/23 00:17:54 INFO mapred.Task: Task attempt_local1090467864_0001_r_000000_0 is allowed to commit now
20/06/23 00:17:54 INFO output.FileOutputCommitter: Saved output of task 'attempt_local1090467864_0001_r_000000_0' to file:/D:/output/_temporary/0/task_local1090467864_0001_r_000000
20/06/23 00:17:54 INFO mapred.LocalJobRunner: reduce > reduce
20/06/23 00:17:54 INFO mapred.Task: Task 'attempt_local1090467864_0001_r_000000_0' done.
20/06/23 00:17:54 INFO mapred.Task: Final Counters for attempt_local1090467864_0001_r_000000_0: Counters: 24
File System Counters
FILE: Number of bytes read=3549
FILE: Number of bytes written=296684
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Combine input records=0
Combine output records=0
Reduce input groups=21
Reduce shuffle bytes=575
Reduce input records=22
Reduce output records=21
Spilled Records=22
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=5
Total committed heap usage (bytes)=121180160
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Output Format Counters
Bytes Written=567
20/06/23 00:17:54 INFO mapred.LocalJobRunner: Finishing task: attempt_local1090467864_0001_r_000000_0
20/06/23 00:17:54 INFO mapred.LocalJobRunner: reduce task executor complete.
20/06/23 00:17:54 INFO mapreduce.Job: Job job_local1090467864_0001 running in uber mode : false
20/06/23 00:17:54 INFO mapreduce.Job: map 100% reduce 100%
20/06/23 00:17:55 INFO mapreduce.Job: Job job_local1090467864_0001 completed successfully
20/06/23 00:17:55 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=5916
FILE: Number of bytes written=592226
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Map input records=22
Map output records=22
Map output bytes=525
Map output materialized bytes=575
Input split bytes=103
Combine input records=0
Combine output records=0
Reduce input groups=21
Reduce shuffle bytes=575
Reduce input records=22
Reduce output records=21
Spilled Records=44
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=35
Total committed heap usage (bytes)=242360320
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=2208
File Output Format Counters
Bytes Written=567
Process finished with exit code 0
898
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
