【运行结果】WordCount的实现

运行过程记录

"C:\Program Files\Java\jdk1.8.0_60\bin\java.exe" "-javaagent:D:\IntelliJ IDEA Community Edition 2020.2.2\lib\idea_rt.jar=56144:D:\IntelliJ IDEA Community Edition 2020.2.2\bin" -Dfile.encoding=UTF-8 -classpath "C:\Program Files\Java\jdk1.8.0_60\jre\lib\charsets.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\deploy.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\access-bridge-64.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\cldrdata.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\dnsns.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\jaccess.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\jfxrt.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\localedata.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\nashorn.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\sunec.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\sunjce_provider.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\sunmscapi.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\sunpkcs11.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\zipfs.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\javaws.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\jce.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\jfr.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\jfxswt.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\jsse.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\management-agent.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\plugin.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\resources.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\rt.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\out\production\Temp;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\xz-1.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\asm-3.2.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\guice-3.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\avro-1.7.4.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\gson-2.2.4.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\junit-4.10.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\junit-4.11.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jsch-0.1.42.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jsp-api-2.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\junit-4.8.2.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\xmlenc-0.52.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\guava-11.0.2.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jets3t-0.6.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jets3t-0.9.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jettison-1.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jetty-6.1.26.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jline-0.9.94.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jsr305-1.3.9.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\log4j-1.2.17.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\paranamer-2.3.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\activation-1.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-el-1.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-io-2.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-io-2.4.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\httpcore-4.2.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\javax.inject-1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jaxb-api-2.2.2.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\stax-api-1.0-2.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\stax-api-1.0.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\aopalliance-1.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-cli-1.2.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-net-3.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jersey-core-1.9.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jersey-json-1.9.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\servlet-api-2.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\slf4j-api-1.7.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\zookeeper-3.4.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\zookeeper-3.4.6.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-lang-2.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-lang-2.6.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-math-2.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-nfs-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-nfs-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\httpclient-4.2.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jackson-xc-1.8.8.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jersey-guice-1.9.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-codec-1.4.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\guice-servlet-3.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-auth-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-auth-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hamcrest-core-1.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hamcrest-core-1.3.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\htrace-core-3.0.4.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jackson-xc-1.9.13.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jaxb-impl-2.2.3-1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jersey-client-1.9.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jersey-server-1.9.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jetty-util-6.1.26.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\mockito-all-1.8.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\netty-3.6.2.Final.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\api-util-1.0.0-M20.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\leveldbjni-all-1.8.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-logging-1.2.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-math3-3.1.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-common-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-common-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jackson-jaxrs-1.8.8.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\java-xmlbuilder-0.4.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\protobuf-java-2.5.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\slf4j-log4j12-1.7.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\snappy-java-1.0.4.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-digester-1.8.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\curator-client-2.6.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jackson-jaxrs-1.9.13.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-logging-1.1.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-logging-1.1.3.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\curator-recipes-2.6.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-api-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jasper-runtime-5.5.23.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\api-asn1-api-1.0.0-M20.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-compress-1.4.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-httpclient-3.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jackson-core-asl-1.8.8.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jasper-compiler-5.5.23.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\apacheds-i18n-2.0.0-M15.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-beanutils-1.7.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\curator-framework-2.6.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jackson-core-asl-1.9.13.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-annotations-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-annotations-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-client-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-common-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jackson-mapper-asl-1.8.8.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-collections-3.2.1.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-collections-3.2.2.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-configuration-1.6.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-common-2.2.0-tests.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\jackson-mapper-asl-1.9.13.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-registry-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\commons-beanutils-core-1.8.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-api-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-tests-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-mapreduce-examples-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-common-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-mapreduce-client-hs-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-client-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-common-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\apacheds-kerberos-codec-2.0.0-M15.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-mapreduce-client-app-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-mapreduce-client-core-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-api-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-web-proxy-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-mapreduce-client-common-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-nodemanager-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-mapreduce-client-shuffle-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-client-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-common-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-tests-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-mapreduce-client-jobclient-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-common-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-mapreduce-client-hs-plugins-2.2.0.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-resourcemanager-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-web-proxy-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-tests-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-common-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-nodemanager-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-mapreduce-client-jobclient-2.2.0-tests.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-applications-distributedshell-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-web-proxy-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-resourcemanager-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-nodemanager-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-applicationhistoryservice-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-applications-unmanaged-am-launcher-2.6.5.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-resourcemanager-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-applications-distributedshell-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-applicationhistoryservice-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-applications-distributedshell-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-applications-unmanaged-am-launcher-2.6.5-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-server-applicationhistoryservice-2.6.5-test-sources.jar;C:\Users\Administrator\Desktop\Code\learn_hadoop\Temp\Jars\hadoop-yarn-applications-unmanaged-am-launcher-2.6.5-test-sources.jar" com.MergeSort.MyWordCount
2023-04-01 11:40:15,497 INFO  [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2023-04-01 11:40:15,811 WARN  [main] mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(149)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2023-04-01 11:40:15,815 WARN  [main] mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(258)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2023-04-01 11:40:15,821 INFO  [main] input.FileInputFormat (FileInputFormat.java:listStatus(287)) - Total input paths to process : 1
2023-04-01 11:40:15,850 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2023-04-01 11:40:15,862 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2023-04-01 11:40:15,862 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
2023-04-01 11:40:15,862 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2023-04-01 11:40:15,862 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
2023-04-01 11:40:15,863 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2023-04-01 11:40:15,863 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2023-04-01 11:40:15,863 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2023-04-01 11:40:15,863 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2023-04-01 11:40:15,863 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2023-04-01 11:40:15,864 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2023-04-01 11:40:15,864 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2023-04-01 11:40:15,865 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2023-04-01 11:40:15,865 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2023-04-01 11:40:15,865 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2023-04-01 11:40:15,989 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1085885745_0001
2023-04-01 11:40:16,017 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2172)) - file:/tmp/hadoop-Administrator/mapred/staging/root1085885745/.staging/job_local1085885745_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2023-04-01 11:40:16,017 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2172)) - file:/tmp/hadoop-Administrator/mapred/staging/root1085885745/.staging/job_local1085885745_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2023-04-01 11:40:16,090 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2172)) - file:/tmp/hadoop-Administrator/mapred/local/localRunner/root/job_local1085885745_0001/job_local1085885745_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2023-04-01 11:40:16,090 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2172)) - file:/tmp/hadoop-Administrator/mapred/local/localRunner/root/job_local1085885745_0001/job_local1085885745_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2023-04-01 11:40:16,095 INFO  [main] mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2023-04-01 11:40:16,095 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1317)) - Running job: job_local1085885745_0001
2023-04-01 11:40:16,096 INFO  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2023-04-01 11:40:16,101 INFO  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2023-04-01 11:40:16,127 INFO  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2023-04-01 11:40:16,127 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1085885745_0001_m_000000_0
2023-04-01 11:40:16,150 INFO  [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(181)) - ProcfsBasedProcessTree currently is supported only on Linux.
2023-04-01 11:40:16,183 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : org.apache.hadoop.yarn.util.WindowsBasedProcessTree@7113a551
2023-04-01 11:40:16,186 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:runNewMapper(732)) - Processing split: file:/C:/Users/Administrator/Desktop/Code/learn_hadoop/input.txt:0+73
2023-04-01 11:40:16,195 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2023-04-01 11:40:16,218 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2023-04-01 11:40:16,218 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2023-04-01 11:40:16,218 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2023-04-01 11:40:16,218 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2023-04-01 11:40:16,219 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2023-04-01 11:40:16,227 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - 
2023-04-01 11:40:16,227 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2023-04-01 11:40:16,228 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2023-04-01 11:40:16,228 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 150; bufvoid = 104857600
2023-04-01 11:40:16,228 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214360(104857440); length = 37/6553600
2023-04-01 11:40:16,241 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2023-04-01 11:40:16,245 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task (Task.java:done(995)) - Task:attempt_local1085885745_0001_m_000000_0 is done. And is in the process of committing
2023-04-01 11:40:16,253 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - map
2023-04-01 11:40:16,253 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1085885745_0001_m_000000_0' done.
2023-04-01 11:40:16,253 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1085885745_0001_m_000000_0
2023-04-01 11:40:16,254 INFO  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2023-04-01 11:40:16,268 INFO  [Thread-3] util.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(181)) - ProcfsBasedProcessTree currently is supported only on Linux.
2023-04-01 11:40:16,300 INFO  [Thread-3] mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : org.apache.hadoop.yarn.util.WindowsBasedProcessTree@5cc5ea65
2023-04-01 11:40:16,337 INFO  [Thread-3] mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2023-04-01 11:40:16,342 INFO  [Thread-3] mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 163 bytes
2023-04-01 11:40:16,343 INFO  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - 
2023-04-01 11:40:16,347 INFO  [Thread-3] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords
2023-04-01 11:40:16,352 INFO  [Thread-3] mapred.Task (Task.java:done(995)) - Task:attempt_local1085885745_0001_r_000000_0 is done. And is in the process of committing
2023-04-01 11:40:16,352 INFO  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - 
2023-04-01 11:40:16,353 INFO  [Thread-3] mapred.Task (Task.java:commit(1156)) - Task attempt_local1085885745_0001_r_000000_0 is allowed to commit now
2023-04-01 11:40:16,353 INFO  [Thread-3] output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1085885745_0001_r_000000_0' to file:/E:/output/_temporary/0/task_local1085885745_0001_r_000000
2023-04-01 11:40:16,354 INFO  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2023-04-01 11:40:16,354 INFO  [Thread-3] mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1085885745_0001_r_000000_0' done.
2023-04-01 11:40:17,097 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1338)) - Job job_local1085885745_0001 running in uber mode : false
2023-04-01 11:40:17,101 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1345)) -  map 100% reduce 100%
2023-04-01 11:40:17,106 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1356)) - Job job_local1085885745_0001 completed successfully
2023-04-01 11:40:17,130 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1363)) - Counters: 27
	File System Counters
		FILE: Number of bytes read=688
		FILE: Number of bytes written=346149
		FILE: Number of read operations=0
		FILE: Number of large read operations=0
		FILE: Number of write operations=0
	Map-Reduce Framework
		Map input records=5
		Map output records=10
		Map output bytes=150
		Map output materialized bytes=176
		Input split bytes=129
		Combine input records=0
		Combine output records=0
		Reduce input groups=5
		Reduce shuffle bytes=0
		Reduce input records=10
		Reduce output records=5
		Spilled Records=20
		Shuffled Maps =0
		Failed Shuffles=0
		Merged Map outputs=0
		GC time elapsed (ms)=31
		CPU time spent (ms)=0
		Physical memory (bytes) snapshot=0
		Virtual memory (bytes) snapshot=0
		Total committed heap usage (bytes)=468713472
	File Input Format Counters 
		Bytes Read=73
	File Output Format Counters 
		Bytes Written=57

Process finished with exit code 0

在HDFS中查看输出结果

在这里插入图片描述

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

王摇摆

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值