"C:\Program Files\Java\jdk1.8.0_60\bin\java.exe""-javaagent:D:\IntelliJ IDEA Community Edition 2020.2.2\lib\idea_rt.jar=49900:D:\IntelliJ IDEA Community Edition 2020.2.2\bin"-Dfile.encoding=UTF-8-classpath "C:\Program Files\Java\jdk1.8.0_60\jre\lib\charsets.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\deploy.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\access-bridge-64.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\cldrdata.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\dnsns.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\jaccess.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\jfxrt.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\localedata.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\nashorn.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\sunec.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\sunjce_provider.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\sunmscapi.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\sunpkcs11.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\ext\zipfs.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\javaws.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\jce.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\jfr.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\jfxswt.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\jsse.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\management-agent.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\plugin.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\resources.jar;C:\Program Files\Java\jdk1.8.0_60\jre\lib\rt.jar;C:\Users\Administrator\Desktop\Code\Learn_import\out\production\WordCount2;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\activation-1.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\aopalliance-1.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\apacheds-i18n-2.0.0-M15.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\apacheds-kerberos-codec-2.0.0-M15.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\api-asn1-api-1.0.0-M20.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\api-util-1.0.0-M20.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\asm-3.2.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\avro-1.7.4.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-beanutils-1.7.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-beanutils-core-1.8.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-cli-1.2.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-codec-1.4.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-collections-3.2.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-collections-3.2.2.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-compress-1.4.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-configuration-1.6.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-digester-1.8.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-el-1.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-httpclient-3.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-io-2.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-io-2.4.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-lang-2.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-lang-2.6.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-logging-1.1.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-logging-1.1.3.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-logging-1.2.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-math-2.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-math3-3.1.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\commons-net-3.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\curator-client-2.6.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\curator-framework-2.6.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\curator-recipes-2.6.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\gson-2.2.4.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\guava-11.0.2.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\guice-3.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\guice-servlet-3.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-annotations-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-annotations-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-auth-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-auth-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-common-2.2.0-tests.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-common-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-common-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-mapreduce-client-app-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-mapreduce-client-common-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-mapreduce-client-core-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-mapreduce-client-hs-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-mapreduce-client-hs-plugins-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-mapreduce-client-jobclient-2.2.0-tests.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-mapreduce-client-jobclient-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-mapreduce-client-shuffle-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-mapreduce-examples-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-nfs-2.2.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-nfs-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-api-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-applications-distributedshell-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-applications-unmanaged-am-launcher-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-client-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-common-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-registry-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-server-applicationhistoryservice-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-server-common-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-server-nodemanager-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-server-resourcemanager-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-server-tests-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hadoop-yarn-server-web-proxy-2.6.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hamcrest-core-1.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\hamcrest-core-1.3.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\htrace-core-3.0.4.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\httpclient-4.2.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\httpcore-4.2.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jackson-core-asl-1.8.8.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jackson-core-asl-1.9.13.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jackson-jaxrs-1.8.8.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jackson-jaxrs-1.9.13.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jackson-mapper-asl-1.8.8.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jackson-mapper-asl-1.9.13.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jackson-xc-1.8.8.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jackson-xc-1.9.13.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jasper-compiler-5.5.23.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jasper-runtime-5.5.23.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\java-xmlbuilder-0.4.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\javax.inject-1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jaxb-api-2.2.2.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jaxb-impl-2.2.3-1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jersey-client-1.9.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jersey-core-1.9.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jersey-guice-1.9.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jersey-json-1.9.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jersey-server-1.9.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jets3t-0.6.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jets3t-0.9.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jettison-1.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jetty-6.1.26.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jetty-util-6.1.26.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jline-0.9.94.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jsch-0.1.42.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jsp-api-2.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\jsr305-1.3.9.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\junit-4.10.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\junit-4.11.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\junit-4.8.2.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\leveldbjni-all-1.8.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\log4j-1.2.17.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\mockito-all-1.8.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\netty-3.6.2.Final.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\paranamer-2.3.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\protobuf-java-2.5.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\servlet-api-2.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\slf4j-api-1.7.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\slf4j-log4j12-1.7.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\snappy-java-1.0.4.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\stax-api-1.0-2.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\stax-api-1.0.1.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\xmlenc-0.52.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\xz-1.0.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\zookeeper-3.4.5.jar;C:\Users\Administrator\Desktop\Code\Learn_import\Test2\Jar\zookeeper-3.4.6.jar"edu.nuc.wordcount2.MPJob2023-04-0208:56:50,055 INFO [main]jvm.JvmMetrics(JvmMetrics.java:init(76))-Initializing JVM MetricswithprocessName=JobTracker, sessionId=2023-04-0208:56:50,324 WARN [main]mapreduce.JobSubmitter(JobSubmitter.java:copyAndConfigureFiles(149))-Hadoop command-line option parsing not performed. Implement the Toolinterface and execute your application withToolRunnertoremedythis.2023-04-0208:56:50,328 WARN [main]mapreduce.JobSubmitter(JobSubmitter.java:copyAndConfigureFiles(258))-No job jar file set. User classes may not be found. SeeJob or Job#setJar(String).2023-04-0208:56:50,334 INFO [main]input.FileInputFormat(FileInputFormat.java:listStatus(287))-Total input paths toprocess:12023-04-0208:56:50,372 INFO [main]mapreduce.JobSubmitter(JobSubmitter.java:submitJobInternal(394))- number of splits:12023-04-0208:56:50,384 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.job.name is deprecated. Instead, use mapreduce.job.name
2023-04-0208:56:50,384 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class2023-04-0208:56:50,384 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2023-04-0208:56:50,385 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class2023-04-0208:56:50,385 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class2023-04-0208:56:50,385 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2023-04-0208:56:50,385 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2023-04-0208:56:50,385 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class2023-04-0208:56:50,386 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2023-04-0208:56:50,386 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class2023-04-0208:56:50,386 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- user.name is deprecated. Instead, use mapreduce.job.user.name
2023-04-0208:56:50,387 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2023-04-0208:56:50,387 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- fs.default.name is deprecated. Instead, use fs.defaultFS
2023-04-0208:56:50,388 INFO [main]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class2023-04-0208:56:50,438 INFO [main]mapreduce.JobSubmitter(JobSubmitter.java:printTokens(477))-Submitting tokens for job: job_local1150550003_0001
2023-04-0208:56:50,473 WARN [main]conf.Configuration(Configuration.java:loadProperty(2172))- file:/tmp/hadoop-Administrator/mapred/staging/local1150550003/.staging/job_local1150550003_0001/job.xml:an attempt tooverridefinal parameter: mapreduce.job.end-notification.max.retry.interval;Ignoring.2023-04-0208:56:50,473 WARN [main]conf.Configuration(Configuration.java:loadProperty(2172))- file:/tmp/hadoop-Administrator/mapred/staging/local1150550003/.staging/job_local1150550003_0001/job.xml:an attempt tooverridefinal parameter: mapreduce.job.end-notification.max.attempts;Ignoring.2023-04-0208:56:50,532 WARN [main]conf.Configuration(Configuration.java:loadProperty(2172))- file:/tmp/hadoop-Administrator/mapred/local/localRunner/local/job_local1150550003_0001/job_local1150550003_0001.xml:an attempt tooverridefinal parameter: mapreduce.job.end-notification.max.retry.interval;Ignoring.2023-04-0208:56:50,533 WARN [main]conf.Configuration(Configuration.java:loadProperty(2172))- file:/tmp/hadoop-Administrator/mapred/local/localRunner/local/job_local1150550003_0001/job_local1150550003_0001.xml:an attempt tooverridefinal parameter: mapreduce.job.end-notification.max.attempts;Ignoring.2023-04-0208:56:50,539 INFO [main]mapreduce.Job(Job.java:submit(1272))-The url totrack the job: http://localhost:8080/2023-04-0208:56:50,540 INFO [main]mapreduce.Job(Job.java:monitorAndPrintJob(1317))-Running job: job_local1150550003_0001
2023-04-0208:56:50,542 INFO [Thread-2]mapred.LocalJobRunner(LocalJobRunner.java:createOutputCommitter(323))-OutputCommitter set in config null2023-04-0208:56:50,546 INFO [Thread-2]mapred.LocalJobRunner(LocalJobRunner.java:createOutputCommitter(341))-OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter2023-04-0208:56:50,568 INFO [Thread-2]mapred.LocalJobRunner(LocalJobRunner.java:run(389))-Waitingfor map tasks
2023-04-0208:56:50,569 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.LocalJobRunner(LocalJobRunner.java:run(216))-Starting task: attempt_local1150550003_0001_m_000000_0
2023-04-0208:56:50,588 INFO [LocalJobRunnerMapTaskExecutor #0]util.ProcfsBasedProcessTree(ProcfsBasedProcessTree.java:isAvailable(181))-ProcfsBasedProcessTree currently is supported only on Linux.2023-04-0208:56:50,612 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.Task(Task.java:initialize(581))-UsingResourceCalculatorProcessTree:org.apache.hadoop.yarn.util.WindowsBasedProcessTree@1657c0942023-04-0208:56:50,616 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:runNewMapper(732))-Processing split: file:/C:/Users/Administrator/Desktop/Code/learn_hadoop/input.txt:0+1092023-04-0208:56:50,625 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:createSortingCollector(387))-Map output collector class=org.apache.hadoop.mapred.MapTask$MapOutputBuffer2023-04-0208:56:50,647 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:setEquator(1183))-(EQUATOR)0 kvi 26214396(104857584)2023-04-0208:56:50,647 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:init(975))- mapreduce.task.io.sort.mb:1002023-04-0208:56:50,647 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:init(976))- soft limit at 838860802023-04-0208:56:50,648 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:init(977))- bufstart =0; bufvoid =1048576002023-04-0208:56:50,648 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:init(978))- kvstart =26214396; length =6553600Map函数正在第1次运行...Map函数正在第1次运行...Map函数正在第1次运行...Map函数正在第1次运行...Map函数正在第1次运行...Map函数正在第1次运行...Map函数正在第1次运行...Map函数正在第1次运行...2023-04-0208:56:50,655 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.LocalJobRunner(LocalJobRunner.java:statusUpdate(513))-2023-04-0208:56:50,655 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:flush(1440))-Starting flush of map output
2023-04-0208:56:50,655 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:flush(1459))-Spilling map output
2023-04-0208:56:50,655 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:flush(1460))- bufstart =0; bufend =231; bufvoid =1048576002023-04-0208:56:50,655 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:flush(1462))- kvstart =26214396(104857584); kvend =26214336(104857344); length =61/65536002023-04-0208:56:50,666 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.MapTask(MapTask.java:sortAndSpill(1648))-Finished spill 02023-04-0208:56:50,671 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.Task(Task.java:done(995))-Task:attempt_local1150550003_0001_m_000000_0 is done. And is in the process of committing
2023-04-0208:56:50,677 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.LocalJobRunner(LocalJobRunner.java:statusUpdate(513))- map
2023-04-0208:56:50,677 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.Task(Task.java:sendDone(1115))-Task 'attempt_local1150550003_0001_m_000000_0' done.2023-04-0208:56:50,677 INFO [LocalJobRunnerMapTaskExecutor #0]mapred.LocalJobRunner(LocalJobRunner.java:run(241))-Finishing task: attempt_local1150550003_0001_m_000000_0
2023-04-0208:56:50,677 INFO [Thread-2]mapred.LocalJobRunner(LocalJobRunner.java:run(397))-Map task executor complete.2023-04-0208:56:50,691 INFO [Thread-2]util.ProcfsBasedProcessTree(ProcfsBasedProcessTree.java:isAvailable(181))-ProcfsBasedProcessTree currently is supported only on Linux.2023-04-0208:56:50,717 INFO [Thread-2]mapred.Task(Task.java:initialize(581))-UsingResourceCalculatorProcessTree:org.apache.hadoop.yarn.util.WindowsBasedProcessTree@d6911902023-04-0208:56:50,722 INFO [Thread-2]mapred.Merger(Merger.java:merge(568))-Merging1 sorted segments
2023-04-0208:56:50,729 INFO [Thread-2]mapred.Merger(Merger.java:merge(667))-Downtothe last merge-pass,with1 segments left of total size:256 bytes
2023-04-0208:56:50,729 INFO [Thread-2]mapred.LocalJobRunner(LocalJobRunner.java:statusUpdate(513))-2023-04-0208:56:50,732 INFO [Thread-2]Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840))- mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords
Reduce函数正在第1次运行...Reduce函数正在第1次运行...Reduce函数正在第1次运行...Reduce函数正在第1次运行...Reduce函数正在第1次运行...2023-04-0208:56:50,738 INFO [Thread-2]mapred.Task(Task.java:done(995))-Task:attempt_local1150550003_0001_r_000000_0 is done. And is in the process of committing
2023-04-0208:56:50,739 INFO [Thread-2]mapred.LocalJobRunner(LocalJobRunner.java:statusUpdate(513))-2023-04-0208:56:50,739 INFO [Thread-2]mapred.Task(Task.java:commit(1156))-Task attempt_local1150550003_0001_r_000000_0 is allowed tocommit now
2023-04-0208:56:50,740 INFO [Thread-2]output.FileOutputCommitter(FileOutputCommitter.java:commitTask(439))-Saved output of task 'attempt_local1150550003_0001_r_000000_0' tofile:/E:/output/output04/_temporary/0/task_local1150550003_0001_r_000000
2023-04-0208:56:50,740 INFO [Thread-2]mapred.LocalJobRunner(LocalJobRunner.java:statusUpdate(513))- reduce > reduce
2023-04-0208:56:50,741 INFO [Thread-2]mapred.Task(Task.java:sendDone(1115))-Task 'attempt_local1150550003_0001_r_000000_0' done.2023-04-0208:56:51,542 INFO [main]mapreduce.Job(Job.java:monitorAndPrintJob(1338))-Job job_local1150550003_0001 running in uber mode :false2023-04-0208:56:51,545 INFO [main]mapreduce.Job(Job.java:monitorAndPrintJob(1345))- map 100% reduce 100%2023-04-0208:56:51,550 INFO [main]mapreduce.Job(Job.java:monitorAndPrintJob(1356))-Job job_local1150550003_0001 completed successfully
2023-04-0208:56:51,573 INFO [main]mapreduce.Job(Job.java:monitorAndPrintJob(1363))-Counters:27FileSystemCounters
FILE:Number of bytes read=853
FILE:Number of bytes written=346467
FILE:Number of read operations=0
FILE:Number of large read operations=0
FILE:Number of write operations=0Map-ReduceFrameworkMap input records=8Map output records=16Map output bytes=231Map output materialized bytes=269Input split bytes=129Combine input records=0Combine output records=0Reduce input groups=5Reduce shuffle bytes=0Reduce input records=16Reduce output records=5SpilledRecords=32ShuffledMaps=0FailedShuffles=0MergedMap outputs=0
GC time elapsed (ms)=0
CPU time spent (ms)=0Physical memory (bytes) snapshot=0Virtual memory (bytes) snapshot=0Total committed heap usage (bytes)=536870912FileInputFormatCountersBytesRead=109FileOutputFormatCountersBytesWritten=57MapReduce正常运行结束。
Process finished withexit code 0
结果"C:\Program Files\Java\jdk1.8.0_60\bin\java.exe" "-javaagent:D:\IntelliJ IDEA Community Edition 2020.2.2\lib\idea_rt.jar=49900:D:\IntelliJ IDEA Community Edition 2020.2.2\bin" -Dfile.encoding=UTF-8 -classpath "C:\Program Files\Java\jdk1.8.0_60\jre\lib\c
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
