Hadoop环境的基准测试----自己电脑搭虚拟机的话就别测了，我电脑的主板差点烧了。

写文件测试

[user@NewBieMaster sbin]$ hadoop jar /home/user/hadoop-3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.2.2-tests.jar TestDFSIO -write -nrFiles 10 -fileSize 8MB
2021-07-03 15:28:52,823 INFO fs.TestDFSIO: TestDFSIO.1.8
2021-07-03 15:28:52,825 INFO fs.TestDFSIO: nrFiles = 10
2021-07-03 15:28:52,825 INFO fs.TestDFSIO: nrBytes (MB) = 8.0
2021-07-03 15:28:52,825 INFO fs.TestDFSIO: bufferSize = 1000000
2021-07-03 15:28:52,825 INFO fs.TestDFSIO: baseDir = /benchmarks/TestDFSIO
2021-07-03 15:28:54,350 INFO fs.TestDFSIO: creating control file: 8388608 bytes, 10 files
2021-07-03 15:28:55,845 INFO fs.TestDFSIO: created control files for: 10 files
2021-07-03 15:28:56,805 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
2021-07-03 15:28:57,528 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/user/.staging/job_1625297306865_0001
2021-07-03 15:28:57,815 INFO mapred.FileInputFormat: Total input files to process : 10
2021-07-03 15:28:57,930 INFO mapreduce.JobSubmitter: number of splits:10
2021-07-03 15:28:58,471 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1625297306865_0001
2021-07-03 15:28:58,472 INFO mapreduce.JobSubmitter: Executing with tokens: []
2021-07-03 15:28:58,913 INFO conf.Configuration: resource-types.xml not found
2021-07-03 15:28:58,913 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2021-07-03 15:28:59,416 INFO impl.YarnClientImpl: Submitted application application_1625297306865_0001
2021-07-03 15:28:59,469 INFO mapreduce.Job: The url to track the job: http://NewBieSlave1:8088/proxy/application_1625297306865_0001/
2021-07-03 15:28:59,471 INFO mapreduce.Job: Running job: job_1625297306865_0001
2021-07-03 15:29:17,520 INFO mapreduce.Job: Job job_1625297306865_0001 running in uber mode : false
2021-07-03 15:29:17,521 INFO mapreduce.Job:  map 0% reduce 0%
2021-07-03 15:29:52,490 INFO mapreduce.Job:  map 30% reduce 0%
2021-07-03 15:29:53,505 INFO mapreduce.Job:  map 40% reduce 0%
2021-07-03 15:30:24,163 INFO mapreduce.Job:  map 53% reduce 13%
2021-07-03 15:30:25,183 INFO mapreduce.Job:  map 73% reduce 13%
2021-07-03 15:30:26,197 INFO mapreduce.Job:  map 97% reduce 13%
2021-07-03 15:30:27,215 INFO mapreduce.Job:  map 100% reduce 13%
2021-07-03 15:30:29,258 INFO mapreduce.Job:  map 100% reduce 100%
2021-07-03 15:30:29,272 INFO mapreduce.Job: Job job_1625297306865_0001 completed successfully
2021-07-03 15:30:29,413 INFO mapreduce.Job: Counters: 54
	File System Counters
		FILE: Number of bytes read=827
		FILE: Number of bytes written=2638353
		FILE: Number of read operations=0
		FILE: Number of large read operations=0
		FILE: Number of write operations=0
		HDFS: Number of bytes read=2240
		HDFS: Number of bytes written=83886154
		HDFS: Number of read operations=45
		HDFS: Number of large read operations=0
		HDFS: Number of write operations=12
		HDFS: Number of bytes read erasure-coded=0
	Job Counters 
		Launched map tasks=10
		Launched reduce tasks=1
		Data-local map tasks=10
		Total time spent by all maps in occupied slots (ms)=521761
		Total time spent by all reduces in occupied slots (ms)=34115
		Total time spent by all map tasks (ms)=521761
		Total time spent by all reduce tasks (ms)=34115
		Total vcore-milliseconds taken by all map tasks=521761
		Total vcore-milliseconds taken by all reduce tasks=34115
		Total megabyte-milliseconds taken by all map tasks=534283264
		Total megabyte-milliseconds taken by all reduce tasks=34933760
	Map-Reduce Framework
		Map input records=10
		Map output records=50
		Map output bytes=721
		Map output materialized bytes=881
		Input split bytes=1120
		Combine input records=0
		Combine output records=0
		Reduce input groups=5
		Reduce shuffle bytes=881
		Reduce input records=50
		Reduce output records=5
		Spilled Records=100
		Shuffled Maps =10
		Failed Shuffles=0
		Merged Map outputs=10
		GC time elapsed (ms)=9914
		CPU time spent (ms)=15330
		Physical memory (bytes) snapshot=2518188032
		Virtual memory (bytes) snapshot=30102917120
		Total committed heap usage (bytes)=2432016384
		Peak Map Physical memory (bytes)=250089472
		Peak Map