项目经验之基准测试
1) 测试HDFS写性能
测试内容:向HDFS集群写14个128M的文件
[xiao @hadoop102 mapreduce]$ hadoop jar /opt/module/hadoop-3.1.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.3-tests.jar TestDFSIO -write -nrFiles 14 -fileSize 128MB
2020-09-02 19:04:08,807 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
2020-09-02 19:04:08,807 INFO fs.TestDFSIO: Date & time: Wed Sep 02 19:04:08 CST 2020
2020-09-02 19:04:08,807 INFO fs.TestDFSIO: Number of files: 14
2020-09-02 19:04:08,807 INFO fs.TestDFSIO: Total MBytes processed: 1792
2020-09-02 19:04:08,807 INFO fs.TestDFSIO: Throughput mb/sec: 9.15
2020-09-02 19:04:08,807 INFO fs.TestDFSIO: Average IO rate mb/sec: 29.19
2020-09-02 19:04:08,807 INFO fs.TestDFSIO: IO rate std deviation: 36.14
2020-09-02 19:04:08,808 INFO fs.TestDFSIO: Test exec time sec: 47.73
2020-09-02 19:04:08,808 INFO fs.TestDFSIO: