测试时的逻辑卷的大小
root:~# lvs
LV VG Attr LSize Origin Snap% Move Log Copy% Convert type alias
nas dg5 -wi-a- 6.50T (null) (null)
reiser dg5 -wi-a- 6.50T (null) (null)
(1) 格式化和挂载时间的比较
1)格式化的时间
root:~# time mkfs.xfs /dev/mapper/dg5-nas
meta-data=/dev/mapper/dg5-nas isize=256 agcount=7, agsize=268435455 blks
= sectsz=512 attr=2
data = bsize=4096 blocks=1744830464, imaxpct=5
= sunit=0 swidth=0 blks
naming =version 2 bsize=4096
log =internal log bsize=4096 blocks=32768, version=2
= sectsz=512 sunit=0 blks, lazy-count=0
realtime =none extsz=4096 blocks=0, rtextents=0
real 0m17.426s
user 0m0.000s
sys 0m0.100s
root:~# time mkfs.reiser4 -f /dev/mapper/dg5-reiser
mkfs.reiser4 1.0.7
Copyright (C) 2001-2005 by Hans Reiser, licensing governed by reiser4progs/COPYING.
Block size 4096 will be used.
Linux 2.6.26.2-ustor20101210 is detected.
Uuid 1d1bf744-a1b7-4d43-b806-f3d81aa85744 will be used.
Reiser4 is going to be created on /dev/mapper/dg5-reiser.
(Yes/No): yes
Creating reiser4 on /dev/mapper/dg5-reiser ... done
real 1m56.882s
user 0m0.230s
sys 0m0.700s
2)挂载时间比较
root:~# mkdir /share/nas
root:~# mkdir /share/reiser
root:~# time mount /dev/mapper/dg5-nas /share/nas
real 0m0.276s
user 0m0.000s
sys 0m0.000s
root:~# time mount /dev/mapper/dg5-reiser /share/reiser/
real 5m38.450s
user 0m0.000s
sys 0m0.880s
3)有数据的时候xfs和reiser4的挂载时间比较
root:/etc/lvm/backup# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/hda1 600M 220M 381M 37% /
shm 1.9G 0 1.9G 0% /dev/shm
/dev/mapper/dg5-nas 6.5T 2.9T 3.7T 44% /share/nas
/dev/mapper/dg5-reiser 6.2T 2.9T 3.4T 46% /share/reiser
xfs 情况
root:/etc/lvm/backup# time mount /dev/mapper/dg5-nas /share/nas
real 0m0.486s
user 0m0.000s
sys 0m0.000s
reiser4的情况
root:/etc/lvm/backup# time mount /dev/mapper/dg5-reiser /share/reiser/
real 41m43.744s
user 0m0.010s
sys 0m1.490s
(2) find的时间比较
find 大量的小文件(30M)
root:/share/reiser# ls -l |wc -l
200101
reiser4的情况
root:/share/reiser# time find
real 0m6.496s
user 0m0.190s
sys 0m1.590s
xfs的情况
root:/share/nas# time find
real 0m7.497s
user 0m0.070s
sys 0m0.320s
(3) dd 20G的文件时的比较
1)dd写的比较
Every 2.0s: free -m Thu Dec 8 12:10:42 2011
total used free shared buffers cached
Mem: 3874 1486 2388 0 0 62033
-/+ buffers/cache: 853 3021
Swap: 0 0 0
reiser4的情况
root:/share# dd if=/dev/zero of=/share/reiser/test.txt bs=1M count=20000
20000+0 records in
20000+0 records out
20971520000 bytes (21 GB) copied, 38.3763 s, 546 MB/s
xfs的情况
Every 2.0s: free -m Thu Dec 8 12:16:09 2011
total used free shared buffers cached
Mem: 3874 1487 2387 0 0 633
-/+ buffers/cache: 853 3021
Swap: 0 0 0
root:/share# dd if=/dev/zero of=/share/nas/test.txt bs=1M count=20000
20000+0 records in
20000+0 records out
20971520000 bytes (21 GB) copied, 28.5043 s, 736 MB/s
2)dd读的比较
reiser4的情况
Every 2.0s: free -m Thu Dec 8 12:22:26 2011
total used free shared buffers cached
Mem: 3874 1628 2246 0 0 730
-/+ buffers/cache: 898 2976
Swap: 0 0 0
root:/share# dd if=/share/reiser/test.txt of=/dev/null bs=1M count=20000
20000+0 records in
20000+0 records out
20971520000 bytes (21 GB) copied, 84.5928 s, 248 MB/s
Every 2.0s: free -m Thu Dec 8 12:23:14 2011
total used free shared buffers cached
Mem: 3874 3822 51 0 0 2808
-/+ buffers/cache: 1014 2860
Swap: 0 0 0
xfs的情况
Every 2.0s: free -m Thu Dec 8 12:26:38 2011
total used free shared buffers cached
Mem: 3874 1487 2387 0 0 633
-/+ buffers/cache: 854 3020
Swap: 0 0 0
root:/share# dd if=/share/nas/test.txt of=/dev/null bs=1M count=20000
20000+0 records in
20000+0 records out
20971520000 bytes (21 GB) copied, 102.429 s, 205 MB/s
Every 2.0s: free -m Thu Dec 8 12:28:39 2011
total used free shared buffers cached
Mem: 3874 3829 45 0 0 2970
-/+ buffers/cache: 858 3016
Swap: 0 0 0
(4) tiobench并发
1)每个文件的大小为30M
reiser4的情况
Every 2.0s: free -m (测量前的内存情况) Thu Dec 8 12:35:47 2011
total used free shared buffers cached
Mem: 3874 1487 2387 0 0 633
-/+ buffers/cache: 853 3021
Swap: 0 0 0
root:/share# tiotest -f 30 -t 200 -k 1 -k 3 -d /share/reiser/
Tiotest results for 200 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 6000 MBs | 29.1 s | 206.307 MB/s | 1744.1 % | 24067.9 % |
| Read 6000 MBs | 39.2 s | 153.074 MB/s | 1124.8 % | 6403.0 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 2.280 ms | 12275.666 ms | 0.00378 | 0.00378 |
| Read | 4.918 ms | 1329.376 ms | 0.00000 | 0.00000 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 3.599 ms | 12275.666 ms | 0.00189 | 0.00189 |
`--------------+-----------------+-----------------+----------+-----------'
xfs的情况
Every 2.0s: free -m Thu Dec 8 12:40:34 2011
total used free shared buffers cached
Mem: 3874 1486 2388 0 0 633
-/+ buffers/cache: 852 3022
Swap: 0 0 0
root:/share# tiotest -f 30 -t 200 -k 1 -k 3 -d /share/nas/
Tiotest results for 200 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 6000 MBs | 18.4 s | 325.393 MB/s | 1973.5 % | 39054.3 % |
| Read 6000 MBs | 46.2 s | 129.976 MB/s | 1087.4 % | 2759.9 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 1.650 ms | 8207.561 ms | 0.01406 | 0.00000 |
| Read | 5.606 ms | 2774.305 ms | 0.00495 | 0.00000 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 3.628 ms | 8207.561 ms | 0.00951 | 0.00000 |
`--------------+-----------------+-----------------+----------+-----------'
Every 2.0s: free -m (测量过程中的内存情况) Thu Dec 8 12:42:02 2011
total used free shared buffers cached
Mem: 3874 3811 63 0 0 2876
-/+ buffers/cache: 934 2940
Swap: 0 0 0
2)每个文件的大小为300M
reiser4的情况
root:/share/reiser# tiotest -f 300 -t 200 -k 3 -k 1 -k 2 -d /share/reiser/
Tiotest results for 200 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 60000 MBs | 261.4 s | 229.517 MB/s | 1818.2 % | 25977.3 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 3.005 ms | 11358.571 ms | 0.01136 | 0.01136 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 3.005 ms | 11358.571 ms | 0.01136 | 0.01136 |
`--------------+-----------------+-----------------+----------+-----------'
xfs的情况
root:/share/nas# tiotest -f 300 -t 200 -k 3 -k 1 -k 2 -d /share/nas
Tiotest results for 200 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 60000 MBs | 199.1 s | 301.374 MB/s | 1992.0 % | 51622.6 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 2.386 ms | 12467.333 ms | 0.03742 | 0.00005 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 2.386 ms | 12467.333 ms | 0.03742 | 0.00005 |
`--------------+-----------------+-----------------+----------+-----------'
(5) postmark
reiser4的情况
root:/share# postmark
PostMark v1.51 : 8/14/01
pm>set size 1000 1000000
pm>set number 50000
pm>set transactions 2000
pm>set location /share/reiser
pm>run
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Time:
130 seconds total
50 seconds of transactions (40 per second)
Files:
50958 created (391 per second)
Creation alone: 50000 files (694 per second)
Mixed with transactions: 958 files (19 per second)
983 read (19 per second)
1017 appended (20 per second)
50958 deleted (391 per second)
Deletion alone: 49916 files (6239 per second)
Mixed with transactions: 1042 files (20 per second)
Data:
463.69 megabytes read (3.57 megabytes per second)
24575.96 megabytes written (189.05 megabytes per second)
xfs的情况
root:/share# postmark
PostMark v1.51 : 8/14/01
pm>set size 1000 1000000
pm>set number 50000
pm>set transactions 2000
pm>set location /share/nas
pm>run
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Time:
314 seconds total
64 seconds of transactions (31 per second)
Files:
50958 created (162 per second)
Creation alone: 50000 files (221 per second)
Mixed with transactions: 958 files (14 per second)
983 read (15 per second)
1017 appended (15 per second)
50958 deleted (162 per second)
Deletion alone: 49916 files (2079 per second)
Mixed with transactions: 1042 files (16 per second)
Data:
463.69 megabytes read (1.48 megabytes per second)
24575.96 megabytes written (78.27 megabytes per second)
(6)iozone 测试读写
reiser4的情况
root:/share/reiser# iozone -a -i 0 -i 1 -i 5 -s 20G -y 4k
Iozone: Performance Test of File I/O
Version $Revision: 3.397 $
Compiled for 64 bit mode.
Build: linux-ia64
Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
Al Slater, Scott Rhine, Mike Wisner, Ken Goss
Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer.
Ben England.
Run began: Thu Dec 8 17:39:23 2011
Auto Mode
File size set to 20971520 KB
Using Minimum Record Size 4 KB
Command line used: iozone -a -i 0 -i 1 -i 5 -s 20G -y 4k
Output is in Kbytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 Kbytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
KB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
20971520 4 473543 457143 229089 228682 14494
20971520 8 501323 471324 230214 231767 22067
20971520 16 527728 509111 232039 233732 24775
20971520 32 551484 532430 230058 235236 29610
xfs的情况
root:/share/nas# iozone -a -i 0 -i 1 -i 5 -s 20G -y 4k -q 4M
Iozone: Performance Test of File I/O
Version $Revision: 3.397 $
Compiled for 64 bit mode.
Build: linux-ia64
Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
Al Slater, Scott Rhine, Mike Wisner, Ken Goss
Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer.
Ben England.
Run began: Thu Dec 8 15:32:18 2011
Auto Mode
File size set to 20971520 KB
Using Minimum Record Size 4 KB
Using Maximum Record Size 4096 KB
Command line used: iozone -a -i 0 -i 1 -i 5 -s 20G -y 4k -q 4M
Output is in Kbytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 Kbytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
KB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
20971520 4 625827 871186 271047 259215 14651
20971520 8 681181 904482 244558 262275 22793
20971520 16 680605 902826 248678 254096 26715
20971520 32 734427 878892 266319 271171 32440
20971520 64 787616 918896 79562 84482 19915
20971520 128 774020 926343 250241 255764 25539
(7) 删除大量的文件的比较
10166个文件
root:/share/reiser# time rm -rf *
real 0m1.614s
user 0m0.010s
sys 0m0.440s
root:/share/nas# time rm -rf *
real 0m11.095s
user 0m0.010s
sys 0m0.370s
删除10万个文件(每个文件的大小为30M)
root:/share/reiser# ls -l |wc -l
100501
root:/share/reiser# time rm -rf *
real 0m17.372s
user 0m0.100s
sys 0m5.980s
root:/share/nas# ls -l |wc -l
100301
root:/share/nas# time rm -rf *
real 0m40.507s
user 0m0.130s
sys 0m7.200s
(8) 随机写的比较
root:/share/nas# tiotest -f 300 -t 100 -k 2
Tiotest results for 100 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 30000 MBs | 83.0 s | 361.332 MB/s | 1194.0 % | 17742.1 % |
| Random Write 391 MBs | 87.7 s | 4.457 MB/s | 7.1 % | 1126.3 % |
| Random Read 391 MBs | 43.7 s | 8.939 MB/s | 104.7 % | 807.6 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 0.955 ms | 8405.187 ms | 0.00512 | 0.00000 |
| Random Write | 0.984 ms | 15196.954 ms | 0.01100 | 0.00500 |
| Random Read | 40.665 ms | 712.321 ms | 0.00000 | 0.00000 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 1.459 ms | 15196.954 ms | 0.00513 | 0.00006 |
`--------------+-----------------+-----------------+----------+-----------'
root:/share/reiser# tiotest -f 300 -t 100 -k 2
Tiotest results for 100 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 30000 MBs | 122.1 s | 245.609 MB/s | 1036.0 % | 12899.0 % |
| Random Write 391 MBs | 143.9 s | 2.715 MB/s | 12.5 % | 1312.9 % |
| Random Read 391 MBs | 41.1 s | 9.500 MB/s | 38.7 % | 1002.9 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 1.350 ms | 8604.727 ms | 0.00572 | 0.00000 |
| Random Write | 0.797 ms | 183.879 ms | 0.00000 | 0.00000 |
| Random Read | 38.792 ms | 814.166 ms | 0.00000 | 0.00000 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 1.818 ms | 8604.727 ms | 0.00557 | 0.00000 |
`--------------+-----------------+-----------------+----------+-----------'
(9)边读写边删除10万个文件时
1)边读写边删除
root:/share/reiser# tiotest -f 300 -t 200 -k 1 -k 3 -d /share/reiser/
Tiotest results for 200 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 60000 MBs | 259.3 s | 231.419 MB/s | 1853.7 % | 23482.9 % |
| Read 60000 MBs | 545.1 s | 110.064 MB/s | 843.5 % | 5763.1 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 2.824 ms | 13102.554 ms | 0.01077 | 0.01071 |
| Read | 6.812 ms | 19940.071 ms | 0.00032 | 0.00031 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 4.818 ms | 19940.071 ms | 0.00555 | 0.00551 |
`--------------+-----------------+-----------------+----------+-----------'
root:/share/nas# tiotest -f 300 -t 200 -k 1 -k 3 -d /share/nas/
Tiotest results for 200 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 60000 MBs | 240.3 s | 249.725 MB/s | 1652.2 % | 43544.3 % |
| Read 60000 MBs | 526.0 s | 114.066 MB/s | 1072.8 % | 2421.7 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 2.660 ms | 33654.917 ms | 0.04019 | 0.00064 |
| Read | 6.732 ms | 9865.145 ms | 0.00404 | 0.00000 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 4.696 ms | 33654.917 ms | 0.02212 | 0.00032 |
`--------------+-----------------+-----------------+----------+-----------'
2)只读写不删除
xfs的情况
root:/share# tiotest -f 300 -t 200 -k 1 -k 3 -d /share/nas/
Tiotest results for 200 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 60000 MBs | 207.5 s | 289.135 MB/s | 2004.1 % | 50681.3 % |
| Read 60000 MBs | 520.9 s | 115.182 MB/s | 1109.6 % | 2498.5 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 2.492 ms | 12982.828 ms | 0.03962 | 0.00014 |
| Read | 6.705 ms | 6295.195 ms | 0.00636 | 0.00000 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 4.599 ms | 12982.828 ms | 0.02299 | 0.00007 |
`--------------+-----------------+-----------------+----------+-----------'
reiser4的情况
root:/share# tiotest -f 300 -t 200 -k 1 -k 3 -d /share/reiser/
Tiotest results for 200 concurrent io threads:
,----------------------------------------------------------------------.
| Item | Time | Rate | Usr CPU | Sys CPU |
+-----------------------+----------+--------------+----------+---------+
| Write 60000 MBs | 244.4 s | 245.512 MB/s | 1934.4 % | 26734.0 % |
| Read 60000 MBs | 459.5 s | 130.567 MB/s | 966.9 % | 6982.6 % |
`----------------------------------------------------------------------'
Tiotest latency results:
,-------------------------------------------------------------------------.
| Item | Average latency | Maximum latency | % >2 sec | % >10 sec |
+--------------+-----------------+-----------------+----------+-----------+
| Write | 2.835 ms | 11763.554 ms | 0.01140 | 0.00644 |
| Read | 5.930 ms | 1730.577 ms | 0.00000 | 0.00000 |
|--------------+-----------------+-----------------+----------+-----------|
| Total | 4.383 ms | 11763.554 ms | 0.00570 | 0.00322 |
`--------------+-----------------+-----------------+----------+-----------'