disk RAID performance

iops 和throughput
iops 是randrw
throughput 是seqrw

实际场景是读写混合，所以以读写混合的fio命令来测试
sata盘的iops 比较弱（注意如果用seqrw的读写模式去测，数据会高不少）

---

iops的输出解析

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           7.01    0.00    1.06    0.00    0.00   91.92

r/s 和w/s 即为读和写的iops

Device:         rrqm/s   wrqm/s     r/s     w/s    rMB/s    wMB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00    23.00    0.00    8.50     0.00     0.15    37.18     0.00    0.00    0.00    0.00   0.00   0.00
sdb               0.00     0.00  462.50  451.50     1.81     1.76     8.00   127.99  138.95  180.67   96.22   1.09 100.00
sdc               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
sdd               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
sde               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00

单盘性能

sas，sata，fc类型单盘性能比较
http://wintelguy.com/2013/201...

raid 性能

5盘raid5

iops

root@SEG-01:/data/osd.0# fio --name=seqwrite --filename=fio.txt  -rw=randrw --rwmixread=50 --bs=4K --size=20G --runtime=120 --ioengine=libaio  --iodepth=128 --numjobs=1 --direct=1 --group_reporting
seqwrite: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=128
Starting 1 process
Jobs: 1 (f=1): [m] [2.1% done] [1462K/1495K /s] [357/365 iops] [eta 01h:32m:16s]
seqwrite: (groupid=0, jobs=1): err= 0: pid=334070
  read : io=224444KB, bw=1856KB/s, iops=464, runt=120904msec
    slat (usec): min=3, max=23101, avg=13.58, stdev=123.96
    clat (usec): min=46, max=3042K, avg=181455.83, stdev=209512.95
    bw (KB/s) : min=    0, max= 5101, per=77.87%, avg=1445.34, stdev=1082.05
  write: io=224556KB, bw=1857KB/s, iops=464, runt=120904msec
    slat (usec): min=4, max=2413K, avg=230.95, stdev=18741.08
    clat (usec): min=31, max=2938K, avg=93941.29, stdev=136416.60
    bw (KB/s) : min=    0, max= 5824, per=90.06%, avg=1672.33, stdev=1017.45
  cpu          : usr=0.48%, sys=2.12%, ctx=101477, majf=0, minf=2092
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
     issued r/w: total=56111/56139, short=0/0
     lat (usec): 50=5.58%, 100=2.20%, 250=0.06%, 500=0.11%, 750=0.21%
     lat (usec): 1000=0.12%
     lat (msec): 2=0.11%, 4=0.28%, 10=0.39%, 20=0.74%, 50=3.93%
     lat (msec): 100=27.78%, 250=49.86%, 500=6.63%, 750=1.00%, 1000=0.37%
     lat (msec): 2000=0.30%, >=2000=0.34%

Run status group 0 (all jobs):
   READ: io=224444KB, aggrb=1856KB/s, minb=1900KB/s, maxb=1900KB/s, mint=120904msec, maxt=120904msec
  WRITE: io=224556KB, aggrb=1857KB/s, minb=1901KB/s, maxb=1901KB/s, mint=120904msec, maxt=120904msec

Disk stats (read/write):
  sdb: ios=56213/56364, merge=0/144, ticks=9412060/4768560, in_queue=14183068, util=99.97%

9盘raid5