fio····

fio -filename=/dev/sdb  -rw=randrw -bs=4k -numjobs=2 -name=haha
haha: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.19
Starting 2 processes
Jobs: 1 (f=1): [f(1),_(1)][100.0%][eta 00m:00s]                                             
haha: (groupid=0, jobs=1): err= 0: pid=4476: Thu May  9 09:56:15 2024
  read: IOPS=1138, BW=4556KiB/s (4665kB/s)(2561MiB/575714msec)
    clat (nsec): min=944, max=1871.7M, avg=133462.79, stdev=2545256.32
     lat (nsec): min=969, max=1871.7M, avg=133545.02, stdev=2545257.74
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   42], 10.00th=[   42], 20.00th=[   43],
     | 30.00th=[   45], 40.00th=[   46], 50.00th=[   48], 60.00th=[   51],
     | 70.00th=[   57], 80.00th=[   88], 90.00th=[  121], 95.00th=[  186],
     | 99.00th=[  562], 99.50th=[ 5145], 99.90th=[11207], 99.95th=[15795],
     | 99.99th=[38536]
   bw (  KiB/s): min=   55, max=23936, per=50.23%, avg=4573.26, stdev=3986.05, samples=1139
   iops        : min=   13, max= 5984, avg=1143.03, stdev=996.53, samples=1139
  write: IOPS=1137, BW=4551KiB/s (4660kB/s)(2559MiB/575714msec); 0 zone resets
    clat (nsec): min=1149, max=685921k, avg=743254.00, stdev=6246120.81
     lat (nsec): min=1177, max=685922k, avg=743350.79, stdev=6246120.48
    clat percentiles (nsec):
     |  1.00th=[     1496],  5.00th=[     1640], 10.00th=[     1752],
     | 20.00th=[     1992], 30.00th=[     2256], 40.00th=[     2768],
     | 50.00th=[     3856], 60.00th=[     4128], 70.00th=[     4448],
     | 80.00th=[     4768], 90.00th=[     5728], 95.00th=[     8256],
     | 99.00th=[ 36438016], 99.50th=[ 42205184], 99.90th=[ 60030976],
     | 99.95th=[ 78118912], 99.99th=[206569472]
   bw (  KiB/s): min=   74, max=22874, per=50.17%, avg=4569.14, stdev=3976.68, samples=1139
   iops        : min=   18, max= 5718, avg=1142.00, stdev=994.19, samples=1139
  lat (nsec)   : 1000=0.01%
  lat (usec)   : 2=10.30%, 4=17.28%, 10=20.68%, 20=0.85%, 50=28.99%
  lat (usec)   : 100=13.93%, 250=5.51%, 500=0.92%, 750=0.16%, 1000=0.04%
  lat (msec)   : 2=0.05%, 4=0.05%, 10=0.17%, 20=0.20%, 50=0.76%
  lat (msec)   : 100=0.09%, 250=0.02%, 500=0.01%, 750=0.01%, 2000=0.01%
  cpu          : usr=0.05%, sys=5.36%, ctx=302043, majf=0, minf=23
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=655676,655044,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
haha: (groupid=0, jobs=1): err= 0: pid=4477: Thu May  9 09:56:15 2024
  read: IOPS=1142, BW=4569KiB/s (4678kB/s)(2558MiB/573321msec)
    clat (nsec): min=1130, max=1905.0M, avg=138805.35, stdev=2687215.66
     lat (nsec): min=1153, max=1905.0M, avg=138887.58, stdev=2687216.23
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   42], 10.00th=[   42], 20.00th=[   43],
     | 30.00th=[   45], 40.00th=[   46], 50.00th=[   48], 60.00th=[   51],
     | 70.00th=[   57], 80.00th=[   89], 90.00th=[  124], 95.00th=[  188],
     | 99.00th=[  586], 99.50th=[ 5604], 99.90th=[11338], 99.95th=[17171],
     | 99.99th=[39060]
   bw (  KiB/s): min=   46, max=23744, per=50.43%, avg=4591.57, stdev=3996.72, samples=1133
   iops        : min=   11, max= 5936, avg=1147.60, stdev=999.20, samples=1133
  write: IOPS=1144, BW=4576KiB/s (4686kB/s)(2562MiB/573321msec); 0 zone resets
    clat (nsec): min=1117, max=829858k, avg=733466.25, stdev=6179949.39
     lat (nsec): min=1158, max=829858k, avg=733564.33, stdev=6179948.29
    clat percentiles (nsec):
     |  1.00th=[     1512],  5.00th=[     1640], 10.00th=[     1752],
     | 20.00th=[     1992], 30.00th=[     2256], 40.00th=[     2768],
     | 50.00th=[     3856], 60.00th=[     4128], 70.00th=[     4448],
     | 80.00th=[     4768], 90.00th=[     5728], 95.00th=[     8384],
     | 99.00th=[ 36438016], 99.50th=[ 42205184], 99.90th=[ 58982400],
     | 99.95th=[ 76021760], 99.99th=[206569472]
   bw (  KiB/s): min=   54, max=24327, per=50.50%, avg=4599.10, stdev=4012.63, samples=1133
   iops        : min=   13, max= 6081, avg=1149.48, stdev=1003.17, samples=1133
  lat (usec)   : 2=10.33%, 4=17.20%, 10=20.75%, 20=0.88%, 50=28.95%
  lat (usec)   : 100=13.79%, 250=5.63%, 500=0.92%, 750=0.17%, 1000=0.04%
  lat (msec)   : 2=0.05%, 4=0.04%, 10=0.18%, 20=0.20%, 50=0.76%
  lat (msec)   : 100=0.09%, 250=0.02%, 500=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2000=0.01%
  cpu          : usr=0.04%, sys=5.19%, ctx=305378, majf=2, minf=22
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=654814,655906,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
   READ: bw=9105KiB/s (9324kB/s), 4556KiB/s-4569KiB/s (4665kB/s-4678kB/s), io=5119MiB (5368MB), run=573321-575714msec
  WRITE: bw=9108KiB/s (9327kB/s), 4551KiB/s-4576KiB/s (4660kB/s-4686kB/s), io=5121MiB (5370MB), run=573321-575714msec

Disk stats (read/write):
  sdb: ios=1302824/1262341, merge=0/37706, ticks=63516/11857334, in_queue=11920849, util=41.97%