test: (g=0): rw=write, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=rbd, iodepth=16 fio-3.12 Starting 1 process test: (groupid=0, jobs=1): err= 0: pid=8708: Mon Jan 18 14:40:18 2021 write: IOPS=35, BW=142MiB/s (149MB/s)(2048MiB/14375msec); 0 zone resets slat (usec): min=571, max=1944, avg=809.61, stdev=245.42 clat (msec): min=87, max=1317, avg=447.48, stdev=186.65 lat (msec): min=88, max=1318, avg=448.29, stdev=186.64 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 205], 10.00th=[ 239], 20.00th=[ 284], | 30.00th=[ 334], 40.00th=[ 376], 50.00th=[ 422], 60.00th=[ 472], | 70.00th=[ 514], 80.00th=[ 592], 90.00th=[ 701], 95.00th=[ 785], | 99.00th=[ 1062], 99.50th=[ 1083], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min=81920, max=196608, per=99.26%, avg=144810.57, stdev=24313.15, samples=28 iops : min= 20, max= 48, avg=35.32, stdev= 5.90, samples=28 lat (msec) : 100=0.39%, 250=12.30%, 500=53.52%, 750=26.95%, 1000=5.27% cpu : usr=2.55%, sys=0.42%, ctx=474, majf=0, minf=25173 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=97.1%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,512,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): WRITE: bw=142MiB/s (149MB/s), 142MiB/s-142MiB/s (149MB/s-149MB/s), io=2048MiB (2147MB), run=14375-14375msec Disk stats (read/write): dm-0: ios=0/37, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/37, aggrmerge=0/0, aggrticks=0/0, aggrin_queue=0, aggrutil=0.00% md0: ios=0/37, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/25, aggrmerge=0/29, aggrticks=0/3, aggrin_queue=0, aggrutil=0.00% sdb: ios=0/25, merge=0/29, ticks=0/3, in_queue=0, util=0.00% sda: ios=0/25, merge=0/29, ticks=0/3, in_queue=0, util=0.00%