test: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=rbd, iodepth=128 fio-3.12 Starting 1 process test: (groupid=0, jobs=1): err= 0: pid=9946: Mon Jan 18 14:50:25 2021 write: IOPS=20.0k, BW=81.9MiB/s (85.9MB/s)(2048MiB/25006msec); 0 zone resets slat (nsec): min=974, max=268076, avg=3661.77, stdev=3043.60 clat (usec): min=670, max=174232, avg=6099.94, stdev=10027.98 lat (usec): min=673, max=174236, avg=6103.60, stdev=10027.99 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 5], 50.00th=[ 6], 60.00th=[ 6], | 70.00th=[ 6], 80.00th=[ 7], 90.00th=[ 7], 95.00th=[ 7], | 99.00th=[ 31], 99.50th=[ 65], 99.90th=[ 153], 99.95th=[ 155], | 99.99th=[ 157] bw ( KiB/s): min=43128, max=108200, per=100.00%, avg=83862.22, stdev=17348.71, samples=50 iops : min=10782, max=27050, avg=20965.54, stdev=4337.17, samples=50 lat (usec) : 750=0.01%, 1000=0.06% lat (msec) : 2=0.39%, 4=8.40%, 10=89.20%, 20=0.40%, 50=0.98% lat (msec) : 100=0.12%, 250=0.45% cpu : usr=13.54%, sys=5.30%, ctx=335263, majf=0, minf=8591 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% issued rwts: total=0,524288,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=128 Run status group 0 (all jobs): WRITE: bw=81.9MiB/s (85.9MB/s), 81.9MiB/s-81.9MiB/s (85.9MB/s-85.9MB/s), io=2048MiB (2147MB), run=25006-25006msec Disk stats (read/write): dm-0: ios=0/69, merge=0/0, ticks=0/4, in_queue=4, util=0.02%, aggrios=0/69, aggrmerge=0/0, aggrticks=0/0, aggrin_queue=0, aggrutil=0.00% md0: ios=0/69, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=2/45, aggrmerge=0/53, aggrticks=0/5, aggrin_queue=4, aggrutil=0.02% sdb: ios=0/45, merge=0/53, ticks=0/6, in_queue=4, util=0.02% sda: ios=4/45, merge=0/53, ticks=0/5, in_queue=4, util=0.02%