PS C:\Users\callum.massey\Downloads> ./fio.exe --thread --filename=fiotmp --verify_pattern=0xdeadbeef --rw=write --verify=pattern --siz e=100m --stonewall --bs=1m --name=layout --do_verify=0 --name=trim --rw=trim --bs=64k --name=verify --verify_only=1 --unlink=1 layout: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=windowsaio, iodepth=1 trim: (g=1): rw=trim, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=windowsaio, iodepth=1 verify: (g=2): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=windowsaio, iodepth=1 fio-3.5-94-g946f9-dirty Starting 3 threads fio: got pattern '9a', wanted 'de'. Bad bits 2,w=100MiB/s,t=100MiB/s][r=0,w=100,t=1603 IOPS][eta 49710d:06h:28m:14s] fio: bad pattern block offset 0 pattern: verify failed at file fiotmp offset 0, length 367477684 fio: verify type mismatch (17832 media, 18 given) verify: No I/O performed by windowsaio, perhaps try --debug=io option for details? fio: pid=17324, err=42/file:io_u.c:2106, func=io_u_queued_complete, error=Illegal byte sequence layout: (groupid=0, jobs=1): err= 0: pid=13864: Thu Apr 5 17:27:30 2018 write: IOPS=2439, BW=2439MiB/s (2558MB/s)(100MiB/41msec) slat (usec): min=252, max=529, avg=333.61, stdev=50.90 clat (usec): min=10, max=148, avg=69.42, stdev=18.02 lat (usec): min=291, max=600, avg=403.03, stdev=57.39 clat percentiles (usec): | 1.00th=[ 11], 5.00th=[ 34], 10.00th=[ 43], 20.00th=[ 68], | 30.00th=[ 71], 40.00th=[ 73], 50.00th=[ 74], 60.00th=[ 76], | 70.00th=[ 77], 80.00th=[ 78], 90.00th=[ 82], 95.00th=[ 84], | 99.00th=[ 95], 99.50th=[ 149], 99.90th=[ 149], 99.95th=[ 149], | 99.99th=[ 149] lat (usec) : 20=3.00%, 50=13.00%, 100=83.00%, 250=1.00% cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,100,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 trim: (groupid=1, jobs=1): err= 0: pid=1420: Thu Apr 5 17:27:30 2018 trim: IOPS=4761, BW=298MiB/s (312MB/s)(100MiB/336msec) slat (usec): min=90, max=5901, avg=189.94, stdev=380.11 clat (nsec): min=432, max=164607, avg=15227.33, stdev=20557.42 lat (usec): min=96, max=5905, avg=205.17, stdev=390.24 clat percentiles (nsec): | 1.00th=[ 884], 5.00th=[ 4256], 10.00th=[ 5856], 20.00th=[ 5920], | 30.00th=[ 5920], 40.00th=[ 5984], 50.00th=[ 6112], 60.00th=[ 8160], | 70.00th=[ 10560], 80.00th=[ 20864], 90.00th=[ 31616], 95.00th=[ 64256], | 99.00th=[109056], 99.50th=[119296], 99.90th=[134144], 99.95th=[164864], | 99.99th=[164864] lat (nsec) : 500=0.13%, 750=0.63%, 1000=0.44% lat (usec) : 2=2.19%, 4=1.50%, 10=61.38%, 20=12.19%, 50=15.13% lat (usec) : 100=4.75%, 250=1.69% cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,0,1600,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 verify: (groupid=2, jobs=1): err=42 (file:io_u.c:2106, func=io_u_queued_complete, error=Illegal byte sequence): pid=17324: Thu Apr 5 17:27:30 2018 read: IOPS=50, BW=50.0MiB/s (52.4MB/s)(1024KiB/20msec) slat (nsec): min=365838, max=365838, avg=365838.00, stdev= 0.00 clat (nsec): min=93771, max=93771, avg=93771.00, stdev= 0.00 lat (nsec): min=459609, max=459609, avg=459609.00, stdev= 0.00 clat percentiles (nsec): | 1.00th=[93696], 5.00th=[93696], 10.00th=[93696], 20.00th=[93696], | 30.00th=[93696], 40.00th=[93696], 50.00th=[93696], 60.00th=[93696], | 70.00th=[93696], 80.00th=[93696], 90.00th=[93696], 95.00th=[93696], | 99.00th=[93696], 99.50th=[93696], 99.90th=[93696], 99.95th=[93696], | 99.99th=[93696] lat (usec) : 100=0.99% cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=33.3%, 4=66.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,100,0,0 short=0,0,0,0 dropped=0,0,0,0 Run status group 0 (all jobs): WRITE: bw=2439MiB/s (2558MB/s), 2439MiB/s-2439MiB/s (2558MB/s-2558MB/s), io=100MiB (105MB), run=41-41msec Run status group 1 (all jobs): READ: bw=0B/s (0B/s), 0B/s-0B/s (0B/s-0B/s), io=0B (0B), run=1-1msec TRIM: bw=298MiB/s (312MB/s), 298MiB/s-298MiB/s (312MB/s-312MB/s), io=100MiB (105MB), run=336-336msec Run status group 2 (all jobs): READ: bw=50.0MiB/s (52.4MB/s), 50.0MiB/s-50.0MiB/s (52.4MB/s-52.4MB/s), io=1024KiB (1049kB), run=20-20msec PS C:\Users\callum.massey\Downloads>