PS C:\Users\callum.massey\Downloads> ./fio.exe --thread --filename=fiotmp --verify_pattern=0xdeadbeef --rw=write --verify=pattern --size=100m --stonewall --bs=1m --name=layout --do_verify=0 --name=trim --rw=trim --bs=64k --name=verify --verify_only=1 layout: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=windowsaio, iodepth=1 trim: (g=1): rw=trim, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=windowsaio, iodepth=1 verify: (g=2): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=windowsaio, iodepth=1 fio-3.5-94-g946f9-dirty Starting 3 threads layout: Laying out IO file (1 file / 100MiB) trim: Laying out IO file (1 file / 100MiB) verify: Laying out IO file (1 file / 100MiB) fio: got pattern '9a', wanted 'de'. Bad bits 2,w=101MiB/s,t=97.5MiB/s][r=0,w=100,t=1559 IOPS][eta 49710d:06h:28m:14s] fio: bad pattern block offset 0 pattern: verify failed at file fiotmp offset 0, length 367477684 fio: verify type mismatch (17832 media, 18 given) verify: No I/O performed by windowsaio, perhaps try --debug=io option for details? fio: pid=12772, err=42/file:io_u.c:2106, func=io_u_queued_complete, error=Illegal byte sequence layout: (groupid=0, jobs=1): err= 0: pid=3184: Thu Apr 5 17:22:50 2018 write: IOPS=1449, BW=1449MiB/s (1520MB/s)(100MiB/69msec) slat (usec): min=272, max=3868, avg=602.46, stdev=388.88 clat (usec): min=2, max=150, avg=75.24, stdev=27.67 lat (usec): min=304, max=3987, avg=677.71, stdev=399.89 clat percentiles (usec): | 1.00th=[ 3], 5.00th=[ 17], 10.00th=[ 43], 20.00th=[ 49], | 30.00th=[ 69], 40.00th=[ 75], 50.00th=[ 78], 60.00th=[ 82], | 70.00th=[ 85], 80.00th=[ 94], 90.00th=[ 110], 95.00th=[ 115], | 99.00th=[ 129], 99.50th=[ 151], 99.90th=[ 151], 99.95th=[ 151], | 99.99th=[ 151] lat (usec) : 4=1.00%, 10=2.00%, 20=2.00%, 50=15.00%, 100=62.00% lat (usec) : 250=18.00% cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,100,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 trim: (groupid=1, jobs=1): err= 0: pid=9564: Thu Apr 5 17:22:50 2018 trim: IOPS=5387, BW=337MiB/s (353MB/s)(100MiB/297msec) slat (usec): min=14, max=4533, avg=156.94, stdev=174.49 clat (nsec): min=546, max=1500.6k, avg=17141.39, stdev=43963.27 lat (usec): min=93, max=4587, avg=174.08, stdev=187.90 clat percentiles (nsec): | 1.00th=[ 692], 5.00th=[ 2256], 10.00th=[ 5856], | 20.00th=[ 5920], 30.00th=[ 5984], 40.00th=[ 6112], | 50.00th=[ 6432], 60.00th=[ 11968], 70.00th=[ 16512], | 80.00th=[ 20352], 90.00th=[ 32128], 95.00th=[ 67072], | 99.00th=[ 112128], 99.50th=[ 119296], 99.90th=[ 387072], | 99.95th=[1499136], 99.99th=[1499136] lat (nsec) : 750=1.06%, 1000=0.06% lat (usec) : 2=1.94%, 4=3.38%, 10=52.69%, 20=20.13%, 50=14.13% lat (usec) : 100=4.38%, 250=2.13%, 500=0.06% lat (msec) : 2=0.06% cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,0,1600,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 verify: (groupid=2, jobs=1): err=42 (file:io_u.c:2106, func=io_u_queued_complete, error=Illegal byte sequence): pid=12772: Thu Apr 5 17:22:50 2018 read: IOPS=250, BW=250MiB/s (262MB/s)(1024KiB/4msec) slat (nsec): min=339080, max=339080, avg=339080.00, stdev= 0.00 clat (nsec): min=111861, max=111861, avg=111861.00, stdev= 0.00 lat (nsec): min=450941, max=450941, avg=450941.00, stdev= 0.00 clat percentiles (usec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 113], 60.00th=[ 113], | 70.00th=[ 113], 80.00th=[ 113], 90.00th=[ 113], 95.00th=[ 113], | 99.00th=[ 113], 99.50th=[ 113], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] lat (usec) : 250=0.99% cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=33.3%, 4=66.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,100,0,0 short=0,0,0,0 dropped=0,0,0,0 Run status group 0 (all jobs): WRITE: bw=1449MiB/s (1520MB/s), 1449MiB/s-1449MiB/s (1520MB/s-1520MB/s), io=100MiB (105MB), run=69-69msec Run status group 1 (all jobs): READ: bw=0B/s (0B/s), 0B/s-0B/s (0B/s-0B/s), io=0B (0B), run=1-1msec TRIM: bw=337MiB/s (353MB/s), 337MiB/s-337MiB/s (353MB/s-353MB/s), io=100MiB (105MB), run=297-297msec Run status group 2 (all jobs): READ: bw=250MiB/s (262MB/s), 250MiB/s-250MiB/s (262MB/s-262MB/s), io=1024KiB (1049kB), run=4-4msec