C:\Users\callu\Downloads> ./fio.exe --thread --filename=fiotmp --verify_pattern=0xdeadbeef --rw=write --verify=pattern --size=100m --stonewall --bs=1m --name=layout --do_verify=0 --name=trim --rw=trim --bs=4k --name=verify --verify_only=1 --unlink=1
layout: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=windowsaio, iodepth=1
trim: (g=1): rw=trim, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=windowsaio, iodepth=1
verify: (g=2): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=windowsaio, iodepth=1
fio-3.5-94-g946f9-dirty
Starting 3 threads
GetLastError=326
fio: io_u error on file fiotmp: Inappropriate I/O control operation: trim offset=0, buflen=4096
trim: No I/O performed by windowsaio, perhaps try --debug=io option for details?
fio: pid=3684, err=25/file:io_u.c:1823, func=io_u error, error=Inappropriate I/O control operation
verify: No I/O performed by windowsaio, perhaps try --debug=io option for details?

layout: (groupid=0, jobs=1): err= 0: pid=11680: Thu Apr 5 22:51:27 2018
  write: IOPS=3125, BW=3125MiB/s (3277MB/s)(100MiB/32msec)
    slat (usec): min=227, max=354, avg=262.40, stdev=29.52
    clat (nsec): min=4720, max=82685, avg=53824.91, stdev=17239.55
     lat (usec): min=237, max=428, avg=316.22, stdev=31.23
    clat percentiles (nsec):
     |  1.00th=[ 4704],  5.00th=[ 8896], 10.00th=[21888], 20.00th=[51456],
     | 30.00th=[54016], 40.00th=[54528], 50.00th=[56576], 60.00th=[59648],
     | 70.00th=[61184], 80.00th=[64256], 90.00th=[69120], 95.00th=[74240],
     | 99.00th=[81408], 99.50th=[82432], 99.90th=[82432], 99.95th=[82432],
     | 99.99th=[82432]
  lat (usec)   : 10=9.00%, 50=9.00%, 100=82.00%
  cpu          : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,100,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
trim: (groupid=1, jobs=1): err=25 (file:io_u.c:1823, func=io_u error, error=Inappropriate I/O control operation): pid=3684: Thu Apr 5 22:51:27 2018
  cpu          : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=33.3%, 4=66.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,0,1,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
verify: (groupid=2, jobs=1): err= 0: pid=4432: Thu Apr 5 22:51:27 2018
   read: IOPS=2941, BW=2941MiB/s (3084MB/s)(100MiB/34msec)
    slat (usec): min=15, max=398, avg=204.37, stdev=41.46
    clat (usec): min=2, max=4786, avg=84.46, stdev=475.67
     lat (usec): min=193, max=4802, avg=288.83, stdev=457.97
    clat percentiles (usec):
     |  1.00th=[    3],  5.00th=[    5], 10.00th=[    5], 20.00th=[    7],
     | 30.00th=[   11], 40.00th=[   29], 50.00th=[   33], 60.00th=[   55],
     | 70.00th=[   55], 80.00th=[   58], 90.00th=[   62], 95.00th=[   72],
     | 99.00th=[  143], 99.50th=[ 4817], 99.90th=[ 4817], 99.95th=[ 4817],
     | 99.99th=[ 4817]
  lat (usec)   : 4=0.50%, 10=12.50%, 20=2.50%, 50=11.00%, 100=22.50%
  lat (usec)   : 250=0.50%
  lat (msec)   : 10=0.50%
  cpu          : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=100,100,0,0 short=0,0,0,0 dropped=0,0,0,0

Run status group 0 (all jobs):
  WRITE: bw=3125MiB/s (3277MB/s), 3125MiB/s-3125MiB/s (3277MB/s-3277MB/s), io=100MiB (105MB), run=32-32msec

Run status group 1 (all jobs):

Run status group 2 (all jobs):
   READ: bw=2941MiB/s (3084MB/s), 2941MiB/s-2941MiB/s (3084MB/s-3084MB/s), io=100MiB (105MB), run=34-34msec