VPS tests (Amsterdam location)

Few new tests for VPSes in Amsterdam location..

./fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=randrw --rwmixread=75

Vultr 25GB instance:

test: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
test: Laying out IO file(s) (1 file(s) / 4096MB)
Jobs: 1 (f=1): [m] [100.0% done] [178.7M/61330K /s] [45.8K/15.4K iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=2812: Sun Nov 5 17:16:01 2017
read : io=3072.2MB, bw=180174KB/s, iops=45043 , runt= 17465msec
write: io=1023.8MB, bw=59981KB/s, iops=14995 , runt= 17465msec
cpu : usr=6.43%, sys=19.97%, ctx=36864, majf=0, minf=17
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=786686/w=261890/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=3072.2MB, aggrb=180174KB/s, minb=180174KB/s, maxb=180174KB/s, mint=17465msec, maxt=17465msec
WRITE: io=1023.8MB, aggrb=59980KB/s, minb=59980KB/s, maxb=59980KB/s, mint=17465msec, maxt=17465msec

Disk stats (read/write):
vda: ios=782148/260368, merge=0/3, ticks=801989/214037, in_queue=1015958, util=99.52%

./fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=randread

test: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
test: Laying out IO file(s) (1 file(s) / 4096MB)
Jobs: 1 (f=1): [r] [100.0% done] [263.3M/0K /s] [67.4K/0 iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=2852: Sun Nov 5 17:45:12 2017
read : io=4096.0MB, bw=267085KB/s, iops=66771 , runt= 15704msec
cpu : usr=5.88%, sys=19.15%, ctx=50669, majf=0, minf=82
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=1048576/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=4096.0MB, aggrb=267085KB/s, minb=267085KB/s, maxb=267085KB/s, mint=15704msec, maxt=15704msec

Disk stats (read/write):
vda: ios=1039605/2, merge=0/1, ticks=935105/3, in_queue=935046, util=99.44%

./fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=randwrite
test: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
Jobs: 1 (f=1): [w] [100.0% done] [0K/198.2M /s] [0 /50.8K iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=2858: Sun Nov 5 17:49:07 2017
write: io=4096.0MB, bw=205472KB/s, iops=51368 , runt= 20413msec
cpu : usr=5.19%, sys=18.03%, ctx=53516, majf=0, minf=17
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=0/w=1048576/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
WRITE: io=4096.0MB, aggrb=205472KB/s, minb=205472KB/s, maxb=205472KB/s, mint=20413msec, maxt=20413msec

Disk stats (read/write):
vda: ios=0/1036034, merge=0/4, ticks=0/1226224, in_queue=1226229, util=99.56%

./fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=400k --iodepth=64 --size=4G --readwrite=randrw --rwmixread=75
test: (g=0): rw=randrw, bs=400K-400K/400K-400K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
Jobs: 1 (f=1): [m] [100.0% done] [315.7M/100.0M /s] [808 /256 iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=2880: Sun Nov 5 17:55:42 2017
read : io=3064.5MB, bw=323305KB/s, iops=808 , runt= 9706msec
write: io=1017.1MB, bw=107397KB/s, iops=268 , runt= 9706msec
cpu : usr=0.79%, sys=3.21%, ctx=606, majf=0, minf=19
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=7845/w=2606/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=3064.5MB, aggrb=323305KB/s, minb=323305KB/s, maxb=323305KB/s, mint=9706msec, maxt=9706msec
WRITE: io=1017.1MB, aggrb=107397KB/s, minb=107397KB/s, maxb=107397KB/s, mint=9706msec, maxt=9706msec

Disk stats (read/write):
vda: ios=7779/2587, merge=0/1, ticks=435857/170901, in_queue=608178, util=98.61%

DigitalOcean 30GB instance:

test: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
test: Laying out IO file(s) (1 file(s) / 4096MB)
Jobs: 1 (f=1): [m] [95.2% done] [136.7M/46980K /s] [34.1K/11.8K iops] [eta 00m:01s]
test: (groupid=0, jobs=1): err= 0: pid=23637: Sun Nov 5 17:23:31 2017
read : io=3071.3MB, bw=157068KB/s, iops=39266 , runt= 20023msec
write: io=1024.8MB, bw=52407KB/s, iops=13101 , runt= 20023msec
cpu : usr=13.53%, sys=55.32%, ctx=59397, majf=0, minf=16
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=786242/w=262334/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=3071.3MB, aggrb=157067KB/s, minb=157067KB/s, maxb=157067KB/s, mint=20023msec, maxt=20023msec
WRITE: io=1024.8MB, aggrb=52406KB/s, minb=52406KB/s, maxb=52406KB/s, mint=20023msec, maxt=20023msec

Disk stats (read/write):
vda: ios=776902/258798, merge=0/4, ticks=146928/761383, in_queue=908376, util=98.87%

fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=randread
test: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
Jobs: 1 (f=1): [r] [100.0% done] [486.8M/0K /s] [125K/0 iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=23998: Sun Nov 5 17:41:17 2017
read : io=4096.0MB, bw=442858KB/s, iops=110714 , runt= 9471msec
cpu : usr=19.26%, sys=66.20%, ctx=9735, majf=0, minf=82
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=1048576/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=4096.0MB, aggrb=442857KB/s, minb=442857KB/s, maxb=442857KB/s, mint=9471msec, maxt=9471msec

Disk stats (read/write):
vda: ios=1047782/5, merge=0/13, ticks=318296/2, in_queue=318102, util=97.92%

./fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=randwrite
test: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
Jobs: 1 (f=1): [w] [100.0% done] [0K/72079K /s] [0 /18.2K iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=24180: Sun Nov 5 17:49:59 2017
write: io=4096.0MB, bw=62441KB/s, iops=15610 , runt= 67172msec
cpu : usr=5.09%, sys=20.30%, ctx=97800, majf=0, minf=16
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=0/w=1048576/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
WRITE: io=4096.0MB, aggrb=62441KB/s, minb=62441KB/s, maxb=62441KB/s, mint=67172msec, maxt=67172msec

Disk stats (read/write):
vda: ios=0/1046029, merge=0/155, ticks=0/3784705, in_queue=3784274, util=98.34%

./fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=400k --iodepth=64 --size=4G --readwrite=randrw --rwmixread=75
test: (g=0): rw=randrw, bs=400K-400K/400K-400K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
Jobs: 1 (f=1)
test: (groupid=0, jobs=1): err= 0: pid=24337: Sun Nov 5 17:55:51 2017
read : io=3054.8MB, bw=2705.7MB/s, iops=6926 , runt= 1129msec
write: io=1027.8MB, bw=932152KB/s, iops=2330 , runt= 1129msec
cpu : usr=13.92%, sys=34.57%, ctx=1964, majf=0, minf=18
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=7820/w=2631/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=3054.8MB, aggrb=2705.7MB/s, minb=2705.7MB/s, maxb=2705.7MB/s, mint=1129msec, maxt=1129msec
WRITE: io=1027.8MB, aggrb=932152KB/s, minb=932152KB/s, maxb=932152KB/s, mint=1129msec, maxt=1129msec

Disk stats (read/write):
vda: ios=6168/2028, merge=0/0, ticks=17435/31300, in_queue=48952, util=86.72%

Vultr performs better with small chunks (e.g. db use) but DO is considerably faster with larger chunks (files). The test is not completely fair as the vultr instance was a clean install and the DO instance had some processes running already.