iperf

tmp]$ iperf -c sv5-prd-artifapp004
------------------------------------------------------------
Client connecting to sv5-prd-artifapp004, TCP port 5001
TCP window size: 19.3 KByte (default)
------------------------------------------------------------
[  3] local 10.156.7.20 port 54581 connected with 10.156.7.24 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec  10.8 GBytes  9.27 Gbits/sec


#==================================================================
#==================================================================
looks like that may have been caused by low block size. increasing to 32k gives me about 5 gbps
``` tmp]$ sudo fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=32k --iodepth=64 --size=10G --readwrite=write
test: (g=0): rw=write, bs=32K-32K/32K-32K/32K-32K, ioengine=libaio, iodepth=64
fio-2.0.13
Starting 1 process
test: Laying out IO file(s) (1 file(s) / 10240MB)
Jobs: 1 (f=1): [W] [100.0% done] [0K/664.6M/0K /s] [0 /21.3K/0  iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=13514: Thu Jul 26 12:38:29 2018
  write: io=10240MB, bw=635039KB/s, iops=19844 , runt= 16512msec
  cpu          : usr=6.93%, sys=13.19%, ctx=94555, majf=0, minf=21
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=0/w=327680/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=10240MB, aggrb=635038KB/s, minb=635038KB/s, maxb=635038KB/s, mint=16512msec, maxt=16512msec```

higher block sizes isn’t giving me more, so that seems to be about max we can push to nfs… which divided by 3 workers is about 2 gbps…



#===============================================================

sudo fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=randwrite
[sudo] password for mdickey: 
test: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.13
Starting 1 process
test: Laying out IO file(s) (1 file(s) / 4096MB)
Jobs: 1 (f=1): [w] [100.0% done] [0K/108.4M/0K /s] [0 /27.8K/0  iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=9945: Thu Jul 26 12:24:29 2018
  write: io=4096.0MB, bw=108332KB/s, iops=27083 , runt= 38717msec
  cpu          : usr=4.45%, sys=13.12%, ctx=1041875, majf=0, minf=19
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=0/w=1048576/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=4096.0MB, aggrb=108332KB/s, minb=108332KB/s, maxb=108332KB/s, mint=38717msec, maxt=38717msec
[mdickey@sv5-prd-artifapp001 tmp]$ sudo fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=write
test: (g=0): rw=write, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.13
Starting 1 process
Jobs: 1 (f=1): [W] [100.0% done] [0K/76504K/0K /s] [0 /19.2K/0  iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=10357: Thu Jul 26 12:26:24 2018
  write: io=4096.0MB, bw=76708KB/s, iops=19176 , runt= 54679msec
  cpu          : usr=2.84%, sys=13.17%, ctx=1365445, majf=0, minf=22
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=0/w=1048576/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=4096.0MB, aggrb=76707KB/s, minb=76707KB/s, maxb=76707KB/s, mint=54679msec, maxt=54679msec
[mdickey@sv5-prd-artifapp001 tmp]$ pwd
/mnt/artifactory_filestore/tmp
[mdickey@sv5-prd-artifapp001 tmp]$ mount |grep nfs
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)

10.156.7.240:/ProductsReleases/artifactory on /mnt/artifactory_filestore type nfs (rw,noatime,nfsvers=3,lookupcache=pos,intr,rsize=32768,wsize=32768,addr=10.156.7.240)