FreeBSD, Centos and ZFS - SOLVED

aurfalien aurfalien at gmail.com
Wed Oct 23 19:30:56 UTC 2013


On Oct 23, 2013, at 12:11 PM, Outback Dingo wrote:

> 
> 
> 
> On Wed, Oct 23, 2013 at 1:53 PM, aurfalien <aurfalien at gmail.com> wrote:
> 
> On Oct 22, 2013, at 6:59 PM, Warren Block wrote:
> 
> > On Tue, 22 Oct 2013, aurfalien wrote:
> >
> >>
> >> On Oct 20, 2013, at 9:04 AM, Mark Felder wrote:
> >>
> >>> On Sat, Oct 19, 2013, at 14:31, aurfalien wrote:
> >>>>
> >>>> ZoL comes with a little interesting feature; arc2 compression, which does
> >>>> seem to enhance performance all around.  I disabled this in CentOS to
> >>>> level the playing field.
> >>>>
> >>>
> >>> FreeBSD 10 also has L2ARC compression
> >>>
> >>> http://svnweb.freebsd.org/base?view=revision&revision=251478
> >>
> >> OMG, what a relief... the ~30% diff in performance was due to a BIOS setting, in particular this one;
> >>
> >> Intel Turbo Boost Technology
> >> Enhanced Intel SpeedStep Tech
> >>
> >> I disabled both.
> >
> > Enable them both and also enable powerd on FreeBSD in /etc/rc.conf so it can take advantage of the first.
> >
> >> In fact, FreeBSD is showing a tad better now then CentOS.  I have files if any one is interested in viewing.
> >
> > With Turbo mode on, it may go even faster.
> 
> Yep, confirmed, got about ~1000 IOPS more by doing this (via fio).
> 
> So on to the other pots regarding tuning powerd.
> 
> - aurf
> 
> so curious what was the fio test on the command line.......  

my fio file;

[global]  
description=Emulation of Intel IOmeter File Server Access Pattern  
      
[iometer]  
rw=randrw  
rwmixread=75  
rwmixwrite=25
direct=0  
size=700g  
ioengine=posixaio
fallocate=none
runtime=900
random_distribution=zipf:2.2
# IOMeter defines the server loads as the following:  
# iodepth=1     Linear  
# iodepth=4     Very Light  
# iodepth=8     Light  
# iodepth=64    Moderate  
# iodepth=256   Heavy  
iodepth=64
thread

My results;

iometer: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=posixaio, iodepth=32
fio-2.1.1
Starting 1 thread
Jobs: 1 (f=1): [m] [100.0% done] [102.4MB/34795KB/0KB /s] [26.3K/8698/0 iops] [eta 00m:00s]
iometer: (groupid=0, jobs=1): err= 0: pid=101195: Wed Oct 23 12:26:55 2013
  Description  : [Emulation of Intel IOmeter File Server Access Pattern]
  read : io=61266MB, bw=104561KB/s, iops=26140, runt=600001msec
    slat (usec): min=0, max=3643, avg= 7.73, stdev=13.20
    clat (usec): min=7, max=707773, avg=707.63, stdev=1254.36
     lat (usec): min=9, max=707777, avg=715.36, stdev=1254.22
    clat percentiles (usec):
     |  1.00th=[   32],  5.00th=[   60], 10.00th=[   93], 20.00th=[  149],
     | 30.00th=[  213], 40.00th=[  286], 50.00th=[  394], 60.00th=[  548],
     | 70.00th=[  788], 80.00th=[ 1128], 90.00th=[ 1720], 95.00th=[ 2352],
     | 99.00th=[ 3824], 99.50th=[ 4512], 99.90th=[ 6240], 99.95th=[ 7136],
     | 99.99th=[11968]
    bw (KB  /s): min= 8755, max=112040, per=100.00%, avg=104619.14, stdev=3609.80
  write: io=20415MB, bw=34842KB/s, iops=8710, runt=600001msec
    slat (usec): min=1, max=3586, avg= 8.68, stdev=13.75
    clat (usec): min=9, max=708187, avg=1436.86, stdev=2013.35
     lat (usec): min=21, max=708192, avg=1445.54, stdev=2013.23
    clat percentiles (usec):
     |  1.00th=[   53],  5.00th=[   96], 10.00th=[  135], 20.00th=[  203],
     | 30.00th=[  286], 40.00th=[  418], 50.00th=[  676], 60.00th=[ 1080],
     | 70.00th=[ 1640], 80.00th=[ 2416], 90.00th=[ 3760], 95.00th=[ 5088],
     | 99.00th=[ 8256], 99.50th=[ 9664], 99.90th=[12992], 99.95th=[14528],
     | 99.99th=[19584]
    bw (KB  /s): min= 2978, max=37584, per=100.00%, avg=34861.41, stdev=1227.92
    lat (usec) : 10=0.01%, 20=0.10%, 50=2.69%, 100=6.81%, 250=23.36%
    lat (usec) : 500=20.88%, 750=10.72%, 1000=7.56%
    lat (msec) : 2=16.17%, 4=8.84%, 10=2.74%, 20=0.11%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.01%, 750=0.01%
  cpu          : usr=12.20%, sys=39.70%, ctx=10290014, majf=0, minf=0
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=64.3%, 32=35.5%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.6%, 8=3.5%, 16=0.8%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=15684217/w=5226293/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=61266MB, aggrb=104561KB/s, minb=104561KB/s, maxb=104561KB/s, mint=600001msec, maxt=600001msec
  WRITE: io=20415MB, aggrb=34841KB/s, minb=34841KB/s, maxb=34841KB/s, mint=600001msec, maxt=600001msec


- aurf


More information about the freebsd-questions mailing list