Performance difference between UFS and ZFS with NFS

[Steven Hartland]

I'm pretty sure when you retest you'll see dd at 100% cpu, you
could even try this for just a few seconds to confirm.

Basially ZFS is doing a lot more under the covers than UFS which
means that transfering 1k blocks in a serial manor is resulting
cpu saturation and not testing throughput to the disks.

    Regards
    Steve
----- Original Message ----- 
From: "Eric Browning" <ericbrowning at skaggscatholiccenter.org>
To: "Steven Hartland" <killing at multiplay.co.uk>
Cc: "FreeBSD FS" <freebsd-fs at freebsd.org>
Sent: Monday, November 25, 2013 7:24 PM
Subject: Re: Performance difference between UFS and ZFS with NFS


> Steven,
> 
> I've tried to 4K align these SSDs with gnop but they are currently ashift
> 9.  Pool layout is just 4 drives in a zfs stripe.  I've also tried raidz1
> with no noticeable performance impacts other than a loss of space for
> parity.
> 
> 
> On Mon, Nov 25, 2013 at 11:35 AM, Steven Hartland
> <killing at multiplay.co.uk>wrote:
> 
>> Just tried this here and I'm seeing CPU saturation from dd, is this
>> your case too?
>>
>> Switching to:
>> /usr/bin/time -h dd if=/dev/zero of=/home/smh/testfile bs=1m count=2930
>>
>> Iit changed from:
>> 3072000000 bytes transferred in 170.102366 secs (18059714 bytes/sec)
>>        2m50.48s real           1.05s user              2m48.28s sys
>>
>> to:
>> 3072327680 bytes transferred in 14.094856 secs (217975102 bytes/sec)
>>        15.19s real             0.00s user              4.87s sys
>>
>>    Regards
>>    Steve
>> ----- Original Message ----- From: "Steven Hartland" <
>> killing at multiplay.co.uk>
>> To: "Eric Browning" <ericbrowning at skaggscatholiccenter.org>
>> Cc: "FreeBSD FS" <freebsd-fs at freebsd.org>
>> Sent: Monday, November 25, 2013 6:20 PM
>> Subject: Re: Performance difference between UFS and ZFS with NFS
>>
>>
>>
>>  And whats your ZFS pool layout and ashift?
>>>
>>>    Regards
>>>    Steve
>>> ----- Original Message ----- From: "Eric Browning" <ericbrowning@
>>> skaggscatholiccenter.org>
>>>
>>>
>>>  I am using /dev/zero
>>>>
>>>> /usr/bin/time -h dd if=/dev/zero of=sometestfile bs=1024 count=3000000
>>>>
>>>>
>>>> On Sun, Nov 24, 2013 at 12:31 PM, krad <kraduk at gmail.com> wrote:
>>>>
>>>>  I was thinking the same, if it was using /dev/zero as an input any
>>>>> compression would skew the results a little.
>>>>>
>>>>>
>>>>> On 24 November 2013 15:15, Steven Hartland <killing at multiplay.co.uk>
>>>>> wrote:
>>>>>
>>>>>  ----- Original Message ----- From: "Eric Browning"
>>>>>>
>>>>>>
>>>>>>
>>>>>>  On a side note I forgot that I had used dd to test the disk
>>>>>> performance a
>>>>>>
>>>>>>> while ago when I was using ZFS.
>>>>>>>
>>>>>>> ZFS performance:
>>>>>>> 3072000000 bytes transferred in 34.167480 secs (89910055 bytes/sec)
>>>>>>> 34.17s real 0.61s user 31.89s sys
>>>>>>>
>>>>>>> UFS performance:
>>>>>>> 3072000000 bytes transferred in 11.848883 secs (259264942 bytes/sec)
>>>>>>> 11.85s real 0.58s user 11.25s sys
>>>>>>>
>>>>>>> Again, even with dd performance is about 3x faster with UFS with the
>>>>>>> same
>>>>>>> disks.
>>>>>>>
>>>>>>>
>>>>>> Interesting, what was you command exactly?
>>>>>>
>>>>>>    Regards
>>>>>>    Steve
>>>>>>
>>>>>> ================================================
>>>>>> This e.mail is private and confidential between Multiplay (UK) Ltd. and
>>>>>> the person or entity to whom it is addressed. In the event of
>>>>>> misdirection,
>>>>>> the recipient is prohibited from using, copying, printing or otherwise
>>>>>> disseminating it or any information contained in it.
>>>>>> In the event of misdirection, illegible or incomplete transmission
>>>>>> please
>>>>>> telephone +44 845 868 1337
>>>>>> or return the E.mail to postmaster at multiplay.co.uk.
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> freebsd-fs at freebsd.org mailing list
>>>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-fs
>>>>>> To unsubscribe, send any mail to "freebsd-fs-unsubscribe at freebsd.org"
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>> --
>>>> Eric Browning
>>>> Systems Administrator
>>>> 801-984-7623
>>>>
>>>> Skaggs Catholic Center
>>>> Juan Diego Catholic High School
>>>> Saint John the Baptist Middle
>>>> Saint John the Baptist Elementary
>>>>
>>>>
>>> ================================================
>>> This e.mail is private and confidential between Multiplay (UK) Ltd. and
>>> the person or entity to whom it is addressed. In the event of misdirection,
>>> the recipient is prohibited from using, copying, printing or otherwise
>>> disseminating it or any information contained in it.
>>> In the event of misdirection, illegible or incomplete transmission please
>>> telephone +44 845 868 1337
>>> or return the E.mail to postmaster at multiplay.co.uk.
>>>
>>> _______________________________________________
>>> freebsd-fs at freebsd.org mailing list
>>> http://lists.freebsd.org/mailman/listinfo/freebsd-fs
>>> To unsubscribe, send any mail to "freebsd-fs-unsubscribe at freebsd.org"
>>>
>>>
>>
>> ================================================
>> This e.mail is private and confidential between Multiplay (UK) Ltd. and
>> the person or entity to whom it is addressed. In the event of misdirection,
>> the recipient is prohibited from using, copying, printing or otherwise
>> disseminating it or any information contained in it.
>> In the event of misdirection, illegible or incomplete transmission please
>> telephone +44 845 868 1337
>> or return the E.mail to postmaster at multiplay.co.uk.
>>
>>
> 
> 
> -- 
> Eric Browning
> Systems Administrator
> 801-984-7623
> 
> Skaggs Catholic Center
> Juan Diego Catholic High School
> Saint John the Baptist Middle
> Saint John the Baptist Elementary
>

================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. 

In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337
or return the E.mail to postmaster at multiplay.co.uk.