Re; ZFS Performance FreeBSD 9.0 vs. Openindiana

Franz Schober franz.schober at firmos.at
Fri Mar 30 07:08:17 UTC 2012


Thx for your input !

Am 29.03.12 12:51, schrieb grarpamp:
> Knowing of no better... I find Iozone quite nice.
>
> However... I would first resolve these differences in
> the test methodology before trying to compare
> anything 74 revisions apart... and perhaps the
> address width as well.
>
> Version $Revision: 3.323 $
> Compiled for 32 bit mode.
> Build: Solaris10cc-64
>       File size set to 4194304 KB
>
> Version $Revision: 3.397 $
> Compiled for 64 bit mode.
> Build: freebsd
>       File size set to 4194304 KB
I recompiled both iozone binaries to 3.398 64 bit, results are similar.
Messurement files are below.
> Then try to see where the average 45% speedup is occuring.
>
>> to run not only in cache
>>   Processor cache size set to 1024 Kbytes.
> 128k could very well fit in a cache somewhere.
> Such as say, the one above.
>
> As shown on the iozone site, I'd try graphing the full range
> of record sizes as a first baseline comparison.
In progress.
> And poke around the sysctls to see how the zfs parameters
> match up.
Any hints about the very interresting sysctls about zfs tuning for 
FreeBSD here ?

>> -c Include  close() in the timing calculations. This is useful only
>>      if you suspect that close() is broken in  the  operating  system
>>      currently  under test.
> Really, you do?
Used the parameters here from an NFS testing paper, for the new tests I 
omitted this one.
> _______________________________________________
> freebsd-fs at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-fs
> To unsubscribe, send any mail to "freebsd-fs-unsubscribe at freebsd.org"
>
>
     Iozone: Performance Test of File I/O
             Version $Revision: 3.398 $
         Compiled for 64 bit mode.
         Build: freebsd

     Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                  Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                  Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                  Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                  Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave 
Boone,
                  Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                  Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer.
                  Ben England.

     Run began: Thu Mar 29 14:19:38 2012

     SYNC Mode.
     Record Size 128 KB
     File size set to 4194304 KB
     Command line used: iozone -o -t 8 -r 128k -s 4G
     Output is in Kbytes/sec
     Time Resolution = 0.000001 seconds.
     Processor cache size set to 1024 Kbytes.
     Processor cache line size set to 32 bytes.
     File stride size set to 17 * record size.
     Throughput test with 8 processes
     Each process writes a 4194304 Kbyte file in 128 Kbyte records

     Children see throughput for  8 initial writers     =  150868.63 KB/sec
     Parent sees throughput for  8 initial writers     =  150863.48 KB/sec
     Min throughput per process             =   18857.70 KB/sec
     Max throughput per process             =   18859.75 KB/sec
     Avg throughput per process             =   18858.58 KB/sec
     Min xfer                     = 4193920.00 KB

     Children see throughput for  8 rewriters     =  149426.29 KB/sec
     Parent sees throughput for  8 rewriters     =  149424.16 KB/sec
     Min throughput per process             =   18593.01 KB/sec
     Max throughput per process             =   18746.05 KB/sec
     Avg throughput per process             =   18678.29 KB/sec
     Min xfer                     = 4160128.00 KB

     Children see throughput for  8 readers         = 1042745.14 KB/sec
     Parent sees throughput for  8 readers         = 1041299.44 KB/sec
     Min throughput per process             =  122961.57 KB/sec
     Max throughput per process             =  133874.20 KB/sec
     Avg throughput per process             =  130343.14 KB/sec
     Min xfer                     = 3852288.00 KB

     Children see throughput for 8 re-readers     =  866942.31 KB/sec
     Parent sees throughput for 8 re-readers     =  862920.82 KB/sec
     Min throughput per process             =  104678.79 KB/sec
     Max throughput per process             =  111929.87 KB/sec
     Avg throughput per process             =  108367.79 KB/sec
     Min xfer                     = 3944832.00 KB

     Children see throughput for 8 reverse readers     =  997806.75 KB/sec
     Parent sees throughput for 8 reverse readers     =  988615.08 KB/sec
     Min throughput per process             =  108911.76 KB/sec
     Max throughput per process             =  144133.22 KB/sec
     Avg throughput per process             =  124725.84 KB/sec
     Min xfer                     = 3181952.00 KB

     Children see throughput for 8 stride readers     =  288693.36 KB/sec
     Parent sees throughput for 8 stride readers     =  287774.92 KB/sec
     Min throughput per process             =   33722.81 KB/sec
     Max throughput per process             =   40996.01 KB/sec
     Avg throughput per process             =   36086.67 KB/sec
     Min xfer                     = 3455104.00 KB

     Children see throughput for 8 random readers     =  115986.33 KB/sec
     Parent sees throughput for 8 random readers     =  115983.24 KB/sec
     Min throughput per process             =   14144.19 KB/sec
     Max throughput per process             =   14719.62 KB/sec
     Avg throughput per process             =   14498.29 KB/sec
     Min xfer                     = 4030464.00 KB

     Children see throughput for 8 mixed workload     =  189486.43 KB/sec
     Parent sees throughput for 8 mixed workload     =  189470.53 KB/sec
     Min throughput per process             =   12340.80 KB/sec
     Max throughput per process             =   35010.00 KB/sec
     Avg throughput per process             =   23685.80 KB/sec
     Min xfer                     = 1478528.00 KB

     Children see throughput for 8 random writers     =  147573.26 KB/sec
     Parent sees throughput for 8 random writers     =  147564.68 KB/sec
     Min throughput per process             =   18446.08 KB/sec
     Max throughput per process             =   18447.95 KB/sec
     Avg throughput per process             =   18446.66 KB/sec
     Min xfer                     = 4193920.00 KB

     Children see throughput for 8 pwrite writers     =  150153.40 KB/sec
     Parent sees throughput for 8 pwrite writers     =  150151.15 KB/sec
     Min throughput per process             =   18768.81 KB/sec
     Max throughput per process             =   18769.74 KB/sec
     Avg throughput per process             =   18769.18 KB/sec
     Min xfer                     = 4194176.00 KB

     Children see throughput for 8 pread readers     = 1132129.56 KB/sec
     Parent sees throughput for 8 pread readers     = 1132038.43 KB/sec
     Min throughput per process             =  132049.78 KB/sec
     Max throughput per process             =  149369.56 KB/sec
     Avg throughput per process             =  141516.20 KB/sec
     Min xfer                     = 3708288.00 KB

     Children see throughput for  8 fwriters     =  479942.93 KB/sec
     Parent sees throughput for  8 fwriters         =  405355.22 KB/sec
     Min throughput per process             =   51488.59 KB/sec
     Max throughput per process             =   79697.76 KB/sec
     Avg throughput per process             =   59992.87 KB/sec
     Min xfer                     = 4194304.00 KB

     Children see throughput for  8 freaders     = 1305623.56 KB/sec
     Parent sees throughput for  8 freaders         = 1274297.58 KB/sec
     Min throughput per process             =  159303.33 KB/sec
     Max throughput per process             =  170930.03 KB/sec
     Avg throughput per process             =  163202.95 KB/sec
     Min xfer                     = 4194304.00 KB



iozone test complete.

     Iozone: Performance Test of File I/O
             Version $Revision: 3.398 $
         Compiled for 64 bit mode.
         Build: Solaris10gcc-64

     Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                  Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                  Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                  Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                  Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave 
Boone,
                  Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                  Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer.
                  Ben England.

     Run began: Thu Mar 29 14:26:32 2012

     SYNC Mode.
     Record Size 128 KB
     File size set to 4194304 KB
     Command line used: /usr/benchmarks/iozone/iozone -o -t 8 -r 128k -s 4G
     Output is in Kbytes/sec
     Time Resolution = 0.000001 seconds.
     Processor cache size set to 1024 Kbytes.
     Processor cache line size set to 32 bytes.
     File stride size set to 17 * record size.
     Throughput test with 8 processes
     Each process writes a 4194304 Kbyte file in 128 Kbyte records

     Children see throughput for  8 initial writers     =  163928.73 KB/sec
     Parent sees throughput for  8 initial writers     =  163742.79 KB/sec
     Min throughput per process             =   20472.19 KB/sec
     Max throughput per process             =   20514.05 KB/sec
     Avg throughput per process             =   20491.09 KB/sec
     Min xfer                     = 4185728.00 KB

     Children see throughput for  8 rewriters     =  166042.96 KB/sec
     Parent sees throughput for  8 rewriters     =  166022.58 KB/sec
     Min throughput per process             =   20738.16 KB/sec
     Max throughput per process             =   20785.44 KB/sec
     Avg throughput per process             =   20755.37 KB/sec
     Min xfer                     = 4184960.00 KB

     Children see throughput for  8 readers         = 1204767.22 KB/sec
     Parent sees throughput for  8 readers         = 1204261.66 KB/sec
     Min throughput per process             =  129381.34 KB/sec
     Max throughput per process             =  193455.00 KB/sec
     Avg throughput per process             =  150595.90 KB/sec
     Min xfer                     = 2804864.00 KB

     Children see throughput for 8 re-readers     =  996214.55 KB/sec
     Parent sees throughput for 8 re-readers     =  991045.12 KB/sec
     Min throughput per process             =  123043.02 KB/sec
     Max throughput per process             =  126982.37 KB/sec
     Avg throughput per process             =  124526.82 KB/sec
     Min xfer                     = 4094208.00 KB

     Children see throughput for 8 reverse readers     = 2712166.84 KB/sec
     Parent sees throughput for 8 reverse readers     = 2634185.61 KB/sec
     Min throughput per process             =  271423.66 KB/sec
     Max throughput per process             =  581808.50 KB/sec
     Avg throughput per process             =  339020.86 KB/sec
     Min xfer                     = 1995136.00 KB

     Children see throughput for 8 stride readers     =  318718.81 KB/sec
     Parent sees throughput for 8 stride readers     =  318551.66 KB/sec
     Min throughput per process             =   32463.41 KB/sec
     Max throughput per process             =   50197.65 KB/sec
     Avg throughput per process             =   39839.85 KB/sec
     Min xfer                     = 2714112.00 KB

     Children see throughput for 8 random readers     =  121252.01 KB/sec
     Parent sees throughput for 8 random readers     =  121242.78 KB/sec
     Min throughput per process             =   14592.07 KB/sec
     Max throughput per process             =   16029.80 KB/sec
     Avg throughput per process             =   15156.50 KB/sec
     Min xfer                     = 3818112.00 KB

     Children see throughput for 8 mixed workload     =  192510.71 KB/sec
     Parent sees throughput for 8 mixed workload     =  192398.09 KB/sec
     Min throughput per process             =   12424.72 KB/sec
     Max throughput per process             =   35641.26 KB/sec
     Avg throughput per process             =   24063.84 KB/sec
     Min xfer                     = 1462912.00 KB

     Children see throughput for 8 random writers     =  163482.42 KB/sec
     Parent sees throughput for 8 random writers     =  163297.29 KB/sec
     Min throughput per process             =   20411.26 KB/sec
     Max throughput per process             =   20456.37 KB/sec
     Avg throughput per process             =   20435.30 KB/sec
     Min xfer                     = 4185216.00 KB

     Children see throughput for  8 fwriters     =  132004.80 KB/sec
     Parent sees throughput for  8 fwriters         =  130492.16 KB/sec
     Min throughput per process             =   16337.71 KB/sec
     Max throughput per process             =   16703.73 KB/sec
     Avg throughput per process             =   16500.60 KB/sec
     Min xfer                     = 4194304.00 KB

     Children see throughput for  8 freaders     = 1069833.95 KB/sec
     Parent sees throughput for  8 freaders         = 1064831.11 KB/sec
     Min throughput per process             =  133137.16 KB/sec
     Max throughput per process             =  135073.42 KB/sec
     Avg throughput per process             =  133729.24 KB/sec
     Min xfer                     = 4194304.00 KB



iozone test complete.

Thx,
Franz Schober



More information about the freebsd-fs mailing list