ULE vs. 4BSD in RELENG_7

Josh Carroll josh.carroll at gmail.com
Sat Dec 1 13:19:05 PST 2007


> I just ran through some of my benchmarks on a kernel build from
> sources as of today, and I've noticed an improvement for the ffmpeg
> workload. Here's a comparison of 4bsd, ule (BETA1) and ule (BETA3).
> This is vanilla source with no patches applied:

Sorry, the ministat output was mangled. I'll try this again with 80
columns instead.

Also, please disregard the buildworld comparison, as world has changed
since the previous 4bsd and ule runs, so obviously that's not a valid
comparison. Sorry about that.

Here are the ministat outputs for ffmpeg and sysbench, truncated to 80
columns instead. Hopefully that'll come through properly.

Josh


ffmpeg:

x 4bsd
+ ule
* uleb3
+------------------------------------------------------------------------------+
|x     xx  xx                     *        * * * *            +   + ++        +|
|  |____A___|                         |_____AM____|            |____MA_____|   |
+------------------------------------------------------------------------------+
    N           Min           Max        Median           Avg        Stddev
x   5         93.28         94.05         93.74        93.746    0.29686697
+   5         97.56          98.7         98.03        98.042    0.41924933
Difference at 95.0% confidence
        4.296 +/- 0.529778
        4.5826% +/- 0.565121%
        (Student's t, pooled s = 0.363249)
*   5         95.58         96.69         96.37        96.278    0.42446437
Difference at 95.0% confidence
        2.532 +/- 0.534176
        2.70092% +/- 0.569812%
        (Student's t, pooled s = 0.366265)

sysbench:

x 4bsd
+ ule
* uleb3
+------------------------------------------------------------------------------+
|x  x   x x                                            +         ++ * + *     *|
| |___A_M_|                                                |_____AM|___|A_____||
+------------------------------------------------------------------------------+
    N           Min           Max        Median           Avg        Stddev
x   5       2151.75       2172.05        2166.7       2163.14     8.1262968
+   5       2274.13       2309.66       2298.99       2296.89     13.648515
Difference at 95.0% confidence
        133.75 +/- 16.3813
        6.18314% +/- 0.757294%
        (Student's t, pooled s = 11.2321)
*   3       2303.61       2327.29       2313.17       2314.69     11.912951
Difference at 95.0% confidence
        151.55 +/- 17.0782
        7.00602% +/- 0.789509%
        (Student's t, pooled s = 9.5567)


More information about the freebsd-performance mailing list