ULE vs. 4BSD in RELENG_7

[Julian Elischer]

Josh Carroll wrote:
>> I just ran through some of my benchmarks on a kernel build from
>> sources as of today, and I've noticed an improvement for the ffmpeg
>> workload. Here's a comparison of 4bsd, ule (BETA1) and ule (BETA3).
>> This is vanilla source with no patches applied:
> 
> Sorry, the ministat output was mangled. I'll try this again with 80
> columns instead.
> 
> Also, please disregard the buildworld comparison, as world has changed
> since the previous 4bsd and ule runs, so obviously that's not a valid
> comparison. Sorry about that.
> 
> Here are the ministat outputs for ffmpeg and sysbench, truncated to 80
> columns instead. Hopefully that'll come through properly.
> 


is bigger better or worse?

> Josh
> 
> 
> ffmpeg:
> 
> x 4bsd
> + ule
> * uleb3
> +------------------------------------------------------------------------------+
> |x     xx  xx                     *        * * * *            +   + ++        +|
> |  |____A___|                         |_____AM____|            |____MA_____|   |
> +------------------------------------------------------------------------------+
>     N           Min           Max        Median           Avg        Stddev
> x   5         93.28         94.05         93.74        93.746    0.29686697
> +   5         97.56          98.7         98.03        98.042    0.41924933
> Difference at 95.0% confidence
>         4.296 +/- 0.529778
>         4.5826% +/- 0.565121%
>         (Student's t, pooled s = 0.363249)
> *   5         95.58         96.69         96.37        96.278    0.42446437
> Difference at 95.0% confidence
>         2.532 +/- 0.534176
>         2.70092% +/- 0.569812%
>         (Student's t, pooled s = 0.366265)
> 
> sysbench:
> 
> x 4bsd
> + ule
> * uleb3
> +------------------------------------------------------------------------------+
> |x  x   x x                                            +         ++ * + *     *|
> | |___A_M_|                                                |_____AM|___|A_____||
> +------------------------------------------------------------------------------+
>     N           Min           Max        Median           Avg        Stddev
> x   5       2151.75       2172.05        2166.7       2163.14     8.1262968
> +   5       2274.13       2309.66       2298.99       2296.89     13.648515
> Difference at 95.0% confidence
>         133.75 +/- 16.3813
>         6.18314% +/- 0.757294%
>         (Student's t, pooled s = 11.2321)
> *   3       2303.61       2327.29       2313.17       2314.69     11.912951
> Difference at 95.0% confidence
>         151.55 +/- 17.0782
>         7.00602% +/- 0.789509%
>         (Student's t, pooled s = 9.5567)
> _______________________________________________
> freebsd-performance at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> To unsubscribe, send any mail to "freebsd-performance-unsubscribe at freebsd.org"