Possible evidence of performance regression for 8.1-S (vs. 7.1)

David Wolfskill david at catwhisker.org
Tue Oct 26 17:45:02 UTC 2010


On Tue, Oct 26, 2010 at 02:03:34PM +0200, Ivan Voras wrote:
> ...
> Since you now have the two kernels readily available, can you rule out
> NFS by just repeating the step which involves it in both kernels and
> compare the results?

On Tue, Oct 26, 2010 at 02:47:11PM +0200, Ivan Voras wrote:
> ...
> Couldn't you simply run blogbench or just copy/untar a full /usr/ports
> tree on NFS that while booting either of the kernels?

OK; here are timing results from 5 iterations each of running "tar
xf", reading aa gzipped tarball of /usr/ports (updated earlier this
morning) from NFS & writing it to the same local file system that
I used for the previously-cited builds.  Each of these was run on
the 8.x reference machine, and each terminated with a status code of 0:

     start        stop    real   user    sys  os
1288111167  1288111298  131.14  12.77  17.88  7.1-R+
1288111359  1288111488  128.40  12.50  19.40  7.1-R+
1288111546  1288111678  131.85  12.80  19.24  7.1-R+
1288111739  1288111862  122.84  12.61  19.60  7.1-R+
1288111919  1288112050  131.35  12.12  19.73  7.1-R+

1288109542  1288109653  111.26  12.03  14.88  8.1-S [7.1-R+ userland]
1288109686  1288109783   97.38  12.83  13.28  8.1-S [7.1-R+ userland]
1288109811  1288109923  112.18  12.32  14.21  8.1-S [7.1-R+ userland]
1288109958  1288110063  104.94  12.21  14.34  8.1-S [7.1-R+ userland]
1288110094  1288110205  110.98  12.02  14.72  8.1-S [7.1-R+ userland]

1288112673  1288112768   94.88   9.41  12.87  8.1-S
1288112793  1288112885   92.37   9.16  13.32  8.1-S
1288112909  1288113009  100.25   9.21  13.72  8.1-S
1288113035  1288113126   90.52   9.38  13.38  8.1-S
1288113149  1288113249  100.23   8.91  14.00  8.1-S



And here are some ministat summaries of the above:

dwolf-bsd(8.1-S)[12] ls
real_k7_u7      real_k8_u8      sys_k8_u7       user_k7_u7      user_k8_u8
real_k8_u7      sys_k7_u7       sys_k8_u8       user_k8_u7

dwolf-bsd(8.1-S)[13] ministat -s real*
x real_k7_u7
+ real_k8_u7
* real_k8_u8
+------------------------------------------------------------------------------+
|                  *                                                           |
|*  *    *   +     *       +          +++                   x         x    xx  |
|                                                               |______A___M__||
|                   |___________A_____M____|                                   |
| |______MA_______|                                                            |
+------------------------------------------------------------------------------+
    N           Min           Max        Median           Avg        Stddev
x   5        122.84        131.85        131.14       129.116     3.7570906
+   5         97.38        112.18        110.98       107.348     6.2650395
Difference at 95.0% confidence
        -21.768 +/- 7.5337
        -16.8593% +/- 5.83483%
        (Student's t, pooled s = 5.16558)
*   5         90.52        100.25         94.88         95.65      4.466671
Difference at 95.0% confidence
        -33.466 +/- 6.01922
        -25.9193% +/- 4.66187%
        (Student's t, pooled s = 4.12716)

dwolf-bsd(8.1-S)[14] ministat -s user*
x user_k7_u7
+ user_k8_u7
* user_k8_u8
+------------------------------------------------------------------------------+
|*    **  **                                                  + x + +  x  x  x+|
|                                                                  |_____AM___||
|                                                            |____MA______|    |
|  |___A___|                                                                   |
+------------------------------------------------------------------------------+
    N           Min           Max        Median           Avg        Stddev
x   5         12.12          12.8         12.61         12.56    0.27449954
+   5         12.02         12.83         12.21        12.282    0.33131556
No difference proven at 95.0% confidence
*   5          8.91          9.41          9.21         9.214    0.20082331
Difference at 95.0% confidence
        -3.346 +/- 0.350755
        -26.6401% +/- 2.79263%
        (Student's t, pooled s = 0.240499)

dwolf-bsd(8.1-S)[15] ministat -s  sys*
x sys_k7_u7
+ sys_k8_u7
* sys_k8_u8
+------------------------------------------------------------------------------+
|*   +**  *  *  ++   + +                                x              xx  xx  |
|                                                             |_______A_M_____||
|         |_____AM_____|                                                       |
|  |___A____|                                                                  |
+------------------------------------------------------------------------------+
    N           Min           Max        Median           Avg        Stddev
x   5         17.88         19.73          19.4         19.17    0.74505033
+   5         13.28         14.88         14.34        14.286    0.62488399
Difference at 95.0% confidence
        -4.884 +/- 1.00282
        -25.4773% +/- 5.2312%
        (Student's t, pooled s = 0.687597)
*   5         12.87            14         13.38        13.458    0.42815885
Difference at 95.0% confidence
        -5.712 +/- 0.886188
        -29.7966% +/- 4.62279%
        (Student's t, pooled s = 0.607627)
dwolf-bsd(8.1-S)[16] 


Peace,
david
-- 
David H. Wolfskill				david at catwhisker.org
Depriving a girl or boy of an opportunity for education is evil.

See http://www.catwhisker.org/~david/publickey.gpg for my public key.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 196 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-performance/attachments/20101026/66abf2e9/attachment.pgp


More information about the freebsd-performance mailing list