Regression testing (was Re: Performance issue)

[Benjamin Krueger]

* Petri Helenius (pete at he.iki.fi) [050510 12:52]:
> 
> This sounds somewhat similar to Solaris dtrace stuff?
> 
> Pete

This sounds more like a QA/Feedback process. dtrace isn't
just a conglomeration of the usual performance metrics. It's
closer to a total revamp of how you perform said metrics at
the system level.

> Bakul Shah wrote:
> 
> >This thread makes me wonder if there is value in runing
> >performance tests on a regular basis.  This would give an
> >early warning of any peformance loss and can be a useful
> >forensic tool (one can pinpoint when some performance curve
> >changed discontinuously even though at the time of change it
> >may be too small to be noticed).  Over a period of time
> >one can gain a view of how the performance evolves.
> >
> >This would not be a single metric but a set of low and high
> >level measures: such as syscall overhead, interrupt overhead,
> >specific h/w devices, disk and fs performance for various
> >filesystems and file sizes, networking data and pkt
> >throughput, routing performance, VM, other subsystems, effect
> >of SMP, various threading libraries, scaling with number of
> >users/programs/cpus/memory, typical applications under normal
> >and stressed loads, compile time for the system and kernel
> >etc. etc. etc.
> >
> >The setup would allow for easy addition of new benchmarks
> >(the only way anything like this can be bootstrapped).  Of
> >course, one would need to record disk/processor/memory speed
> >and capacities + kernel config options, system build tools
> >and their options to interpret the results as best as
> >possible.  For the results to be useful the setup has to
> >remain as stable as possible for a long time.
> >
> >[While I am dreaming...] A follow on project would be to
> >create visualization tools -- mainly graphing and comparing
> >graphs.  It would be neat if one can click on a performance
> >graph to zoom in or see commits made during some selected
> >period.
> >
> >Such a detailed look, combined with profiling can help people
> >focus on specific hotspots & feel good about any improvements
> >they are making.  This can be a great way to rope in new
> >people;-)
> >_______________________________________________
> >freebsd-performance at freebsd.org mailing list
> >http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> >To unsubscribe, send any mail to 
> >"freebsd-performance-unsubscribe at freebsd.org"
> >
> > 
> >
> 
> _______________________________________________
> freebsd-performance at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> To unsubscribe, send any mail to 
> "freebsd-performance-unsubscribe at freebsd.org"

-- 

--
Benjamin Krueger
SysAdmin, CarDomain Network
92 Toyota Turbo MR2
78 Datsun B-210
91 freakin Geo Prizm