on Thu Oct 04 2007, Beman Dawes <bdawes-AT-acm.org> wrote:
As an experiment, I've got a script that is checking svn every 15 minutes, and if there is a change, running the regression tests and uploading results to a web site.
For current VC++ results, see http://mysite.verizon.net/beman/win32-trunk-results.html On these runs the reporting is set to show a row only if the results are something other than a simple "pass" without link.
That part doesn't seem to be working.
For slightly outdated Linux results, see http://mysite.verizon.net/beman/ubuntu-trunk-results.html Here the results show all tests, regardless of result.
The idea is to supplement the regular regression tests at http://beta.boost.org/development/tests/trunk/developer/serialization.html with rapid turnaround tests on a few major platforms, aimed at giving developers quick response as they try to fix bugs affecting platforms they don't have access to. At the current level failures, the Win32 tests are turning around in 11 minutes while the Linux tests turn in 4 minutes. Thus worst case developers can see test results in 26 minutes!
It seems to me this might be helpful to developers. Opinions?
I don't know. This seems to use some older regression reporting scripts; do they take into account explicit failure markup? -- Dave Abrahams Boost Consulting http://www.boost-consulting.com