[regression] new runner missing in master results
Hi, Since MSVC-7.1 is (in theory) supported by Boost and we had no regressions on that platform, I've set up an old computer to do the job. I've executed regression tests several times and results appear in develop branch's result page but they are always missing in master branch. Logs indicate that executions and uploading were correct. Eg.: Runner "igaztanaga" present in develop: http://www.boost.org/development/tests/develop/developer/move.html Runner "igaztanaga" missing in develop: http://www.boost.org/development/tests/master/developer/move.html Any hint on what could be the problem? Ion
On Wed, Oct 7, 2015 at 3:13 PM, Ion Gaztañaga
Since MSVC-7.1 is (in theory) supported by Boost and we had no regressions on that platform, I've set up an old computer to do the job.
I've executed regression tests several times and results appear in develop branch's result page but they are always missing in master branch. Any hint on what could be the problem?
Test runner against master need to be "approved" before showing up. Assuming it's a stable test runner.. You can submit a PR to add it to the allowed list of runners here < https://github.com/boostorg/regression/blob/develop/reports/src/boost_wide_report.py#L51>. So.. How often will that runner do tests? Continuous? Daily? Weekly? Other? -- -- Rene Rivera -- Grafik - Don't Assume Anything -- Robot Dreams - http://robot-dreams.net -- rrivera/acm.org (msn) - grafikrobot/aim,yahoo,skype,efnet,gmail
On 07/10/2015 22:27, Rene Rivera wrote:
On Wed, Oct 7, 2015 at 3:13 PM, Ion Gaztañaga
wrote: Since MSVC-7.1 is (in theory) supported by Boost and we had no regressions on that platform, I've set up an old computer to do the job.
I've executed regression tests several times and results appear in develop branch's result page but they are always missing in master branch. Any hint on what could be the problem?
Test runner against master need to be "approved" before showing up. Assuming it's a stable test runner.. You can submit a PR to add it to the allowed list of runners here < https://github.com/boostorg/regression/blob/develop/reports/src/boost_wide_report.py#L51>. So..
Thanks! PR submitted.
How often will that runner do tests? Continuous? Daily? Weekly? Other?
Currently three times a week. With a single toolset (I might be adding some other missing toolsets) I could run it more frequently (master + develop need in my old computer ~16 hours). Is 3 times a week acceptable? Best, Ion
On Wed, Oct 7, 2015 at 4:36 PM, Ion Gaztañaga
On 07/10/2015 22:27, Rene Rivera wrote:
On Wed, Oct 7, 2015 at 3:13 PM, Ion Gaztañaga
wrote: Since MSVC-7.1 is (in theory) supported by Boost and we had no regressions
on that platform, I've set up an old computer to do the job.
I've executed regression tests several times and results appear in develop branch's result page but they are always missing in master branch. Any hint on what could be the problem?
Test runner against master need to be "approved" before showing up. Assuming it's a stable test runner.. You can submit a PR to add it to the allowed list of runners here <
https://github.com/boostorg/regression/blob/develop/reports/src/boost_wide_r...
. So..
Thanks! PR submitted.
I still don't see a PR. How often will that runner do tests? Continuous? Daily? Weekly? Other?
Currently three times a week. With a single toolset (I might be adding some other missing toolsets) I could run it more frequently (master + develop need in my old computer ~16 hours). Is 3 times a week acceptable?
That's fine. -- -- Rene Rivera -- Grafik - Don't Assume Anything -- Robot Dreams - http://robot-dreams.net -- rrivera/acm.org (msn) - grafikrobot/aim,yahoo,skype,efnet,gmail
On 08/10/2015 15:54, Rene Rivera wrote:
Thanks! PR submitted.
I still don't see a PR.
I must have dreamt it. Here we go: https://github.com/boostorg/regression/pull/31 Ion
On 10/07/2015 04:27 PM, Rene Rivera wrote:
On Wed, Oct 7, 2015 at 3:13 PM, Ion Gaztañaga
wrote: Since MSVC-7.1 is (in theory) supported by Boost and we had no regressions on that platform, I've set up an old computer to do the job.
I've executed regression tests several times and results appear in develop branch's result page but they are always missing in master branch. Any hint on what could be the problem?
Test runner against master need to be "approved" before showing up.
I also had a problem running regression tests against master, not seeing it show up on the 'master' regression test page, posting a message to the Boost testing mailing list, and when no one seem to know why the results never showed on the 'master' regression test page, just giving up. So can we please document on the Boost web site for running regression tests what you have answered here, ie exactly what has to be done to have one's 'master' regression test show up properly on the website's page ?
Assuming it's a stable test runner.. You can submit a PR to add it to the allowed list of runners here < https://github.com/boostorg/regression/blob/develop/reports/src/boost_wide_report.py#L51>. So..
How often will that runner do tests? Continuous? Daily? Weekly? Other?
On Thu, Oct 8, 2015 at 1:11 AM, Edward Diener
On 10/07/2015 04:27 PM, Rene Rivera wrote:
On Wed, Oct 7, 2015 at 3:13 PM, Ion Gaztañaga
wrote: Since MSVC-7.1 is (in theory) supported by Boost and we had no regressions
on that platform, I've set up an old computer to do the job.
I've executed regression tests several times and results appear in develop branch's result page but they are always missing in master branch. Any hint on what could be the problem?
Test runner against master need to be "approved" before showing up.
I also had a problem running regression tests against master, not seeing it show up on the 'master' regression test page, posting a message to the Boost testing mailing list, and when no one seem to know why the results never showed on the 'master' regression test page, just giving up.
I obviously missed that :-(
So can we please document on the Boost web site for running regression tests what you have answered here, ie exactly what has to be done to have one's 'master' regression test show up properly on the website's page ?
Will do. -- -- Rene Rivera -- Grafik - Don't Assume Anything -- Robot Dreams - http://robot-dreams.net -- rrivera/acm.org (msn) - grafikrobot/aim,yahoo,skype,efnet,gmail
participants (3)
-
Edward Diener
-
Ion Gaztañaga
-
Rene Rivera