marking regression test failures as expected
Hi, I noticed in the regression tests results taht some failing tests are marked as "fail*" in greyish color indicating that the failure is expected along with the explanation why. E.g., http://www.boost.org/development/tests/develop/developer/output/teeks99-03a-... Question: how can I indicate that the new failure is expected in the same manner? Regards, &rzej
On 30 April 2014 10:57, Andrzej Krzemienski
Hi, I noticed in the regression tests results taht some failing tests are marked as "fail*" in greyish color indicating that the failure is expected along with the explanation why. E.g., http://www.boost.org/development/tests/develop/developer/output/teeks99-03a-...
Question: how can I indicate that the new failure is expected in the same manner?
It's specified in the super project at 'status/explicit-failures-markup.xml'. I think you'll need to create a pull request.
2014-04-30 12:05 GMT+02:00 Daniel James
On 30 April 2014 10:57, Andrzej Krzemienski
wrote: Hi, I noticed in the regression tests results taht some failing tests are marked as "fail*" in greyish color indicating that the failure is expected along with the explanation why. E.g.,
http://www.boost.org/development/tests/develop/developer/output/teeks99-03a-...
Question: how can I indicate that the new failure is expected in the same manner?
It's specified in the super project at 'status/explicit-failures-markup.xml'. I think you'll need to create a pull request.
I am trying to learn the syntax of this file and I cannot understand one thing. When I look at tests results here: http://www.boost.org/development/tests/master/developer/optional.html, one test case (optional_test_refhttps://github.com/boostorg/optional/blob/master/test/optional_test_ref.cpp) is marked as expected failure for toolset "gcc- 4.4", but in the file 'status/explicit-failures-markup.xml' I cannot find a corresponding entry for this toolset. How does the testing framework know, then? Regards, &rzej
On Tuesday 06 May 2014 15:38:59 Andrzej Krzemienski wrote:
2014-04-30 12:05 GMT+02:00 Daniel James
: On 30 April 2014 10:57, Andrzej Krzemienski
wrote: Hi, I noticed in the regression tests results taht some failing tests are marked as "fail*" in greyish color indicating that the failure is
expected
along with the explanation why. E.g.,
http://www.boost.org/development/tests/develop/developer/output/teeks99-03 a-Ubuntu12-04-64-boost-bin-v2-libs-optional-test-optional_test_ref-test-gc c-4-4-debug.html>
Question: how can I indicate that the new failure is expected in the same manner?
It's specified in the super project at 'status/explicit-failures-markup.xml'. I think you'll need to create a pull request.
I am trying to learn the syntax of this file and I cannot understand one thing. When I look at tests results here: http://www.boost.org/development/tests/master/developer/optional.html, one test case (optional_test_ref<https://github.com/boostorg/optional/blob/master/test/op tional_test_ref.cpp>) is marked as expected failure for toolset "gcc- 4.4", but in the file 'status/explicit-failures-markup.xml' I cannot find a corresponding entry for this toolset. How does the testing framework know, then?
I think, regression markup is used from develop, even if master branch is tested.
participants (3)
-
Andrey Semashev
-
Andrzej Krzemienski
-
Daniel James