Re: [boost] marking regression test failures as expected

On Tuesday 06 May 2014 15:38:59 Andrzej Krzemienski wrote:

2014-04-30 12:05 GMT+02:00 Daniel James :

...

On 30 April 2014 10:57, Andrzej Krzemienski wrote:

...

Hi, I noticed in the regression tests results taht some failing tests are marked as "fail*" in greyish color indicating that the failure is

expected

...

along with the explanation why. E.g.,

http://www.boost.org/development/tests/develop/developer/output/teeks99-03 a-Ubuntu12-04-64-boost-bin-v2-libs-optional-test-optional_test_ref-test-gc c-4-4-debug.html>

...

Question: how can I indicate that the new failure is expected in the same manner?

It's specified in the super project at 'status/explicit-failures-markup.xml'. I think you'll need to create a pull request.

I am trying to learn the syntax of this file and I cannot understand one thing. When I look at tests results here: http://www.boost.org/development/tests/master/developer/optional.html, one test case (optional_test_ref<https://github.com/boostorg/optional/blob/master/test/op tional_test_ref.cpp>) is marked as expected failure for toolset "gcc- 4.4", but in the file 'status/explicit-failures-markup.xml' I cannot find a corresponding entry for this toolset. How does the testing framework know, then?

I think, regression markup is used from develop, even if master branch is tested.