[Boost.Test] Why is "less failures then expected" not an error?
Hi! If I use BOOST_AUTO_TEST_CASE_EXPECTED_FAILURES I would expect it to be an error when I have less as well as too many errors in the marked testcases. However, the Test Run only fails if there are to many errors. Is this intentional? Why? Thanks! br, Martin Testsuite Output (1.34.1) ---- Running 14 test cases... (...) Test case has less failures then expected (...) *** No errors detected ---- versus: ---- Running 14 test cases... (...) *** 7 failures detected (6 failures expected) in test suite "Master Test Suite" ----
Martin Trappel <0xCDCDCDCD <at> gmx.at> writes:
Hi!
If I use BOOST_AUTO_TEST_CASE_EXPECTED_FAILURES I would expect it to be an error when I have less as well as too many errors in the marked testcases. However, the Test Run only fails if there are to many errors. Is this intentional?
Yes. But if you have less errors than expetected warning is issued.
Why?
Becasue having less errors than expected is not considerred a reason to fail the test. Gennadiy
participants (2)
-
Gennadiy Rozental -
Martin Trappel