https://svn.boost.org/trac10/ticket/6129 <p> I <a class="ext-link" href="http://lists.boost.org/boost-users/2011/11/71744.php"><span class="icon">​</span>mentioned</a> this on the mailing list before, but I would like to be able to report the number of times assertions in the <code>BOOST_WARN</code> "family" have failed. </p> <p> For test cases, the (XML) report includes information similar to: </p> <pre class="wiki">result="passed" assertions_passed="x" assertions_failed="x" expected_failures="x" </pre><p> and for test suites </p> <pre class="wiki">result="passed" assertions_passed="x" assertions_failed="x" expected_failures="x" test_cases_passed="x" test_cases_failed="x" test_cases_skipped="x" test_cases_aborted="x" </pre><p> I guess I would like to see a count of something like <code>assertions_ignored</code> added to the test cases and an additional <code>ignored</code> value for their <code>result</code> attribute. This <code>ignored</code> value is used for test cases that fail one or more of their <code>BOOST_WARN</code> type assertions but pass <em>all</em> of their <code>BOOST_REQUIRE</code> and <code>BOOST_CHECK</code> assertions. If all assertions pass, the test case passes. If a <code>BOOST_CHECK</code> assertion fails the test case fails. If a <code>BOOST_REQUIRE</code> assertion fails, the test case is aborted and fails. </p> <p> For the test suites, the same story goes for the <code>assertions_ignored</code> and <code>ignored</code> additions, where an <code>ignored</code> result is assigned if one or more test cases with that result were encountered and none of the test cases <code>failed</code>. If all test cases passed, the test suite passes. If one or more test cases failed, the test suite fails. In addition to the existing <code>test_cases_*</code> counts, I'd like to see a <code>test_cases_ignored</code> count. </p> <p> Summarizing, you'd get something like this: </p> <ul><li>counts of assertions <code>passed</code>, <code>ignored</code> or <code>failed</code> </li><li>a value of <code>passed</code>, <code>ignored</code> or <code>failed</code> for the <code>result</code> attribute </li><li>counts of test cases <code>passed</code>, <code>ignored</code>, <code>failed</code>, <code>skipped</code> or <code>aborted</code> </li><li>counts of test suites <code>passed</code>, <code>ignored</code>, <code>failed</code> or <code>skipped</code>? </li></ul><p> Please note the distinction between <code>skipped</code> (was not even started so no assertions have been evaluated) and <code>ignored</code> (ran to completion with one or more failed <code>BOOST_WARN</code> assertions). </p> <p> AFAIK, test suites cannot be aborted. Can they? </p> <p> In reviewing my ticket, I noticed that <code>skipped</code> and <code>aborted</code> should perhaps be added as test case result values as well. That way, the report includes everything you ever wanted to know about all test cases' and test suites' states. </p> <p> Adding the output of failed assertions would be nice too, but that's outside the scope of this ticket. </p> en-us /htdocs/site/boost.png https://svn.boost.org/trac10/ticket/6129 Trac 1.4.3 Gennadiy Rozental Tue, 13 Nov 2012 12:20:19 GMT https://svn.boost.org/trac10/ticket/6129#comment:1 https://svn.boost.org/trac10/ticket/6129#comment:1 <ul> <li><strong>status</strong> <span class="trac-field-old">new</span> → <span class="trac-field-new">closed</span> </li> <li><strong>resolution</strong> → <span class="trac-field-new">fixed</span> </li> </ul> <p> Fixed in trunk in 81320. Thank you for the submission </p> Ticket olaf.meeuwissen@… Tue, 13 Nov 2012 23:50:28 GMT