Boost C++ Libraries: Ticket #11845: Ability to generate the unique and stable test name for every data set in BOOST_DATA_TEST_CASE https://svn.boost.org/trac10/ticket/11845 <p> Ability to generate the unique and stable test name for every data item in BOOST_DATA_TEST_CASE. </p> <p> In this example will be run 3 tests with name "T": </p> <pre class="wiki">BOOST_DATA_TEST_CASE(TTT, std::vector&lt;char const *&gt;({"A", "B", "C"}), PPP) { } </pre><p> There is no way to understand which parameter <code>PPP</code> was used for every test until test will be failed (our case is <code>log_level::log_test_units</code>, because <code>log_level::log_successful_tests</code> generate too many unnecessary messages). </p> <p> Output for <code>log_level::log_test_units</code>: </p> <pre class="wiki">Entering test case "TTT" Leaving test case "TTT"; testing time: 1ms Entering test case "TTT" Leaving test case "TTT"; testing time: 1ms Entering test case "TTT" Leaving test case "TTT"; testing time: 1ms </pre><p> Almost all continues integration tools can collect test statistics by its name. But <code>test_unit_start()/test_unit_finish()</code> from <code>boost::unit_test::unit_test_log_formatter</code> has no test data and has no access to the test context. It means that continues integration tools can receive only the information about test <code>TTT</code> which was run 3 times. It's not truth. </p> <p> It's possible to inject test name customizer for <code>m_tc_name</code> <a class="ext-link" href="https://github.com/boostorg/test/blob/9dead6da674e919710e670a75e9d23805842a415/include/boost/test/data/test_case.hpp#L102"><span class="icon">​</span>here</a>. </p> en-us Boost C++ Libraries /htdocs/site/boost.png https://svn.boost.org/trac10/ticket/11845 Trac 1.4.3 Raffi Enficiaud Tue, 02 Feb 2016 08:20:40 GMT version changed https://svn.boost.org/trac10/ticket/11845#comment:1 https://svn.boost.org/trac10/ticket/11845#comment:1 <ul> <li><strong>version</strong> <span class="trac-field-old">Boost 1.59.0</span> → <span class="trac-field-new">Boost 1.61.0</span> </li> </ul> Ticket Raffi Enficiaud Tue, 02 Feb 2016 08:20:54 GMT version, milestone changed https://svn.boost.org/trac10/ticket/11845#comment:2 https://svn.boost.org/trac10/ticket/11845#comment:2 <ul> <li><strong>version</strong> <span class="trac-field-old">Boost 1.61.0</span> → <span class="trac-field-new">Boost 1.59.0</span> </li> <li><strong>milestone</strong> <span class="trac-field-old">To Be Determined</span> → <span class="trac-field-new">Boost 1.61.0</span> </li> </ul> Ticket Raffi Enficiaud Thu, 31 Mar 2016 23:15:23 GMT milestone changed https://svn.boost.org/trac10/ticket/11845#comment:3 https://svn.boost.org/trac10/ticket/11845#comment:3 <ul> <li><strong>milestone</strong> <span class="trac-field-old">Boost 1.61.0</span> → <span class="trac-field-new">Boost 1.62.0</span> </li> </ul> Ticket Raffi Enficiaud Thu, 18 Aug 2016 00:47:25 GMT <link>https://svn.boost.org/trac10/ticket/11845#comment:4 </link> <guid isPermaLink="false">https://svn.boost.org/trac10/ticket/11845#comment:4</guid> <description> <p> Each data test case now has its own name: </p> <ul><li>the name provided in <pre class="wiki">BOOST_DATA_TEST_CASE(TTT, std::vector&lt;char const *&gt;({"A", "B", "C"}), PPP) </pre>defines a test suite TTT </li><li>each sample of the dataset is a test case that is a child of the previous test suite, with names in "_0", "_1", etc. </li></ul><p> Currently on develop and master (rev a8fa08b9b78516b78458ecb8b005d520a0c173f7) </p> </description> <category>Ticket</category> </item> <item> <dc:creator>Raffi Enficiaud</dc:creator> <pubDate>Thu, 18 Aug 2016 00:50:41 GMT</pubDate> <title>owner changed https://svn.boost.org/trac10/ticket/11845#comment:5 https://svn.boost.org/trac10/ticket/11845#comment:5 <ul> <li><strong>owner</strong> changed from <span class="trac-author">Gennadiy Rozental</span> to <span class="trac-author">Raffi Enficiaud</span> </li> </ul> Ticket Raffi Enficiaud Thu, 18 Aug 2016 00:51:04 GMT status changed https://svn.boost.org/trac10/ticket/11845#comment:6 https://svn.boost.org/trac10/ticket/11845#comment:6 <ul> <li><strong>status</strong> <span class="trac-field-old">new</span> → <span class="trac-field-new">assigned</span> </li> </ul> Ticket Raffi Enficiaud Thu, 29 Sep 2016 13:40:36 GMT status changed; resolution set https://svn.boost.org/trac10/ticket/11845#comment:7 https://svn.boost.org/trac10/ticket/11845#comment:7 <ul> <li><strong>status</strong> <span class="trac-field-old">assigned</span> → <span class="trac-field-new">closed</span> </li> <li><strong>resolution</strong> → <span class="trac-field-new">fixed</span> </li> </ul> <p> Released in 1.62 </p> Ticket mikhail@… Fri, 30 Sep 2016 23:28:15 GMT status, severity, version, milestone, type changed; resolution deleted https://svn.boost.org/trac10/ticket/11845#comment:8 https://svn.boost.org/trac10/ticket/11845#comment:8 <ul> <li><strong>status</strong> <span class="trac-field-old">closed</span> → <span class="trac-field-new">reopened</span> </li> <li><strong>severity</strong> <span class="trac-field-old">Problem</span> → <span class="trac-field-new">Regression</span> </li> <li><strong>resolution</strong> <span class="trac-field-deleted">fixed</span> </li> <li><strong>version</strong> <span class="trac-field-old">Boost 1.59.0</span> → <span class="trac-field-new">Boost 1.62.0</span> </li> <li><strong>milestone</strong> <span class="trac-field-old">Boost 1.62.0</span> → <span class="trac-field-new">Boost 1.63.0</span> </li> <li><strong>type</strong> <span class="trac-field-old">Feature Requests</span> → <span class="trac-field-new">Bugs</span> </li> </ul> <p> I was very upset when have seen the result. There is no more test name! I got numbers from 0 to 74 for my 7 data case tests in one test suite. There is more ability to understand which test was failed! Could you please return the test name back and keep numbers? But please make separate numeration for each data case test! This is very important! </p> Ticket mikhail@… Fri, 30 Sep 2016 23:32:21 GMT <link>https://svn.boost.org/trac10/ticket/11845#comment:9 </link> <guid isPermaLink="false">https://svn.boost.org/trac10/ticket/11845#comment:9</guid> <description> <p> Sorry for mistake: There is NO more ability to understand which test was failed! </p> </description> <category>Ticket</category> </item> <item> <author>mikhail@…</author> <pubDate>Fri, 30 Sep 2016 23:40:39 GMT</pubDate> <title>version, type, severity, milestone changed https://svn.boost.org/trac10/ticket/11845#comment:10 https://svn.boost.org/trac10/ticket/11845#comment:10 <ul> <li><strong>version</strong> <span class="trac-field-old">Boost 1.62.0</span> → <span class="trac-field-new">Boost 1.59.0</span> </li> <li><strong>type</strong> <span class="trac-field-old">Bugs</span> → <span class="trac-field-new">Feature Requests</span> </li> <li><strong>severity</strong> <span class="trac-field-old">Regression</span> → <span class="trac-field-new">Problem</span> </li> <li><strong>milestone</strong> <span class="trac-field-old">Boost 1.63.0</span> → <span class="trac-field-new">Boost 1.62.0</span> </li> </ul> <p> I'm very very sorry. I haven't seen that you create virtual test suite with test name. Unfortunately, I can't close the ticket. Could you please close it again? </p> Ticket Raffi Enficiaud Sat, 01 Oct 2016 06:55:28 GMT status changed; resolution set https://svn.boost.org/trac10/ticket/11845#comment:11 https://svn.boost.org/trac10/ticket/11845#comment:11 <ul> <li><strong>status</strong> <span class="trac-field-old">reopened</span> → <span class="trac-field-new">closed</span> </li> <li><strong>resolution</strong> → <span class="trac-field-new">fixed</span> </li> </ul> <p> Hi, </p> <p> Next time I suggest you read the change log more carefully. Thanks. </p> Ticket