Opened 9 years ago
Closed 8 years ago
#8591 closed Bugs (wontfix)
Incremental test runs do not detect test removal or configuration changes
| Reported by: | Andrey Semashev | Owned by: | René Rivera |
|---|---|---|---|
| Milestone: | To Be Determined | Component: | Regression Testing USE GITHUB |
| Version: | Boost Development Trunk | Severity: | Problem |
| Keywords: | Cc: |
Description
There are two problems that can be seen on this page that stem from the same source:
- The util_dynamic_type_dispatcher and util_static_type_dispatcher tests were renamed to util_dynamic_type_disp and util_static_type_disp in SVN, but they are still present in the test matrix for incremental runners.
- The RDC-VC10 test runner shows test failures that correspond to an older revision than the tests were reportedly run. When clicking on the failed tests it can be seen that there are several test variants and the failed one should not be built according to the current library configuration.
I believe both problems are because incremental test runs don't detect that a certain test or configuration no longer exist (or run) and re-collect the outdated results into the test matrix.
Note:
See TracTickets
for help on using tickets.
This is somewhat of an intractable problem.. Or rather really hard to fix.