poky/scripts/lib/resulttool
Alexis Lothoré ae1d378693 scripts/resulttool: add mention about new detected tests
Some regression reports show a lot of "PASSED->None" transitions. When such
big lot of identical transitions are observed, it could be that tests are
now failing, but it could also be that some tests has been renamed.

To detect such case, add a log in regression report to report the number of
new tests (i.e: tests that are present in target results but not in base
result). This new log also allows to know about newly added tests bases

(From OE-Core rev: 01b5cefd07e01c7407bc663842b8a8d502358a6d)

Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-07-25 15:27:33 +01:00
..
template scripts/resulttool/report: Add total statistic to test result. 2019-11-14 13:20:59 +00:00
__init__.py resulttool: enable merge, store, report and regression analysis 2019-02-21 12:34:00 +00:00
log.py resulttool: Improve overlapping ptest result reporting 2023-03-16 22:52:15 +00:00
manualexecution.py resulttool/manualexecution: Enable creation of test case configuration 2019-06-04 09:09:42 +01:00
merge.py resulttool/merge: Enable control TESTSERIES and extra configurations 2019-06-12 10:54:40 +01:00
regression.py scripts/resulttool: add mention about new detected tests 2023-07-25 15:27:33 +01:00
report.py resulttool/report: Remove leftover debugging 2020-05-27 10:22:31 +01:00
resultutils.py resulttool/resultutils: allow index generation despite corrupt json 2023-07-19 19:37:38 +01:00
store.py resulttool/store.py: Enable add extra test environment data 2019-11-14 13:20:59 +00:00