MIRRORS/poky
1
0
Fork 0
mirror of git://git.yoctoproject.org/poky.git synced 2025-07-19 12:59:02 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity

scripts/resulttool: fix ptests results containing a non reproducible path

Browse Source 
Some ptests results may be wrongly sampled, resulting in some part of the error
being propagated in test name. For example:

"ptestresult.binutils-ld.in testcase /home/pokybuild/yocto-worker/qemumips/build/build-st-1666126/tmp/work/mips32r2-poky-linux/binutils-cross-testsuite/2.40-r0/git/ld/testsuite/ld-ctf/ctf.exp"
"ptestresult.gcc.Couldn't create remote directory /tmp/runtest.455781 on ssh"
"ptestresult.gcc-libstdc++-v3.Couldn't create remote directory /tmp/runtest.3814266 on target"

While the root errors must be fixed in corresponding ptests packages for those
tests, the test results history must still be usable even with this issue

Add new filters to detect if temporary test directories (build-st-*,
/tmp/runtime.*) are present in name. If so, truncate test name. As a side
effect, it will aggregate multiple failing errors into one, but the regression
will still be raised

(From OE-Core rev: 601eecfddd26bfe2954835a73ed1116bb520235f)

Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
This commit is contained in:
Alexis Lothoré 2023-02-28 19:10:50 +01:00 committed by Richard Purdie
parent 754d270ab8
commit 1feffaf41a
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
scripts/lib/resulttool/regression.py
View File

@ -219,6 +219,12 @@ def fixup_ptest_names(results, logger):
new = test.split("_-_")[0]
elif test.startswith(("ptestresult.curl.")) and "__" in test:
new = test.split("__")[0]
elif test.startswith(("ptestresult.dbus.")) and "__" in test:
new = test.split("__")[0]
elif test.startswith("ptestresult.binutils") and "build-st-" in test:
new = test.split(" ")[0]
elif test.startswith("ptestresult.gcc") and "/tmp/runtest." in test:
new = ".".join(test.split(".")[:2])
if new:
results[r][i]['result'][new] = results[r][i]['result'][test]
del results[r][i]['result'][test]