Commit Graph

197 Commits

Author SHA1 Message Date
Richard Purdie
79dd2f94aa send-qa-email/utils: Improve new branch regression script handling
There are several issues:

* New branches don't currently have git regression history
* The regression tool errors if there isn't anything to compare against

To fix this, create a branch with history and only generate a regression
report if there are commits to compare against.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-16 16:25:43 +00:00
Richard Purdie
014a1c4b89 scripts/publish-artefact: Ensure ptest images are published
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-31 11:14:24 +00:00
Richard Purdie
aa5f3f7b39 build-perf-test-wrapper: Cannot clean up helper at this point
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-04 08:39:56 +01:00
Richard Purdie
488882ac9a build-perf-test-wrapper: Ensure worker checkout and sstate is cleaned up
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-03 16:49:56 +01:00
Richard Purdie
f54b2f5104 publish-artefacts: Update to use -alt naming for release output
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-02 10:44:51 +01:00
Richard Purdie
28ee9be07d config.py: Update -lsb -> -alt naming
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-02 10:44:00 +01:00
Richard Purdie
81b3587a90 run-config: Fix selftest tag filtering command
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-07 16:50:32 +01:00
Richard Purdie
68c19d067d config.json/run-config: Add configuration for toolchain testsuites
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 17:55:24 +01:00
Richard Purdie
718fe955c2 prepare-shared-repos: Really fix shell globbing
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 15:57:56 +01:00
Richard Purdie
e99f772fc4 prepare-shared-repos: UAllow shell globing to fix failure
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 15:45:19 +01:00
Richard Purdie
554a2114ef prepare-shared-repos: Use temporary non-NFS directory for layer clones for speed
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 15:37:43 +01:00
Richard Purdie
21ebf7df51 scripts/run-config: Add --build-type commandline option
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 14:24:04 +01:00
Thomas Goodwin
417c7d33db layer-config, shared-repo-unpack: Sub-repos in NEEDREPOS
The previous fixes requires the user to set "no-layer-add"
for a repo and then use ADDLAYER to insert the sub-repos
(e.g., meta-openmbedded/meta-oe) as a two-part process.
This means that you would also have to specify that flag
if a repo that is a layer with dependencies is in the
list so that it can be inserted in the correct order later
via ADDLAYER to avoid parsing problems.  This fix allows
for specifying a NEEDREPOS with the subdirectory of the
target layer (e.g., meta-openembedded/meta-oe) so that
there is no need for the "no-layer-add" followed by
ADDLAYER combination.  The entire meta-openembedded
repo would be moved into place, and the sublayer added
to bblayers.conf.

Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:34:48 +01:00
Thomas Goodwin
2aeb77f3f2 shared-repo-unpack: suppressing exception, returning exit code
The preceeding errors that would be shown should be enough to
identify the problem since it would have been a problem
running bitbake-layers add-layer, indicating a misconfiguration
of config.json.

Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:34:48 +01:00
Thomas Goodwin
43c2a3acc3 layer-config: fixing silent failures from always exiting '0'
The return value from bitbakecmd was not being returned when
errors occurred which allowed shared-repo-unpack to succeed
despite the failure.  This fix changes to check_call and a
try-catch when attempting to add repos that fail for whatever
reason during add-layer, like a missing conf/layer.conf at
the top level or a previously-added layer breaks parsing
because of missing dependencies.

Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:34:48 +01:00
Richard Purdie
7689893bb3 generate-testresult-index: Handle build performance without reports
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-06-05 16:55:12 +01:00
Richard Purdie
1b3e3ced9f scripts: Add script to generate autobuilder results index
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-06-05 16:43:24 +01:00
Richard Purdie
becdbd3729 utils: Fix incorrect module usage
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 18:21:51 +01:00
Richard Purdie
68f351ed83 run-config: Fix uninitalized variable problem
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 18:17:16 +01:00
Richard Purdie
f9bdcf888f config.json/utils: Allow buildhistory to be configurable and disable for oe-selftest in qemu-arch
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 16:23:54 +01:00
Richard Purdie
a93a79945f scripts/collect-results: Ensure selftest doesn't trigger buildhistory results collection
Affects sumo since that doesn't have oe-selftest parallelism. thud/master create
these in a different location so don't see the issue.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-03-25 10:07:21 +00:00
Richard Purdie
372282eb6b scripts/publish-artefacts: Ensure aarch64 uninative is published
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-03-19 15:24:33 +00:00
Richard Purdie
520ea457e8 send-qa-email: Fix typo causing wrong report contents to be written
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-25 09:34:22 +00:00
Richard Purdie
2deb018441 send-qa-email: Be specific about which test result branches to push
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-23 22:53:50 +00:00
Richard Purdie
f19aa61cd6 buildhistory-init/collect-results: Use a tag to make buildhistory data consistent
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-23 17:23:52 +00:00
Richard Purdie
a0963045de scripts/utils: Simplify buildhistory path, no need for such deep paths
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-22 00:07:37 +00:00
Richard Purdie
e67a6aab27 send-qa-report: Add handling of results files with resulttool
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:19:02 +00:00
Richard Purdie
13eb8eb282 scripts/send-qa-email: Add optional -R option for test results directory
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:13:16 +00:00
Richard Purdie
5130ab9f21 utils: Move getcomparisonbranch() to common function library
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:13:16 +00:00
Richard Purdie
e1564ff86c collect-results: Generate buildhistory-diff output
Since we now have functional buildhistory repository functionality,
generate buildhistory-diff output for builds where its enabled.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 13:50:26 +00:00
Richard Purdie
e5310650b0 scripts/utils: Ensure list filtering code doesn't match appends/prepends
We want all INHERIT += to apply for example

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-12 14:18:09 +00:00
Richard Purdie
700f297cd5 build-perf-test-wrapper: Print URL data is published to in output
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-12 12:47:35 +00:00
Richard Purdie
5a2eddd6bd setup-config/utils: Improve extravars handling
Currently there was no way to override an existing extra vars
assignment, which meant BB_NUMBER_THREADS was impossible to change.

This adds code to allow the higher override of a value to override
the other settings which makes the code function more as a user
would expect.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-11 11:05:49 +00:00
Richard Purdie
28ad5cdcc9 build-perf-test-wrapper: Place auto.conf into the correct location
Currently it was being placed a directory level too high and hence
was being ignored.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-11 11:03:52 +00:00
Richard Purdie
e1b505f006 build-perf-test-wrapper: Fix branch comparision code
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-10 08:50:26 +00:00
Richard Purdie
3dfa90c4ba build-perf-test-wrapper: Fix to use full commit hashes and short repo names
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-10 08:18:00 +00:00
Richard Purdie
5e62bc3f9c build-perf-test-wrapper: Fix missing module reference
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-09 21:18:03 +00:00
Richard Purdie
72b22dc785 config.json/run-config/build-perf-test-wrapper: Allow build performance branch comparisions
This ensures that release branch performance build tests work on the correct
branch and that comparisions between mut+master and master-next+master
start to work correctly. It also ensures reports for the current
revision are generated even if later revisions are built.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-09 17:24:16 +00:00
Richard Purdie
07d4e99b6d build-perf-test-wrapper: Fix missing variable
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-08 23:14:57 +00:00
Richard Purdie
9a62bbf6b4 build-perf-test-wrapper: Add HTML link to published text report
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-08 14:02:55 +00:00
Richard Purdie
6fbc1321a0 config.json/run-config: Ensure build-perf publish-dir contains the target name
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-05 22:22:46 +00:00
Richard Purdie
d4f649024d build-perf-test-wrapper: Fix report path names
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 20:40:20 +00:00
Richard Purdie
1d8d6b70fa build-perf-test-wrapper: Further variable cleanup
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 16:12:50 +00:00
Richard Purdie
c865dbb73e build-perf-test-wrapper: Clean up path option handling and directory creation
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 15:25:21 +00:00
Richard Purdie
ca730319a9 build-perf-test-wrapper: Handle the case where /bin/sh is dash
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 15:10:31 +00:00
Richard Purdie
72ee261692 build-perf-test-wrapper: Fix path joining issues
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-03 22:13:18 +00:00
Richard Purdie
852ebb4889 build-perf-test-wrapper: Fix report path names to account for build directory
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-03 15:38:22 +00:00
Richard Purdie
4fda3f2816 build-perf-test-wrapper: Ensure scripts within OE-Core are available within PATH
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-03 11:29:07 +00:00
Richard Purdie
e0770f4b55 scripts: Convert build-perf-test-wrapper from shell to python
The shell script can't access the config.json data easily, convert
from shell to python so that we prepare the way for further enhancements.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-02 11:42:52 +00:00
Richard Purdie
efeb042a77 config.json/build-perf-test-wrapper.sh: Add support for publishing to the standard results location
This makes the build performance code behave similarly to the other
results publishing code using the standard location.

Also tweak the report names so they sort.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-01 15:18:57 +00:00