Commit Graph

218 Commits

Author SHA1 Message Date
Richard Purdie
aa81bd61c5 scripts/run-config: Add extra debug about buildtools to show when active
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-27 17:07:28 +01:00
Steve Sakoman
00df7cbc02 scripts/send-qa-email: fix bug in git push logic for yocto-testresults
We were mistakenly doing a force push if the branch was in either
BUILD_HISTORY_FORKPUSH or BUILD_HISTORY_DIRECTPUSH.

Now we force push for branches in BUILD_HISTORY_FORKPUSH, regular push
for branches in BUILD_HISTORY_DIRECTPUSH, and no push if the branch is
in neither list.

Signed-off-by: Steve Sakoman <steve@sakoman.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-23 14:43:36 +01:00
Steve Sakoman
e79f6ddafd scripts/utils.py: Fix confusing naming of getcomparisonbranch() return value
This code was copy/pasted but in this case the variables should
be called "compare", not base.

Signed-off-by: Steve Sakoman <steve@sakoman.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-23 14:42:38 +01:00
Richard Purdie
a1ea9f6e60 scripts/run-config: Resolve path early for buildtools
The buildtools path contains "../" which may not resolve correctly by the
shell if the final directory doesn't exist. Avoid this by using abspath()
on the expression straightaway.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-07 08:33:51 +01:00
Richard Purdie
a9f4f21ee9 run-config: Fix lockfile loop handling
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-12 18:13:42 +00:00
Richard Purdie
531cdb168e scripts/run-config: Fix BB_LOGFILE missing /
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-12 12:44:49 +00:00
Richard Purdie
c41c1d0c74 scripts/run-config: Ensure racing for the lockfile doesn't traceback
Traceback (most recent call last):
  File "yocto-autobuilder-helper/scripts/run-config", line 116, in <module>
    fcntl.flock(fileno, fcntl.LOCK_EX)
OSError: [Errno 22] Invalid argument

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-12 12:41:32 +00:00
Richard Purdie
1622cb7b09 scripts/run-config: Add support for local filesystem buildtools urls
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-12 11:58:13 +00:00
Richard Purdie
0902ededff scripts/run-config: Handle quoting issues in buildtools environment files
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-12 11:58:05 +00:00
Richard Purdie
8e7a052f07 scripts/run-config: Handle multiple builds racing with lockfile for buildtools
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-12 11:57:55 +00:00
Richard Purdie
37955b4b8d send-qa-email: Limit results clone to shallow depth to avoid timeouts
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-10 22:22:36 +00:00
Richard Purdie
91bd587bf3 scripts/run-config: Set BB_LOGCONFIG on autobuilder
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-09 22:43:49 +00:00
Richard Purdie
d4a9248fd0 scripts/run-config: Fix buildtools path
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-07 10:02:20 +00:00
Richard Purdie
fbdaa169c3 run-config: Add support for wrapping builds in a buildtools tarball
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-06 15:51:42 +00:00
Richard Purdie
17386f43c2 run-config: Add workername parameter
Allow the workername to be passed into the script. This is to allow future
buildtools tarball support based upon the worker.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-06 14:37:38 +00:00
Richard Purdie
ee6fc35569 build-perf/send-qa-email: Fallback to master as a comparision branch
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-01 17:44:34 +00:00
Richard Purdie
89633facc4 run-config: Preface log output with auto.conf settings to aid debugging
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-19 16:47:09 +00:00
Richard Purdie
1b78039d41 scripts/send-qa-email: Allow force pushing of basebranch based comparisions
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-08 15:25:42 +00:00
Richard Purdie
5f423e3a26 scripts/send-qa-email: Handle older git clients
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-08 14:32:10 +00:00
akuster
32218185dd yocto-autobuilder-helper: remove mpc8315 from configs
Signed-off-by: Armin Kuster <akuster808@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-02 10:38:30 +00:00
Richard Purdie
8bae4b2955 run-config/upload-error-reports: Handle builddir not existing
This fixes failures on the buildperf workers which do early cleanup of build
directories.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-12-12 13:02:57 +00:00
Richard Purdie
79dd2f94aa send-qa-email/utils: Improve new branch regression script handling
There are several issues:

* New branches don't currently have git regression history
* The regression tool errors if there isn't anything to compare against

To fix this, create a branch with history and only generate a regression
report if there are commits to compare against.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-16 16:25:43 +00:00
Richard Purdie
014a1c4b89 scripts/publish-artefact: Ensure ptest images are published
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-31 11:14:24 +00:00
Richard Purdie
aa5f3f7b39 build-perf-test-wrapper: Cannot clean up helper at this point
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-04 08:39:56 +01:00
Richard Purdie
488882ac9a build-perf-test-wrapper: Ensure worker checkout and sstate is cleaned up
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-03 16:49:56 +01:00
Richard Purdie
f54b2f5104 publish-artefacts: Update to use -alt naming for release output
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-02 10:44:51 +01:00
Richard Purdie
28ee9be07d config.py: Update -lsb -> -alt naming
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-02 10:44:00 +01:00
Richard Purdie
81b3587a90 run-config: Fix selftest tag filtering command
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-07 16:50:32 +01:00
Richard Purdie
68c19d067d config.json/run-config: Add configuration for toolchain testsuites
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 17:55:24 +01:00
Richard Purdie
718fe955c2 prepare-shared-repos: Really fix shell globbing
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 15:57:56 +01:00
Richard Purdie
e99f772fc4 prepare-shared-repos: UAllow shell globing to fix failure
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 15:45:19 +01:00
Richard Purdie
554a2114ef prepare-shared-repos: Use temporary non-NFS directory for layer clones for speed
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 15:37:43 +01:00
Richard Purdie
21ebf7df51 scripts/run-config: Add --build-type commandline option
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 14:24:04 +01:00
Thomas Goodwin
417c7d33db layer-config, shared-repo-unpack: Sub-repos in NEEDREPOS
The previous fixes requires the user to set "no-layer-add"
for a repo and then use ADDLAYER to insert the sub-repos
(e.g., meta-openmbedded/meta-oe) as a two-part process.
This means that you would also have to specify that flag
if a repo that is a layer with dependencies is in the
list so that it can be inserted in the correct order later
via ADDLAYER to avoid parsing problems.  This fix allows
for specifying a NEEDREPOS with the subdirectory of the
target layer (e.g., meta-openembedded/meta-oe) so that
there is no need for the "no-layer-add" followed by
ADDLAYER combination.  The entire meta-openembedded
repo would be moved into place, and the sublayer added
to bblayers.conf.

Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:34:48 +01:00
Thomas Goodwin
2aeb77f3f2 shared-repo-unpack: suppressing exception, returning exit code
The preceeding errors that would be shown should be enough to
identify the problem since it would have been a problem
running bitbake-layers add-layer, indicating a misconfiguration
of config.json.

Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:34:48 +01:00
Thomas Goodwin
43c2a3acc3 layer-config: fixing silent failures from always exiting '0'
The return value from bitbakecmd was not being returned when
errors occurred which allowed shared-repo-unpack to succeed
despite the failure.  This fix changes to check_call and a
try-catch when attempting to add repos that fail for whatever
reason during add-layer, like a missing conf/layer.conf at
the top level or a previously-added layer breaks parsing
because of missing dependencies.

Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:34:48 +01:00
Richard Purdie
7689893bb3 generate-testresult-index: Handle build performance without reports
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-06-05 16:55:12 +01:00
Richard Purdie
1b3e3ced9f scripts: Add script to generate autobuilder results index
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-06-05 16:43:24 +01:00
Richard Purdie
becdbd3729 utils: Fix incorrect module usage
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 18:21:51 +01:00
Richard Purdie
68f351ed83 run-config: Fix uninitalized variable problem
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 18:17:16 +01:00
Richard Purdie
f9bdcf888f config.json/utils: Allow buildhistory to be configurable and disable for oe-selftest in qemu-arch
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 16:23:54 +01:00
Richard Purdie
a93a79945f scripts/collect-results: Ensure selftest doesn't trigger buildhistory results collection
Affects sumo since that doesn't have oe-selftest parallelism. thud/master create
these in a different location so don't see the issue.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-03-25 10:07:21 +00:00
Richard Purdie
372282eb6b scripts/publish-artefacts: Ensure aarch64 uninative is published
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-03-19 15:24:33 +00:00
Richard Purdie
520ea457e8 send-qa-email: Fix typo causing wrong report contents to be written
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-25 09:34:22 +00:00
Richard Purdie
2deb018441 send-qa-email: Be specific about which test result branches to push
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-23 22:53:50 +00:00
Richard Purdie
f19aa61cd6 buildhistory-init/collect-results: Use a tag to make buildhistory data consistent
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-23 17:23:52 +00:00
Richard Purdie
a0963045de scripts/utils: Simplify buildhistory path, no need for such deep paths
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-22 00:07:37 +00:00
Richard Purdie
e67a6aab27 send-qa-report: Add handling of results files with resulttool
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:19:02 +00:00
Richard Purdie
13eb8eb282 scripts/send-qa-email: Add optional -R option for test results directory
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:13:16 +00:00
Richard Purdie
5130ab9f21 utils: Move getcomparisonbranch() to common function library
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:13:16 +00:00