Commit Graph

169 Commits

Author SHA1 Message Date
Richard Purdie
5130ab9f21 utils: Move getcomparisonbranch() to common function library
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:13:16 +00:00
Richard Purdie
e1564ff86c collect-results: Generate buildhistory-diff output
Since we now have functional buildhistory repository functionality,
generate buildhistory-diff output for builds where its enabled.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 13:50:26 +00:00
Richard Purdie
e5310650b0 scripts/utils: Ensure list filtering code doesn't match appends/prepends
We want all INHERIT += to apply for example

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-12 14:18:09 +00:00
Richard Purdie
700f297cd5 build-perf-test-wrapper: Print URL data is published to in output
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-12 12:47:35 +00:00
Richard Purdie
5a2eddd6bd setup-config/utils: Improve extravars handling
Currently there was no way to override an existing extra vars
assignment, which meant BB_NUMBER_THREADS was impossible to change.

This adds code to allow the higher override of a value to override
the other settings which makes the code function more as a user
would expect.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-11 11:05:49 +00:00
Richard Purdie
28ad5cdcc9 build-perf-test-wrapper: Place auto.conf into the correct location
Currently it was being placed a directory level too high and hence
was being ignored.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-11 11:03:52 +00:00
Richard Purdie
e1b505f006 build-perf-test-wrapper: Fix branch comparision code
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-10 08:50:26 +00:00
Richard Purdie
3dfa90c4ba build-perf-test-wrapper: Fix to use full commit hashes and short repo names
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-10 08:18:00 +00:00
Richard Purdie
5e62bc3f9c build-perf-test-wrapper: Fix missing module reference
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-09 21:18:03 +00:00
Richard Purdie
72b22dc785 config.json/run-config/build-perf-test-wrapper: Allow build performance branch comparisions
This ensures that release branch performance build tests work on the correct
branch and that comparisions between mut+master and master-next+master
start to work correctly. It also ensures reports for the current
revision are generated even if later revisions are built.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-09 17:24:16 +00:00
Richard Purdie
07d4e99b6d build-perf-test-wrapper: Fix missing variable
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-08 23:14:57 +00:00
Richard Purdie
9a62bbf6b4 build-perf-test-wrapper: Add HTML link to published text report
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-08 14:02:55 +00:00
Richard Purdie
6fbc1321a0 config.json/run-config: Ensure build-perf publish-dir contains the target name
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-05 22:22:46 +00:00
Richard Purdie
d4f649024d build-perf-test-wrapper: Fix report path names
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 20:40:20 +00:00
Richard Purdie
1d8d6b70fa build-perf-test-wrapper: Further variable cleanup
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 16:12:50 +00:00
Richard Purdie
c865dbb73e build-perf-test-wrapper: Clean up path option handling and directory creation
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 15:25:21 +00:00
Richard Purdie
ca730319a9 build-perf-test-wrapper: Handle the case where /bin/sh is dash
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 15:10:31 +00:00
Richard Purdie
72ee261692 build-perf-test-wrapper: Fix path joining issues
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-03 22:13:18 +00:00
Richard Purdie
852ebb4889 build-perf-test-wrapper: Fix report path names to account for build directory
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-03 15:38:22 +00:00
Richard Purdie
4fda3f2816 build-perf-test-wrapper: Ensure scripts within OE-Core are available within PATH
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-03 11:29:07 +00:00
Richard Purdie
e0770f4b55 scripts: Convert build-perf-test-wrapper from shell to python
The shell script can't access the config.json data easily, convert
from shell to python so that we prepare the way for further enhancements.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-02 11:42:52 +00:00
Richard Purdie
efeb042a77 config.json/build-perf-test-wrapper.sh: Add support for publishing to the standard results location
This makes the build performance code behave similarly to the other
results publishing code using the standard location.

Also tweak the report names so they sort.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-01 15:18:57 +00:00
Richard Purdie
b480d77271 scripts/run-config: Allow command failures to be non-fatal
We need the final logging to show which command steps contain errors so print
failing commands but allow the code to continue and show the final log output.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-31 12:57:54 +00:00
Richard Purdie
81382c6c5d scripts/run-config: Always run bitbake with -k option
This ensures the builds get as far as they can when there is failure rather
that stopping at the first sign of one. This means caches are hotter and
allows for faster respins, at the cost of the failure being lost in longer
logs.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-31 12:53:00 +00:00
Richard Purdie
69b8ac6c27 build-perf-test-wrapper: Ensure download_dir exists
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-22 23:09:26 +00:00
Richard Purdie
6e078513b7 build-perf-test-wrapper: Remove code we don't need
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-22 23:02:13 +00:00
Richard Purdie
f022d37f70 build-perf-test-wrapper/report-email: Tweak for ab-helper usage
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-22 23:01:57 +00:00
Richard Purdie
fbe172bbdf scripts: Import build-perf scripts from oe-core
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-22 22:58:11 +00:00
Richard Purdie
d36deb8543 run-config: Ensure log directory (builddir) exists
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-12-26 11:34:03 +00:00
Richard Purdie
d6049a972f publish-artefacts: Fix an incorrect target directory for qemux86-64-lsb
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-21 17:38:38 +00:00
Richard Purdie
a1e1525178 config.json/publish-artefacts: Split qemu machines from real hardware and drop nightly prefix+rename
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-21 15:32:38 +00:00
Richard Purdie
dfd07f06f8 scripts/run-config: Ensure we rename the build directory before exitting when failing
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-21 11:47:46 +00:00
Richard Purdie
e9b855fe8c scripts: Add results collection script and option in run-config 2018-11-20 23:32:09 +00:00
Richard Purdie
10b47e4928 run-config: Fix missing / typo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-20 15:24:42 +00:00
Richard Purdie
37b3943ca7 scripts/run-config: Rename any completed build directory so that other builds can't reference paths within it
This should further protect us against contamination between different build directories
as old build directory paths should no longer exist.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-20 14:52:00 +00:00
Richard Purdie
9e181c3ebb run-config: Remove successful build directories straight away
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-20 14:50:35 +00:00
Richard Purdie
19bd8ebfee setup-config: Also set HELPERBUILDDIR
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-11 09:26:51 +00:00
Richard Purdie
3c57c77a77 run-config: Fix typo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-10 14:45:26 +00:00
Richard Purdie
885d79c393 config.json/run-config: Add HELPERBUILDDIR and fix sstate reuse for nightly-bringup
There is no current mechanism to reference the 'builddir' within the config.json,
so add HELPERBUILDDIR for this purpose.

Use this to set SSTATEDIR for nightly-bringup, meaning sstate arefacts should be
shared for use between the different oe-selftest threads, speeding up builds.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-10 14:42:07 +00:00
Richard Purdie
7f6a3b7fba scripts/utils: Fix string/float combination error
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-09 14:17:10 +00:00
Richard Purdie
dabf9d6e20 scripts/utils: Fix variable name conflict
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-09 14:14:34 +00:00
Richard Purdie
8ce219dda5 run-config/utils: Allow headers to show the difference in time since the previous header
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-09 14:06:52 +00:00
Richard Purdie
df2e005030 scripts/setup-config: Allow SSTATEDIR to unset
The SSTATEDIR was accidentally using getconfiglist instead of getconfigvar which
meant it couldn't be unset. Fix to use var so the values in config.json work
as intended.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-08 21:22:01 +00:00
Richard Purdie
478eb6d78c scripts/run-config: Export SCRIPTSDIR to avoid scripts having to mess with paths
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-08 20:45:56 +00:00
Richard Purdie
5fe0e21b8a scripts/send-qa-email: Handle systems with sendmail in sbin
Many of the distros we use have sendmail in /sbin or /usr/sbin
which may not be in the path for non-interactive users. Handle
this in the script to avoid failures where tests work but the
real QA email fails.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-05 16:57:37 +00:00
Richard Purdie
e23d0b3ab2 scripts/setup-config: Ensure PACKAGE_CLASSES is set
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-10-10 11:40:41 +01:00
Richard Purdie
b27ef9a53d run-config: Renumber the log files to match step numbers
Also print a summary of the logfiles which contain failures.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-05 14:11:33 +01:00
Aaron Chan
842def0599 publish-artefacts: Add deployment BSP support on x86_64
Add in the support to publish images into the designated path.
BSP packages of the previous build will be cleaned up before
new BSP packages are copied over. This ensures the previous
image will not be retained and causes conflicts before image
is loaded into x86_64 (MTURBOT64) hardware.

Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30 16:21:51 +01:00
Paul Eggleton
d7d1a2b345 scripts: use argparse for command line parsing
[RP: Minor tweaks made to adpat to buildbot and option naming

Fixed shared-repo-unpack for publishing when no cache-dir supplied]

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30 14:36:07 +01:00
Richard Purdie
c41c2e0a5a run-config: Add a new option to control echoing of log output
The new buildbot code can directly monitor the logfiles itself so
we need to be able to optionally stop echoing onto the console.

Add missing flush() calls and print the command being used and logfile
so its clear what is happening on stdout too.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30 13:25:05 +01:00