Commit Graph

269 Commits

Author SHA1 Message Date
Richard Purdie
520ea457e8 send-qa-email: Fix typo causing wrong report contents to be written
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-25 09:34:22 +00:00
Richard Purdie
2deb018441 send-qa-email: Be specific about which test result branches to push
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-23 22:53:50 +00:00
Richard Purdie
f19aa61cd6 buildhistory-init/collect-results: Use a tag to make buildhistory data consistent
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-23 17:23:52 +00:00
Richard Purdie
a0963045de scripts/utils: Simplify buildhistory path, no need for such deep paths
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-22 00:07:37 +00:00
Richard Purdie
c4b12405b5 config.json: Tweak buildstats push url
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 20:49:45 +00:00
Richard Purdie
5f003ff4e6 config.json: Push buildperf data to the yocto-buildstats repo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:28:46 +00:00
Richard Purdie
e67a6aab27 send-qa-report: Add handling of results files with resulttool
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:19:02 +00:00
Richard Purdie
13eb8eb282 scripts/send-qa-email: Add optional -R option for test results directory
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:13:16 +00:00
Richard Purdie
5130ab9f21 utils: Move getcomparisonbranch() to common function library
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:13:16 +00:00
Richard Purdie
e1564ff86c collect-results: Generate buildhistory-diff output
Since we now have functional buildhistory repository functionality,
generate buildhistory-diff output for builds where its enabled.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 13:50:26 +00:00
Richard Purdie
dca5a89ca9 janitor/clobberdir: Fix case where clobber directory isn't a local path to the trash directory
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-15 18:00:20 +00:00
Richard Purdie
c0a1bfe54c config.json: Update Stephen's email address
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-12 21:46:55 +00:00
Richard Purdie
e5310650b0 scripts/utils: Ensure list filtering code doesn't match appends/prepends
We want all INHERIT += to apply for example

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-12 14:18:09 +00:00
Richard Purdie
700f297cd5 build-perf-test-wrapper: Print URL data is published to in output
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-12 12:47:35 +00:00
Richard Purdie
73050e1bb5 config.json: Build performance measurements only use rpm packaging
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-12 12:47:12 +00:00
Richard Purdie
7d8b47637b config.json: Use x86_64 SDKMACHINE for buildperf tests
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-11 13:11:27 +00:00
Richard Purdie
5a2eddd6bd setup-config/utils: Improve extravars handling
Currently there was no way to override an existing extra vars
assignment, which meant BB_NUMBER_THREADS was impossible to change.

This adds code to allow the higher override of a value to override
the other settings which makes the code function more as a user
would expect.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-11 11:05:49 +00:00
Richard Purdie
76411cd131 config.json: Make the perf thread counts match what was being tested
Due to the previous bug the configuration being tested didn't quite match.
Work around this by making them match for now.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-11 11:04:38 +00:00
Richard Purdie
28ad5cdcc9 build-perf-test-wrapper: Place auto.conf into the correct location
Currently it was being placed a directory level too high and hence
was being ignored.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-11 11:03:52 +00:00
Richard Purdie
e1b505f006 build-perf-test-wrapper: Fix branch comparision code
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-10 08:50:26 +00:00
Richard Purdie
3dfa90c4ba build-perf-test-wrapper: Fix to use full commit hashes and short repo names
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-10 08:18:00 +00:00
Richard Purdie
5e62bc3f9c build-perf-test-wrapper: Fix missing module reference
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-09 21:18:03 +00:00
Richard Purdie
72b22dc785 config.json/run-config/build-perf-test-wrapper: Allow build performance branch comparisions
This ensures that release branch performance build tests work on the correct
branch and that comparisions between mut+master and master-next+master
start to work correctly. It also ensures reports for the current
revision are generated even if later revisions are built.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-09 17:24:16 +00:00
Richard Purdie
07d4e99b6d build-perf-test-wrapper: Fix missing variable
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-08 23:14:57 +00:00
Richard Purdie
9a62bbf6b4 build-perf-test-wrapper: Add HTML link to published text report
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-08 14:02:55 +00:00
Richard Purdie
6fbc1321a0 config.json/run-config: Ensure build-perf publish-dir contains the target name
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-05 22:22:46 +00:00
Richard Purdie
d4f649024d build-perf-test-wrapper: Fix report path names
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 20:40:20 +00:00
Richard Purdie
1d8d6b70fa build-perf-test-wrapper: Further variable cleanup
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 16:12:50 +00:00
Richard Purdie
c865dbb73e build-perf-test-wrapper: Clean up path option handling and directory creation
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 15:25:21 +00:00
Richard Purdie
9a458fb546 config.json: Ensure buildperf doesn't use a common sstate
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 15:10:31 +00:00
Richard Purdie
ca730319a9 build-perf-test-wrapper: Handle the case where /bin/sh is dash
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-04 15:10:31 +00:00
Richard Purdie
72ee261692 build-perf-test-wrapper: Fix path joining issues
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-03 22:13:18 +00:00
Richard Purdie
852ebb4889 build-perf-test-wrapper: Fix report path names to account for build directory
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-03 15:38:22 +00:00
Richard Purdie
4fda3f2816 build-perf-test-wrapper: Ensure scripts within OE-Core are available within PATH
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-03 11:29:07 +00:00
Richard Purdie
e0770f4b55 scripts: Convert build-perf-test-wrapper from shell to python
The shell script can't access the config.json data easily, convert
from shell to python so that we prepare the way for further enhancements.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-02 11:42:52 +00:00
Richard Purdie
efeb042a77 config.json/build-perf-test-wrapper.sh: Add support for publishing to the standard results location
This makes the build performance code behave similarly to the other
results publishing code using the standard location.

Also tweak the report names so they sort.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-01 15:18:57 +00:00
Richard Purdie
b480d77271 scripts/run-config: Allow command failures to be non-fatal
We need the final logging to show which command steps contain errors so print
failing commands but allow the code to continue and show the final log output.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-31 12:57:54 +00:00
Richard Purdie
81382c6c5d scripts/run-config: Always run bitbake with -k option
This ensures the builds get as far as they can when there is failure rather
that stopping at the first sign of one. This means caches are hotter and
allows for faster respins, at the cost of the failure being lost in longer
logs.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-31 12:53:00 +00:00
Richard Purdie
69b8ac6c27 build-perf-test-wrapper: Ensure download_dir exists
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-22 23:09:26 +00:00
Richard Purdie
6e078513b7 build-perf-test-wrapper: Remove code we don't need
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-22 23:02:13 +00:00
Richard Purdie
f022d37f70 build-perf-test-wrapper/report-email: Tweak for ab-helper usage
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-22 23:01:57 +00:00
Richard Purdie
fbe172bbdf scripts: Import build-perf scripts from oe-core
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-22 22:58:11 +00:00
Richard Purdie
337cd8ee97 config.json: Ensure the downloads and global results files are preserved
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-20 11:56:39 +00:00
Richard Purdie
740f12b1a2 config.json: Add first pass at entries for build performance workers
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-18 14:53:10 +00:00
Richard Purdie
d36deb8543 run-config: Ensure log directory (builddir) exists
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-12-26 11:34:03 +00:00
Richard Purdie
6a7d53e080 config.json: Update QA email notification list
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-12-18 15:54:22 +00:00
Richard Purdie
1f51bb1b46 config.json: Disable PRSERV for trigger-build template to avoid selftest error
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-12-05 11:06:55 +00:00
Richard Purdie
c15036a418 config.json: Move the SourceMirroring test to the end of the quick/full targets
Also take the opportunity to turn these targets into a template and
reduce duplication.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-12-04 12:34:47 +00:00
Richard Purdie
4e1cf4612d config.json: Change mingw to build 32 and 64 bit versions and test 64 bit
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-22 17:32:03 +00:00
Richard Purdie
18bd737233 config.json: Fix meta-oe layer ordering
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-22 16:52:53 +00:00