Commit Graph

51 Commits

Author SHA1 Message Date
Richard Purdie
23d65680f8 run-config: Adapt to two pass execution
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:32:26 +00:00
Richard Purdie
eb295f62f1 utils: Teach buildtools script handling about unset
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-23 08:53:19 +01:00
Richard Purdie
e47a9a26f5 scripts/send-qa-email,utils: Use buildtools if present
resulttool has python version requirements so use buildtools if present.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-17 07:44:46 +01:00
Richard Purdie
a677305551 scripts/utils: Ensuring new logging is flushed from buffers
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-08-24 18:31:10 +01:00
Richard Purdie
f3892fac1e scripts/utils: Add more logging for fetchgitrepo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-08-24 18:27:56 +01:00
Richard Purdie
4c9358ac78 scripts/utils: Ensure buildtools tarball hash matches any supplied value
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-07-14 22:42:25 +01:00
Vineela
3aefa5a763 scripts/utils.py: Convert md5sum to sha256sum for layer tarballs
Signed-off-by: Vineela Tummalapalli <vineela.tummalapalli@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-06-26 21:33:42 +01:00
Richard Purdie
033ae6ffbd scripts/run-config: Share buildtools setup code with shared-repo-unpack
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-27 19:05:11 +01:00
Steve Sakoman
e79f6ddafd scripts/utils.py: Fix confusing naming of getcomparisonbranch() return value
This code was copy/pasted but in this case the variables should
be called "compare", not base.

Signed-off-by: Steve Sakoman <steve@sakoman.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-23 14:42:38 +01:00
Richard Purdie
79dd2f94aa send-qa-email/utils: Improve new branch regression script handling
There are several issues:

* New branches don't currently have git regression history
* The regression tool errors if there isn't anything to compare against

To fix this, create a branch with history and only generate a regression
report if there are commits to compare against.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-16 16:25:43 +00:00
Richard Purdie
becdbd3729 utils: Fix incorrect module usage
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 18:21:51 +01:00
Richard Purdie
f9bdcf888f config.json/utils: Allow buildhistory to be configurable and disable for oe-selftest in qemu-arch
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 16:23:54 +01:00
Richard Purdie
a0963045de scripts/utils: Simplify buildhistory path, no need for such deep paths
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-22 00:07:37 +00:00
Richard Purdie
5130ab9f21 utils: Move getcomparisonbranch() to common function library
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:13:16 +00:00
Richard Purdie
e5310650b0 scripts/utils: Ensure list filtering code doesn't match appends/prepends
We want all INHERIT += to apply for example

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-12 14:18:09 +00:00
Richard Purdie
5a2eddd6bd setup-config/utils: Improve extravars handling
Currently there was no way to override an existing extra vars
assignment, which meant BB_NUMBER_THREADS was impossible to change.

This adds code to allow the higher override of a value to override
the other settings which makes the code function more as a user
would expect.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-11 11:05:49 +00:00
Richard Purdie
7f6a3b7fba scripts/utils: Fix string/float combination error
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-09 14:17:10 +00:00
Richard Purdie
dabf9d6e20 scripts/utils: Fix variable name conflict
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-09 14:14:34 +00:00
Richard Purdie
8ce219dda5 run-config/utils: Allow headers to show the difference in time since the previous header
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-09 14:06:52 +00:00
Paul Eggleton
d7d1a2b345 scripts: use argparse for command line parsing
[RP: Minor tweaks made to adpat to buildbot and option naming

Fixed shared-repo-unpack for publishing when no cache-dir supplied]

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30 14:36:07 +01:00
Richard Purdie
89b5f50dd2 utils: Fix previous commit
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-06 15:55:02 +01:00
Richard Purdie
579b732755 utils: Filter reponame to only use base repository name, not a full url
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-06 15:48:30 +01:00
Richard Purdie
621143cee4 scripts: Various buildhistory code fixes/improvements
* Remove the code disabling it
* Move to a non-shared directory by default (but still support absolute pathnames
  if wanted)
* Use shallow clones by default for speed
* Allow force pushing 'fork' mode branches

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-06 15:17:41 +01:00
Richard Purdie
696eacc94a utils: Ensure unspecified variables aren't expanded badly
We want ${BUILDDIR} to stay as ${BUILDDIR}, not become BUILDDIR
for example.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-03 14:57:56 +01:00
Richard Purdie
42416bdc9c utils: Ensure we don't infinitely recurse for variable expansion
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-03 14:08:40 +01:00
Richard Purdie
94cc0afb1c utils: Enhance loadconfig to better merge dicts
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-21 00:04:11 +01:00
Richard Purdie
b7cf6d8209 utils: Allow customisation using ABHELPER_JSON from the environment
Usage is documented in README and an example, local-example.json is
included.

Also clean up the parameter to loadconfig() as its actually not needed.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20 23:16:10 +01:00
Richard Purdie
0ccbfc0e05 utils: Ensure list entries also are expanded
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20 23:07:09 +01:00
Richard Purdie
547a3793fc utils: Fix for python 3.5 and before, remove debug
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20 22:14:46 +01:00
Richard Purdie
d6253df2bc scripts: Convert to use data expansion pretty much everywhere
We want to be able to use data expansion/variable substitution
in most variables so convert to use the utils API for this.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20 16:21:16 +01:00
Richard Purdie
d2c0dcd1d9 utils: Add data expansion handling/API
The code clearly won't scale without some kind of variable substitution/
variable expansion mechanism, so add one.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20 16:20:08 +01:00
Richard Purdie
fde1417b5d utils: Ensure updates on the remote branch are applied for revison==HEAD
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-09 11:19:01 -08:00
Richard Purdie
c8e4cc8483 utils: Ensure fetchgitrepo fetches revisions as well as tags
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-03-01 23:29:59 +00:00
Richard Purdie
a37a62a15c utils: Fix typo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-07 11:29:38 +00:00
Richard Purdie
0a6549a913 utils: Add timestamp to log headers
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-07 10:59:18 +00:00
Richard Purdie
53618a59cb utils: Handle oe-selftest in error reports
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-07 10:39:43 +00:00
Richard Purdie
eb0f56cece utils: Need to flush *after* the header, not before
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-05 23:25:12 +00:00
Richard Purdie
9948821070 utils: Ensure header flushes stdout/stderr first to order output correctly
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-05 22:33:21 +00:00
Richard Purdie
193ea5a9fe utils: Ensure revision has no whitespace
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-05 18:00:06 +00:00
Richard Purdie
477b75ac3c utils: Add missing output decoding
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-05 17:58:17 +00:00
Richard Purdie
a71ea84970 Add support for publishing the layer tarballs
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-05 17:40:49 +00:00
Richard Purdie
4239708b85 Add error reporting server handling
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-02-05 13:16:41 +00:00
Richard Purdie
376ad36d4d Move buildhistory init to run-config (and factor common functionality to utils)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-23 13:49:38 +00:00
Richard Purdie
f79fab19a1 utils/shared-repo-unpack: Create common mkdir function and fix shared-repo-unpack to create directory to rsync to
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-23 13:09:53 +00:00
Joshua Lock
316e0629f9 utils: fix variable name in fetchgitrepo
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
2018-01-22 20:14:30 +00:00
Richard Purdie
7f70683c57 prepare-shared-repos/shared-repo-unpack: Allow future option to filter repos and implement more functionality
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-22 16:12:34 +00:00
Richard Purdie
45b14f6c80 utils: Create helper for loading config.json
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-22 15:20:00 +00:00
Richard Purdie
b47ea0eaa6 run-config: Also use templating support (move to utils)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-20 13:41:33 +00:00
Richard Purdie
4433714dfe setup-config: Also use printheader from utils (and cleanup utils extra \n)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-18 17:12:52 +00:00
Richard Purdie
94b4144c14 utils: Add printheader function
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-18 15:27:27 +00:00