MIRRORS/yocto-autobuilder-helper
1
0
Fork 0
mirror of git://git.yoctoproject.org/yocto-autobuilder-helper.git synced 2025-07-19 20:59:02 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
925 Commits 94 Branches 0 Tags 3.1 MiB
1ae87b3a56
Commit Graph

550 Commits

Author SHA1 Message Date
Richard Purdie
25d574946a config.json: Add QA/publish info and script to mail QA 
Add a script which allows QA to be emailed upon build completion
for QA test runs.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-05-14 13:04:50 +01:00
Ross Burton
b3eb077391 pre-commit-hook: add a pre-commit hook to verify the JSON 
Signed-off-by: Ross Burton <ross.burton@intel.com>
 2018-05-11 11:36:06 +01:00
Richard Purdie
74de885ad7 scripts/run-config: Add more detail when running EXTRA*CMDS 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-05-09 15:44:38 +01:00
Richard Purdie
7175195f7a publish-artefacts: Fix eclipse artefact publish dir 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-03-10 05:38:20 -08:00
Richard Purdie
fde1417b5d utils: Ensure updates on the remote branch are applied for revison==HEAD 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-03-09 11:19:01 -08:00
Richard Purdie
c8e4cc8483 utils: Ensure fetchgitrepo fetches revisions as well as tags 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-03-01 23:29:59 +00:00
Richard Purdie
ef9b1c8d47 run-config: Add eclipe build support 
This means making the configuration generation conditional, the error
reporting conditional and allowing non bitbake commands.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-03-01 21:41:30 +00:00
Richard Purdie
59607f3a19 Add gplv3 check from existing AB code 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-28 17:37:04 +00:00
Richard Purdie
a37a62a15c utils: Fix typo 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-07 11:29:38 +00:00
Richard Purdie
0a6549a913 utils: Add timestamp to log headers 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-07 10:59:18 +00:00
Richard Purdie
53618a59cb utils: Handle oe-selftest in error reports 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-07 10:39:43 +00:00
Richard Purdie
a979873199 run-config: Remove layers after EXTRACMDS to fix oe-selftest 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-07 10:35:22 +00:00
Richard Purdie
d8f1e3ec27 run-config: Replace tee usage 
tee hides the exit code of the pipeline. Instead use subprocess to write out the logfile.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-06 12:58:41 +00:00
Richard Purdie
eb0f56cece utils: Need to flush *after* the header, not before 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 23:25:12 +00:00
Richard Purdie
a7ca61715d upload-error-reports: Fix parameter contamination problem 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 22:45:08 +00:00
Richard Purdie
9948821070 utils: Ensure header flushes stdout/stderr first to order output correctly 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 22:33:21 +00:00
Richard Purdie
7d31d6cb84 run-config: Handle build directory being removed/recreated 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 22:32:57 +00:00
Richard Purdie
cf9cfd5f3a publish-artefacts: Fix another typo 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 22:29:48 +00:00
Richard Purdie
08410f5257 run-config: Fix step numbering printed 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 22:20:42 +00:00
Richard Purdie
cece09f2cf publish-artefacts: Fix recursive function reference and typos 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 22:20:27 +00:00
Richard Purdie
193ea5a9fe utils: Ensure revision has no whitespace 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 18:00:06 +00:00
Richard Purdie
477b75ac3c utils: Add missing output decoding 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 17:58:17 +00:00
Richard Purdie
a71ea84970 Add support for publishing the layer tarballs 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 17:40:49 +00:00
Richard Purdie
38af6b0f6c run-config: Add missing parameter documentation 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 16:38:39 +00:00
Richard Purdie
297219ecc0 run-config: Clean up stepnum a bit 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 16:36:56 +00:00
Richard Purdie
f66abd6270 run-config: Print step x of y headers and summary of the number of failures 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 16:34:51 +00:00
Richard Purdie
4239708b85 Add error reporting server handling 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-02-05 13:16:41 +00:00
Richard Purdie
d9137f05ff publish-artefacts: Fix syntax error 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-31 11:46:53 +00:00
Richard Purdie
2808a9bc72 run-config: Add publish artefact support 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-31 10:12:52 +00:00
Richard Purdie
943395f925 layer-config: Add configuration for calling the init scripts (fixes eclipse build) 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-30 14:13:22 +00:00
Richard Purdie
6e000b6eb6 layer-config: No longer need to use 'topdir' 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-30 13:40:43 +00:00
Richard Purdie
a28efd463b shared-repo-unpack: Drop now unneeded directory deletion 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-30 13:40:16 +00:00
Richard Purdie
f91610defd shared-repo-unpack: Allow shared to be unspecified 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-29 17:52:27 +00:00
Richard Purdie
aad15671f7 shared-repos-unpack/layer-config: Use topdir and repos subdirs for checkouts/builds 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-25 10:15:58 +00:00
Joshua Lock
28cf55e5ab shared-repo-unpack: fix mv calls 
As the mv commands use a filename wildcard we need to tell check_call to
execute through the shell so that the wildcard is expanded, rather than
treat as a file name.

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-24 22:20:12 +00:00
Richard Purdie
2591cb364b Add initial publish-artefacts script 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-24 16:51:04 +00:00
Joshua Lock
8a18530eca shared-repo-unpack: make moving old repos more resilient 
Only move the directory contents if they exist, try to move dot
files after moving non dot files.

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-24 16:22:41 +00:00
Joshua Lock
d3ef90083b shared-repo-unpack: move existing dir's contents, not dir itself 
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-24 14:29:51 +00:00
Richard Purdie
c6a0df6db6 shared-repo-pack: Add missing imports 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-24 14:11:05 +00:00
Richard Purdie
f92af9cb9a shared-repo-pack: Move out any existing build directory to the trash delection handler 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-24 14:05:20 +00:00
Richard Purdie
98f101ee93 shared-repo-unpack: Call layer-config 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-23 16:57:45 +00:00
Richard Purdie
838339775d shared-repo-unpack: Correct the rsync command 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-23 16:11:36 +00:00
Richard Purdie
c431561542 Add layer-config script to setup layers correctly 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-23 16:11:18 +00:00
Richard Purdie
376ad36d4d Move buildhistory init to run-config (and factor common functionality to utils) 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-23 13:49:38 +00:00
Richard Purdie
f79fab19a1 utils/shared-repo-unpack: Create common mkdir function and fix shared-repo-unpack to create directory to rsync to 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-23 13:09:53 +00:00
Richard Purdie
806957b392 scripts: Fix help text and program name 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-23 13:09:53 +00:00
Joshua Lock
316e0629f9 utils: fix variable name in fetchgitrepo 
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-22 20:14:30 +00:00
Richard Purdie
0ffecfbb25 Add repo filtering functionality per target 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-22 16:25:13 +00:00
Richard Purdie
89fbb72693 shared-repo-unpack: Fix missing variable 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-22 16:13:55 +00:00
Richard Purdie
7f70683c57 prepare-shared-repos/shared-repo-unpack: Allow future option to filter repos and implement more functionality 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-22 16:12:34 +00:00
Richard Purdie
6bf85dbbdc Add initial repo handling scripts 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-22 15:20:37 +00:00
Richard Purdie
45b14f6c80 utils: Create helper for loading config.json 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-22 15:20:00 +00:00
Richard Purdie
b47ea0eaa6 run-config: Also use templating support (move to utils) 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-20 13:41:33 +00:00
Richard Purdie
40eb3f0820 run-config: Fix return value handling 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-20 13:40:01 +00:00
Richard Purdie
ea38889fc3 config.json/setup-config: Add templating support to remove error prone configuration duplication 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-20 13:01:06 +00:00
Richard Purdie
db8cf29820 run-config: Add support for adding/removing layers and extra commands in steps 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-20 11:14:58 +00:00
Richard Purdie
9996fff768 run-config: Ensure stdout/stderr is flushed and fix DISPLAY 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-19 12:26:00 +00:00
Richard Purdie
0fbdf0c27f run-config: Fix typo 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 23:02:48 +00:00
Richard Purdie
4ceb9e49d4 run-config: Fix off by one error 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 22:29:46 +00:00
Richard Purdie
307ce0c502 run-config: Print error message/exit code upon failure 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 18:30:34 +00:00
Richard Purdie
8cd1d0ccb8 Handle build-appliance srcrev 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 18:14:06 +00:00
Richard Purdie
0a045ed92d run-config: Cleanup/fix commands 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 17:52:30 +00:00
Richard Purdie
4433714dfe setup-config: Also use printheader from utils (and cleanup utils extra \n) 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 17:12:52 +00:00
Richard Purdie
94460edf3b run-config: Use subprocess directly so we see the output 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 17:10:02 +00:00
Richard Purdie
94b4144c14 utils: Add printheader function 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 15:27:27 +00:00
Richard Purdie
a18dd64923 run-config: Complete the code 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 15:27:14 +00:00
Richard Purdie
1a5e7e1cb8 add run-config script to execute targets 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 15:09:20 +00:00
Richard Purdie
337f0c12f9 setup-config: Split useful functions to utils.py 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-18 14:53:59 +00:00
Richard Purdie
3374739122 Only run buildhistory-init on first step 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-17 23:32:56 +00:00
Richard Purdie
d3efe9c894 indent print output to aid readability 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-17 23:27:35 +00:00
Richard Purdie
cb4b520530 Fix sdk-extras mirror url 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-17 23:26:41 +00:00
Richard Purdie
59bd6f009b Improve sstate mirror handling for release 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-17 23:25:26 +00:00
Richard Purdie
bf3986819f Handle buildinfo 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-17 22:58:29 +00:00
Richard Purdie
a2c18b4537 Finish buildhistory support 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-17 22:44:28 +00:00
Richard Purdie
88973c3c99 Add sdk-extra handling, DL_DIR and SSTATE_DIR 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-17 18:24:20 +00:00
Richard Purdie
8e3081ffd7 Handle PRSERV 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-17 17:47:32 +00:00
Joshua Lock
1db6f2f787 setup-config: disable version-going-backwards error when using buildhistory 
The version-going-backwards ERROR_QA option should be disabled when using
buildhistory.

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-17 14:00:40 +00:00
Richard Purdie
8deb8008d4 setup-config: Add handling for MACHINE and SDKMACHINE 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-16 21:47:48 +00:00
Richard Purdie
0495bf45cc setup-config: Clean up stepnum handling and drop debug 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 23:42:13 +00:00
Richard Purdie
885d2d8c91 setup-config: Handle step variable overrides 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 21:43:38 +00:00
Richard Purdie
c4999fdb69 Add getconfiglist and use for hanfling extravars 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 17:28:33 +00:00
Richard Purdie
f1f2190025 Allow extravars to be specified 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 17:20:21 +00:00
Joshua Lock
0c49fbbc80 setup-config: don't strip off "nightly-" prefix from target 
This ultimately makes the code more complex as not all buildsets on the
Yocto Project autobuilder are named with that prefix.

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-15 17:07:17 +00:00
Richard Purdie
43b255cae8 Add USE_ERROR_REPORT 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 17:04:24 +00:00
Joshua Lock
bb3a281db6 setup-config: add a 5th parameter to take the repo name 
This will likely be useful in several places and is require for buildhistory
configuration.

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-15 16:47:06 +00:00
Richard Purdie
22f5aea386 Handle DISTRO setup 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 16:38:23 +00:00
Joshua Lock
19ebd0492a setup-config: fix another os.remove() call 
The remove method is in the top-level os module, not os.path - I missed
this call last time...

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-15 16:36:13 +00:00
Joshua Lock
c4fd38e466 setup-config: fix os.remove() call 
The remove method is in the top-level os module, not os.path

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-15 16:22:34 +00:00
Joshua Lock
15613c6708 setup-config: fix last commit, import errno module 
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-15 15:33:36 +00:00
Joshua Lock
fb6405431f setup-config: don't fail if autoconf's parent dir already exists 
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-15 15:31:08 +00:00
Joshua Lock
f3e37a8614 setup-config: remove stray : 
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-15 15:27:30 +00:00
Joshua Lock
dccd73ef47 setup-config: fix a couple of missing : after if expressions 
Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
 2018-01-15 15:22:29 +00:00
Richard Purdie
dc2ec763af setup-config: Add branch information to build and generate auto.conf 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 15:09:43 +00:00
Richard Purdie
c3eda8bbfa Further development of the file 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 14:51:19 +00:00
Richard Purdie
c3ff43bcbf Further development of the file 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 14:47:55 +00:00
Richard Purdie
3081270545 Add buildhistory-reset and further cleanup 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 14:03:33 +00:00
Richard Purdie
bb67d8aa84 setup-config: Start to build up variables to add to configuration 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 13:56:00 +00:00
Richard Purdie
d19e7f2802 Continue to fill out buildhistory code 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 13:45:29 +00:00
Richard Purdie
70db7ea161 setup-config: Convert to python, handle paths issues and add basic json config 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 10:30:55 +00:00
Richard Purdie
09d2ec62dc Initial population with sample code 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2018-01-15 10:16:13 +00:00