MIRRORS/yocto-autobuilder-helper
1
0
Fork 0
mirror of git://git.yoctoproject.org/yocto-autobuilder-helper.git synced 2025-07-19 20:59:02 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
435 Commits 94 Branches 0 Tags 3.1 MiB
6e2825564c
Commit Graph

267 Commits

Author SHA1 Message Date
Richard Purdie
6e2825564c scripts/shared-repo-unpack: Add flush call to update the output more regularly before buildtools 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 23:32:26 +00:00
Richard Purdie
2bb4804243 scripts/run-config: Remove redundant boilerplate json 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 23:32:26 +00:00
Richard Purdie
ce63e8f024 config.json/run-config: Add human readable descriptions of steps 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 23:32:26 +00:00
Richard Purdie
b1bc4d64c2 scripts/run-config: Ensure logging to both logfile and stdout 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 23:32:26 +00:00
Richard Purdie
4a4c888f66 scripts/run-config: Improve logfile naming 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 23:32:26 +00:00
Richard Purdie
23d65680f8 run-config: Adapt to two pass execution 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 23:32:26 +00:00
Richard Purdie
e183db413f scripts/run-config: If target is present default to 1 step 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 23:32:20 +00:00
Richard Purdie
afb6c5a887 scripts/run-config: Ensure stepnum has a value when there are no steps 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 23:24:22 +00:00
Richard Purdie
d9c77dd000 scripts: Add target present check script 
Add a script which from the exit code determines if a build target is present
in the configuration. The autobuilder can use this to determine whether to
execute the target at all or whether to skip it.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 17:28:51 +00:00
Richard Purdie
290e1bc2ee scripts/run-config: Don't execute steps that don't exist! 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-20 17:27:15 +00:00
Alexander Kanavin
2c3f66ba37 auh-config: add non-default distro features 
This adds systemd and pam related recipes to upstream checks and devtool-driven updates.

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-17 21:56:47 +00:00
Richard Purdie
354b43fece scripts/run-docs-build: Further improve docs rsync flags 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-09 17:18:35 +00:00
Richard Purdie
b8c8ddac4a scripts/run-docs-build: Drop time rsync flag as we don't need that 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-09 16:55:42 +00:00
Richard Purdie
7958928739 scripts/run-docs-build: Improve docs rsync flags 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-09 16:26:14 +00:00
Richard Purdie
078d72fe0e scripts/run-docs-build: Fix typo in previous commit 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-09 16:03:12 +00:00
Richard Purdie
14d98490e9 scripts/run-docs-build: make target change needs different artefact copying 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-09 15:03:42 +00:00
Richard Purdie
c5860c6ef2 scripts/run-docs-build: Enable docs builds, remove dry run option to rsync 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-09 10:51:48 +00:00
Richard Purdie
2f423c5a07 scripts/run-docs-build: Use an archive copy of the docbook archives for efficiency 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-09 10:51:02 +00:00
Richard Purdie
761c27ad68 scripts/run-docs-build: Use make publissh target instead of html 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-09 10:48:01 +00:00
Richard Purdie
19b288977b scripts/run-docs-build: Ensure potentially stale _build is cleaned before build 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-06 15:05:26 +00:00
Richard Purdie
fba3c36389 scripts/run-docs-build: Publish gatesgarth to the correct location 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-06 15:04:23 +00:00
Richard Purdie
5d64a5d569 scripts/run-docs-build: Ensure switchers update affects gatesgarth too 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-06 15:04:03 +00:00
Richard Purdie
8288b27ac2 scripts/run-docs-build: Fix rsync paths and drop continue mode for wget 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-06 14:28:56 +00:00
Richard Purdie
f4a7a7a644 scripts/run-docs-build: First pass at building the various documentation branches 
The script is suboptimal in many ways but is a start and gives us something to test
and improve upon.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-06 14:08:08 +00:00
Richard Purdie
590b045b34 scripts: Add run-docs-build as a wrapper around documentation building 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-11-05 12:59:27 +00:00
Richard Purdie
4b8eab92ee scripts/generate-testresult-index.py: Use bulma css to improve the look of the index 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-10-21 21:42:32 +01:00
Richard Purdie
ab485e89bd scripts/generate-testresult-index: Reorder buildhistory to improve display 
Also, use the artefacts directory in the main link, not direct to testresults.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-10-21 21:08:25 +01:00
Richard Purdie
9f50544d00 scripts/generate-testresult-index: Improve index to list test reports, ptest and buildperf separately 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-10-21 21:00:20 +01:00
Richard Purdie
098de71cbd scripts/generate-testresult-index.py: Ensure we're not always rerunning resulttool 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-10-21 19:30:41 +01:00
Richard Purdie
83c2052781 scripts/generate-testresult-index: Ensure backwards compatibility with older layout 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-10-21 19:23:49 +01:00
Richard Purdie
6d6c45cbda scripts/generate-testresult-index: Update after 'posttrigger' renaming broke the index generation 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-10-21 19:17:58 +01:00
Richard Purdie
3634672674 scripts/send-qa-email: Fix buildtools handling 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-09-24 12:27:58 +01:00
Richard Purdie
eb295f62f1 utils: Teach buildtools script handling about unset 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-09-23 08:53:19 +01:00
Alexander Kanavin
0f8534c747 auh: correct the SMTP server in config file 
Michael Halstead has confirmed this.

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-09-17 12:31:52 +01:00
Richard Purdie
e47a9a26f5 scripts/send-qa-email,utils: Use buildtools if present 
resulttool has python version requirements so use buildtools if present.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-09-17 07:44:46 +01:00
Richard Purdie
838be1a00c scripts: Add runqemu-renice.c for renicing runqemu 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-09-05 14:59:14 +01:00
Michael Halstead
01c16fa772 scripts/send-qa-email: Update to dedicated push capable domain 
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-09-01 18:14:31 +01:00
Richard Purdie
a677305551 scripts/utils: Ensuring new logging is flushed from buffers 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-08-24 18:31:10 +01:00
Richard Purdie
f3892fac1e scripts/utils: Add more logging for fetchgitrepo 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-08-24 18:27:56 +01:00
Quentin Schulz
7571e44fc1 scripts: run-auh: update upgrade-helper name 
Since https://lists.yoctoproject.org/g/yocto/message/50282 was merged in
autoupgrade-helper git repo, the python script isn't called
upgradehelper.py anymore but upgrade-helper.py for consistency sake.

Let's update the run-auh script so that it's still working.

Signed-off-by: Quentin Schulz <foss@0leil.net>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-08-17 11:38:32 +01:00
Richard Purdie
4c9358ac78 scripts/utils: Ensure buildtools tarball hash matches any supplied value 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-07-14 22:42:25 +01:00
Alexander Kanavin
d88728431a auh-config: send AUH update emails to oe-core list as well 
Sadly, many maintainers do not act on AUH mails in a timely manner
(or do not act at all). Sending these emails to oe-core list as well
will allow other people to pick them up, and ease up the path
to doing recipe version maintenance.

Also, recently the amount of outdate recipes has been greatly reduced,
so there should not be too many of those emails each month.

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-06-30 17:33:41 +01:00
Vineela
3aefa5a763 scripts/utils.py: Convert md5sum to sha256sum for layer tarballs 
Signed-off-by: Vineela Tummalapalli <vineela.tummalapalli@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-06-26 21:33:42 +01:00
Richard Purdie
eb86b7fd11 send-qa-email: Fix stable branch test result history issues 
On stable release branch builds, it will clone "master" since comparebranch
is None. It will then fail to push since there is already a dunfell
branch upstream with changes on which it needs to rebase on top of.
The change to use shallow clones significantly increases this problem.

To fix this, fall back to cloning basebranch by name, then master
if it doesn't exist.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-06-09 16:51:23 +01:00
Tummalapalli, Vineela
835ac325a4 publish-artefacts: Improve sha256 checksum handling 
The existing checksum files were encoding full paths. This patch changes
this to use just the filename which allows relocation of the directories
and is more appropriate for sharing over http.

Signed-off-by: Vineela Tummalapalli <vineela.tummalapalli@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-05-27 07:55:06 +01:00
Alexander Kanavin
cfa62a586a scripts: add a pair of scripts to set up and run Auto Upgrade Helper 
This allows automating its setup and execution on all autobuilder worker machines;
previously there was a static setup on a dedicated machine, which wasn't
great from maintenance perspective.

To use:

scripts/setup-auh target_dir
scripts/run-auh target_dir

(run-auh can be run several times in a directory that
was previously set up)

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-05-17 16:57:25 +01:00
Richard Purdie
80c53d03ea scripts/publish-artefacts: Convert md5sum to sha256sum 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-05-05 13:29:01 +01:00
Richard Purdie
033ae6ffbd scripts/run-config: Share buildtools setup code with shared-repo-unpack 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-04-27 19:05:11 +01:00
Richard Purdie
0a7bf5191e scripts/shared-repo-unpack: Accept workername parameter 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-04-27 17:09:03 +01:00
Richard Purdie
aa81bd61c5 scripts/run-config: Add extra debug about buildtools to show when active 
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
 2020-04-27 17:07:28 +01:00