Commit Graph

276 Commits

Author SHA1 Message Date
Nicolas Dechesne
f2816b929f scripts/run-docs-build: publish docs for 3.1.6 and 3.2.2
Fixes: #14308

Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-25 21:28:08 +00:00
Nicolas Dechesne
1c44c0e0fd scripts/run-docs-build: add for loop when publishing tags/branches
Use for loop to avoid repeating the same pattern over and over.

Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-03-25 21:28:08 +00:00
Michael Halstead
f8c2faaf20 send-qa-email: Save the QA email in case it doesn't reach the mailing lists.
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-23 10:24:01 +00:00
Richard Purdie
c21732937c scripts/run-config: Disable output buffering
Line buffering (bufsize=1) is unavailable with binary mode so use unbuffered
mode instead. This fixes python runtime warnings.

[YOCTO #14093]

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-31 11:21:47 +00:00
Richard Purdie
241ae71c18 scripts/run-docs-build: Generate 3.2 docs as well
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-22 22:31:55 +00:00
Richard Purdie
9a34cc8120 scripts/run-docs-build: Generate 3.1.5 and 3.2.1 docs (at least for now)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-22 22:24:00 +00:00
Nicolas Dechesne
698743bdd6 run-docs-build: delete files on the server when publishing
run-docs-build rebuilds the entire doc website, so when we rsync the
output, we need to delete files no longer needed, this is especially
important when we move/rename pages, to avoid stale content.

Using rsync with "wildcards" was a problem in case a file/folder is
removed in the output dir, it won't be deleted.

Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-22 22:09:26 +00:00
Richard Purdie
56db25b673 run-docs-build: Enable sphinx docs for dunfell
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-04 10:57:59 +00:00
Richard Purdie
bceb63fb79 config.json/run-config: Add support for shortnames and descriptions
Learn from the previous experiments and add meaninful shortnames and
descriptions to work around the 50 char name limit.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:32:26 +00:00
Richard Purdie
6e2825564c scripts/shared-repo-unpack: Add flush call to update the output more regularly before buildtools
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:32:26 +00:00
Richard Purdie
2bb4804243 scripts/run-config: Remove redundant boilerplate json
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:32:26 +00:00
Richard Purdie
ce63e8f024 config.json/run-config: Add human readable descriptions of steps
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:32:26 +00:00
Richard Purdie
b1bc4d64c2 scripts/run-config: Ensure logging to both logfile and stdout
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:32:26 +00:00
Richard Purdie
4a4c888f66 scripts/run-config: Improve logfile naming
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:32:26 +00:00
Richard Purdie
23d65680f8 run-config: Adapt to two pass execution
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:32:26 +00:00
Richard Purdie
e183db413f scripts/run-config: If target is present default to 1 step
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:32:20 +00:00
Richard Purdie
afb6c5a887 scripts/run-config: Ensure stepnum has a value when there are no steps
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:24:22 +00:00
Richard Purdie
d9c77dd000 scripts: Add target present check script
Add a script which from the exit code determines if a build target is present
in the configuration. The autobuilder can use this to determine whether to
execute the target at all or whether to skip it.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 17:28:51 +00:00
Richard Purdie
290e1bc2ee scripts/run-config: Don't execute steps that don't exist!
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 17:27:15 +00:00
Alexander Kanavin
2c3f66ba37 auh-config: add non-default distro features
This adds systemd and pam related recipes to upstream checks and devtool-driven updates.

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-17 21:56:47 +00:00
Richard Purdie
354b43fece scripts/run-docs-build: Further improve docs rsync flags
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-09 17:18:35 +00:00
Richard Purdie
b8c8ddac4a scripts/run-docs-build: Drop time rsync flag as we don't need that
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-09 16:55:42 +00:00
Richard Purdie
7958928739 scripts/run-docs-build: Improve docs rsync flags
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-09 16:26:14 +00:00
Richard Purdie
078d72fe0e scripts/run-docs-build: Fix typo in previous commit
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-09 16:03:12 +00:00
Richard Purdie
14d98490e9 scripts/run-docs-build: make target change needs different artefact copying
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-09 15:03:42 +00:00
Richard Purdie
c5860c6ef2 scripts/run-docs-build: Enable docs builds, remove dry run option to rsync
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-09 10:51:48 +00:00
Richard Purdie
2f423c5a07 scripts/run-docs-build: Use an archive copy of the docbook archives for efficiency
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-09 10:51:02 +00:00
Richard Purdie
761c27ad68 scripts/run-docs-build: Use make publissh target instead of html
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-09 10:48:01 +00:00
Richard Purdie
19b288977b scripts/run-docs-build: Ensure potentially stale _build is cleaned before build
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-06 15:05:26 +00:00
Richard Purdie
fba3c36389 scripts/run-docs-build: Publish gatesgarth to the correct location
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-06 15:04:23 +00:00
Richard Purdie
5d64a5d569 scripts/run-docs-build: Ensure switchers update affects gatesgarth too
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-06 15:04:03 +00:00
Richard Purdie
8288b27ac2 scripts/run-docs-build: Fix rsync paths and drop continue mode for wget
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-06 14:28:56 +00:00
Richard Purdie
f4a7a7a644 scripts/run-docs-build: First pass at building the various documentation branches
The script is suboptimal in many ways but is a start and gives us something to test
and improve upon.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-06 14:08:08 +00:00
Richard Purdie
590b045b34 scripts: Add run-docs-build as a wrapper around documentation building
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-05 12:59:27 +00:00
Richard Purdie
4b8eab92ee scripts/generate-testresult-index.py: Use bulma css to improve the look of the index
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-10-21 21:42:32 +01:00
Richard Purdie
ab485e89bd scripts/generate-testresult-index: Reorder buildhistory to improve display
Also, use the artefacts directory in the main link, not direct to testresults.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-10-21 21:08:25 +01:00
Richard Purdie
9f50544d00 scripts/generate-testresult-index: Improve index to list test reports, ptest and buildperf separately
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-10-21 21:00:20 +01:00
Richard Purdie
098de71cbd scripts/generate-testresult-index.py: Ensure we're not always rerunning resulttool
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-10-21 19:30:41 +01:00
Richard Purdie
83c2052781 scripts/generate-testresult-index: Ensure backwards compatibility with older layout
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-10-21 19:23:49 +01:00
Richard Purdie
6d6c45cbda scripts/generate-testresult-index: Update after 'posttrigger' renaming broke the index generation
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-10-21 19:17:58 +01:00
Richard Purdie
3634672674 scripts/send-qa-email: Fix buildtools handling
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-24 12:27:58 +01:00
Richard Purdie
eb295f62f1 utils: Teach buildtools script handling about unset
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-23 08:53:19 +01:00
Alexander Kanavin
0f8534c747 auh: correct the SMTP server in config file
Michael Halstead has confirmed this.

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-17 12:31:52 +01:00
Richard Purdie
e47a9a26f5 scripts/send-qa-email,utils: Use buildtools if present
resulttool has python version requirements so use buildtools if present.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-17 07:44:46 +01:00
Richard Purdie
838be1a00c scripts: Add runqemu-renice.c for renicing runqemu
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-05 14:59:14 +01:00
Michael Halstead
01c16fa772 scripts/send-qa-email: Update to dedicated push capable domain
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-01 18:14:31 +01:00
Richard Purdie
a677305551 scripts/utils: Ensuring new logging is flushed from buffers
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-08-24 18:31:10 +01:00
Richard Purdie
f3892fac1e scripts/utils: Add more logging for fetchgitrepo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-08-24 18:27:56 +01:00
Quentin Schulz
7571e44fc1 scripts: run-auh: update upgrade-helper name
Since https://lists.yoctoproject.org/g/yocto/message/50282 was merged in
autoupgrade-helper git repo, the python script isn't called
upgradehelper.py anymore but upgrade-helper.py for consistency sake.

Let's update the run-auh script so that it's still working.

Signed-off-by: Quentin Schulz <foss@0leil.net>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-08-17 11:38:32 +01:00
Richard Purdie
4c9358ac78 scripts/utils: Ensure buildtools tarball hash matches any supplied value
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-07-14 22:42:25 +01:00