Commit Graph

470 Commits

Author SHA1 Message Date
Mathieu Dubois-Briand
253d1f5bd7 schedulers: Fix missing parenthesis in field label
Signed-off-by: Mathieu Dubois-Briand <mathieu.dubois-briand@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2025-02-06 11:56:14 +00:00
Antonin Godard
8f6709cf0f schedulers: docs: pass properties to branch schedulers
Unlike the ForceScheduler, the AnyBranchScheduler does not take a list
of parameters but a simple dict. Add a repos_dict_for_scheduler() helper
that returns a dict containing the {repo,branch}_<repo> keys mapping to
the values in config.py. These are used in the factory definition of the
docs build (see the Git steps).

Also add the missing "yab-helper" to the bitbake-docs-changed scheduler.

Signed-off-by: Antonin Godard <antonin.godard@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2025-01-10 15:43:12 +00:00
Antonin Godard
afa838d962 docs build: make it possible to override repo settings
In the current form when forcing a docs build, the different repo
parameters do nothing and are not propagated. The properties from
props_for_builder() are propagated, but weren't used in the factory
definition.

So use FixedParameters in the codebases definition: this removes the
useless entries in the form (we cannot simply remove the codebases arg
or it triggers another error "No sourcestamp found in build for
codebase"). Then in config.py, populate the "docs" entry in
buildertorepos, so that these show up in the form. Finally, in the docs
factory build, use Interpolate to get the property (I had issues using
util.Property directly).

Note: in latest buildbot version I hit a known bug
https://github.com/buildbot/buildbot/issues/8274. It shouldn't affect us
since we use an older version of Buildbot, but leaving this here just in
case.

Signed-off-by: Antonin Godard <antonin.godard@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2025-01-10 15:43:12 +00:00
Richard Purdie
adb36c2213 config.py: Fix typo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-12-20 15:16:37 +00:00
Richard Purdie
4ad0dc5539 config.py: Update with typhoon -> valkyrie changes
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-12-20 15:10:48 +00:00
Mathieu Dubois-Briand
2078359b30 builders: Create poky tags on a-full or a-quick builds
Signed-off-by: Mathieu Dubois-Briand <mathieu.dubois-briand@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-12-17 15:21:54 +00:00
Richard Purdie
7a517815e0 schedulers: Switch to a-full once a day
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-12-02 23:02:55 +00:00
Mathieu Dubois-Briand
1cc6527125 config.py: Update meta-qt6 from 6.6.0 to 6.7.2
meta-qt6 is only used for the webosose builder and webosose now needs
Qt6.7.

Signed-off-by: Mathieu Dubois-Briand <mathieu.dubois-briand@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-11-05 11:29:39 +00:00
Richard Purdie
29a5a12025 schedulers: Fix styhead for meta-ti
meta-ti will never have a styhead branch. Have the scheduler point to a valid branch.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-28 14:38:05 +00:00
Mathieu Dubois-Briand
15f37f7101 schedulers: Add codebase on all forced builds
Adding the code base with no name and a label on sub-builders, so it
adds the missing "yocto-autobuilder-helper" header on the build start
pop-up. This mimic the behaviour we already have for the a-full/a-quick
builds.

Signed-off-by: Mathieu Dubois-Briand <mathieu.dubois-briand@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-24 10:32:39 +01:00
Mathieu Dubois-Briand
f6a7a67425 builders/config: Use a shorter codebase name for docs
The introduction of codebases for docs builder changed the git clone
steps internal names, as they are now suffixed with the codebase name.
This new name for the yocto-autobuilder-helper seems to be too long for
the database used on our autobuilder and triggers an exception. Use a
shorter codebase name to fix this issue.

Signed-off-by: Mathieu Dubois-Briand <mathieu.dubois-briand@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-23 15:26:47 +01:00
Mathieu Dubois-Briand
b6a8b1eac1 schedulers: Add branch selector for Mathieu
As Alexandre is no longer using the autobuilder daily, remove his branch
selector and add mine.

Signed-off-by: Mathieu Dubois-Briand <mathieu.dubois-briand@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-23 11:35:33 +01:00
Mathieu Dubois-Briand
110cd04b3d README-Guide: Fix spaces in README-Guide
Remove any no-break-spaces in the file.

Signed-off-by: Mathieu Dubois-Briand <mathieu.dubois-briand@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-23 11:35:23 +01:00
Mathieu Dubois-Briand
06dfc4e43a builders/config: Fix docs builder with custom branches
While most of the builds on the autobuilder rely on the
shared-repo-unpack helper script and do not use the Buildbot codebases,
the "docs" builder use Buildbot traditional way to setup sources. As a
consequence, we have to use Buildbot codebases, otherwise the same
branch name is used for all cloned repos.

Add the codebase specifications for all three repos used by the docs
builder. Also remove them from the repos list, as these fields are not
used.

Signed-off-by: Mathieu Dubois-Briand <mathieu.dubois-briand@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-23 11:34:55 +01:00
Richard Purdie
fc65d707b7 config.py: Add buildtools-docs builder with meta-oe as a depenedncy
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-14 15:42:03 +01:00
Richard Purdie
8c7217134a builders: Fix reversed branchname matching logic
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-09 23:50:54 +01:00
Richard Purdie
0094a385c8 builders: Add commented out debugging for bonuses
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-09 21:57:27 +01:00
Richard Purdie
48686d22b9 builders: Allow partial matching of helper branches
Helper branches with names like contrib/kirkstone-nut don't work with
worker restrictions currently. Try and fix this.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-10-07 22:27:30 +01:00
Richard Purdie
64cbb9b0ef schedulers: Add styhead
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-09-17 12:38:35 +01:00
Richard Purdie
3ba986a65a schedulers: Drop nanbield
The nanbield release is out of maintenance now, stop running metrics for it.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-08-23 10:26:01 +01:00
Richard Purdie
fdc1617271 builders: Reduce threshold for /tmp space to 1GB
buildperf-debian11 only has 1.8GB space on /tmp so this was blocking builds.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-08-08 11:06:13 +01:00
Richard Purdie
12f10fc494 builders: Handle different distro /tmp mount point output
Simplfy the space command to directly use findmnt and output in bytes to simplify the expression.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-08-05 23:26:51 +01:00
Richard Purdie
d809e29a23 builders: Improve disk space checking
We've been seeing increasing problems with disk space issues breaking builds.

Increase the check from 100GB to 200GB
Monitor /tmp for 10GB free as well
Refactor the code to make adding other mount point checks easy

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-08-04 12:58:31 +01:00
Richard Purdie
694d2a9bae config.py: Don't test toaster on fedora39/fedora40 as it doesn't work
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-08-01 16:28:40 +01:00
Richard Purdie
3b6febc312 config.py: Don't test toaster on fedora39/fedora40 as it doesn't work
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-08-01 16:27:58 +01:00
Richard Purdie
96e82ce670 config.py: Sync workers list with the live instance
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-08-01 16:22:53 +01:00
Richard Purdie
b3eea6d45e Revert "schedulers.py: Set indexing to every few hours to minimise console disruption for now"
This reverts commit 11a1e0a899.
2024-07-15 16:05:09 +01:00
Richard Purdie
6fd9d2019c yocto_console_view: Compile plugin
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-07-15 15:50:33 +01:00
Richard Purdie
573e590f9d yocto_console_view: Skip indexing job on console view
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-07-15 15:50:33 +01:00
Richard Purdie
11a1e0a899 schedulers.py: Set indexing to every few hours to minimise console disruption for now
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-07-12 23:42:59 +01:00
Richard Purdie
a3cbeaff08 schedulers: Add missing clang branch targets
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-07-12 17:18:18 +01:00
Richard Purdie
c7a0d152be config/schedulers: Add indexing target run every 15 mins
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-07-12 17:16:49 +01:00
Ross Burton
d9dc0d0a52 schedulers.py: add meta-webosose scheduled build
Add a scheduled build (2am on Friday) to run meta-webosose for kirkstone.

Signed-off-by: Ross Burton <ross.burton@arm.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-07-10 13:04:33 +01:00
Richard Purdie
ad6a94fd31 schedulers: Add mappings for meta-security
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-07-09 12:09:13 +01:00
Ross Burton
c51e2bd0ec config.py: meta-webosose now depends on meta-security
Signed-off-by: Ross Burton <ross.burton@arm.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-07-02 16:02:04 +01:00
Alexandre Belloni
7210d227d1 schedulers: switch meta-agl branches
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-06-27 11:20:46 +01:00
Steve Sakoman
9b1b82f856 schedulers: update branchdefaults for scarthgap
Signed-off-by: Steve Sakoman <steve@sakoman.com
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-05-15 18:01:17 +01:00
Richard Purdie
ef9002c68e scheedulers: Move from nanbield to scarthgap
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-05-13 13:20:28 +01:00
Richard Purdie
2538d651b7 schedulers: Drop mickledore metrics, add scarthgap
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-04-26 08:54:33 +01:00
Ross Burton
f11799d6fb README: update patch submission address
Patches should now be sent to yocto-patches@.

Signed-off-by: Ross Burton <ross.burton@arm.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-28 17:51:03 +00:00
Alexandre Belloni
eda13d08fe schedulers: ensure correct branch is used for meta-exein for nanbield
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-28 17:46:56 +00:00
Richard Purdie
b339425d95 config: Drop qemuriscv64 automatic testing
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-19 14:39:57 +00:00
Richard Purdie
b839dfa52c Revert "schedulers: metrics: Start with master for the daily full download"
This reverts commit 839c3cedbf.

There are assumptions in the code that master runs last, not first.
2024-03-15 17:26:20 +00:00
Yoann Congal
839c3cedbf schedulers: metrics: Start with master for the daily full download
Change the order of metrics branches:
* First, master at 5am which may do the full CVE download (might take
  1 hour to finish).
* Then, the other branches starting at 6am to allow them to use the
  fresh download.

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-03-13 22:07:12 +00:00
Richard Purdie
d2a265bdeb config: Add genericarm64 machine
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-28 17:15:54 +00:00
Steve Sakoman
bc52eaad62 config.py: add alma9 to workers_prev_releases for kirkstone
Signed-off-by: Steve Sakoman <steve@sakoman.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-28 09:26:15 +00:00
Richard Purdie
81ddd3e444 config: Add meta-clang to a-full
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-23 17:44:14 +00:00
Ross Burton
3921c18396 config.py: add meta-clang to a-full
Now that meta-clang builds successfully on the autobuilder, we can ensure
that it doesn't regress by enabling it in a-full builds.

Signed-off-by: Ross Burton <ross.burton@arm.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-23 15:33:37 +00:00
Richard Purdie
488f6f2b81 config: Also enable qemuriscv64-tc target
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-18 17:37:42 +00:00
Richard Purdie
a16d3ff825 steps/runconfig: Allow usepty to be specified
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2024-02-18 16:14:06 +00:00