Commit Graph

188 Commits

Author SHA1 Message Date
Ross Burton
ee6cdfc4e7 Add meta-arm 2020-06-29 17:16:01 +01:00
Richard Purdie
6375d089c2 schedulers: Add scheduler for auh once a month
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-06-10 10:24:52 +01:00
Steve Sakoman
a7b04c45c8 config.py: Add Ubuntu 20.04 workers
Signed-off-by: Steve Sakoman <steve@sakoman.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-05-28 18:28:17 +01:00
Richard Purdie
598322d6db config: Add support for auh target
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-05-17 17:05:30 +01:00
Trevor Gamblin
b450d5cd97 README-Guide: fix typos, add hashserv setup
Added some instructions on setting up the hash equivalency server for
an autobuilder instance that operates independently of the Yocto one.
This all still assumes that the user is planning on running the controller,
worker, and janitor on the same build host, although the hash equivalency
server itself doesn't need to be.

Also made some minor changes to the list of packages to install to support
the autobuilder on Ubuntu, since there were some typos in the package names.

Signed-off-by: Trevor Gamblin <trevor.gamblin@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-05-12 21:48:26 +01:00
Richard Purdie
bec33fd671 builders: Add workername parameter to shared-repo-unpack calls
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-27 16:59:33 +01:00
Aaron Chan
0e0388132c config: Fix giturl for meta-virtualization Layer
Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-07 21:47:03 +01:00
Richard Purdie
152cb30db2 config/schedulers: Add dunfell release
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-06 17:00:52 +01:00
Richard Purdie
3fdc7d9c0d yocto_console_view: Drop yarn.lock
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-04 10:44:20 +01:00
Richard Purdie
452b0255c2 builders: Pass in workername to run-config
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-06 14:40:54 +00:00
Richard Purdie
553e9d76f4 schedulers: Test whether we can avoid tracebacks in logs upon reconfig
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-21 10:42:25 +00:00
Richard Purdie
4f990e3f6d builders: Fix string formatting to use Interpolate
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-17 23:21:13 +00:00
Richard Purdie
3204310119 builders: Add a posttrigger component to the build
This means the source mirror check is run a significant time after the source mirror
update allowing the mirroring code to have time to take effect rather than showing
errors on first build runs.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-17 16:56:56 +00:00
Richard Purdie
b641513e3f config: Add perf- to stable branch allowed workers
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-17 12:51:33 +00:00
Richard Purdie
8fe016342b master.cfg: Add example of enabling profiling
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-16 22:34:12 +00:00
Richard Purdie
701a7089b3 config.py: Set workers to use for zeus/warriro/thud builds
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-16 18:53:05 +00:00
Richard Purdie
57c799d9b4 confg.py: Add centos8 workers
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-16 18:52:04 +00:00
Richard Purdie
31b796b042 schedulers: Handle yp_branch == None case
The addition of a-full automatic triggers discovered yp_branch can be
None causing tracebacks.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-16 10:40:18 +00:00
Richard Purdie
5f3bc3f33d schedulers: Allow a-full to run on Sundays instead of a-quick
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-14 17:19:36 +00:00
Richard Purdie
09d64cfe0d config: Add meta-intel to a-full
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-01-09 21:14:29 +00:00
Richard Purdie
3b290ec6d7 builders: Add randomised nextBuild function
nextWorker  can block a request if there is no worker available.
_getNextUnclaimedBuildRequest will always return the first request
which then will always fail to find worker, and this will block the queue
We therefore randomise the build requests queue with nextBuild to avoid
blocking.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-07 11:37:06 +00:00
Richard Purdie
5f370fbce0 schedulers: Really fix builderName handling (magic indexes rule :/)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-07 10:04:18 +00:00
Richard Purdie
1f9f212256 schedulers: Fix builderNames and handle partial matches to branch names
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-07 09:08:23 +00:00
Richard Purdie
471eecf823 config/schedulers: Allow a-full to vary targets depending on the release
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-06 21:10:38 +00:00
Richard Purdie
75b4e77973 builders/config: Allow filtering of workers for previous releases
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-06 17:36:03 +00:00
Richard Purdie
345ebf06ab config/schedulers: Bring example config back into line with real autobuilder (including armhost builds)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-19 09:19:53 +01:00
Michael Halstead
e00253a850 scheduler: make the default choice an option
The default choice on the force build form will select a random worker.

builder_to_workers dictionary values can no longer be strings.

Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-19 09:01:58 +01:00
Richard Purdie
8eba9650b1 schedulers: Add zeus branch/release
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-08 20:42:14 +01:00
Richard Purdie
52bbef9f6c config.py: Update -lsb -> -alt naming
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-10-02 10:42:01 +01:00
Richard Purdie
b0f684ee64 builders/scheduler: Add ability to select the worker to run on
Thanks to tardyp for the pointer to an example of how to make this work!

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-18 17:15:11 +01:00
Richard Purdie
62e4e2b174 config.py: Add meta-intel entry to repo table
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-18 11:56:35 +01:00
Richard Purdie
f13a2d2024 config.py: Add meta-intel to list of builders
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-17 22:07:16 +01:00
Richard Purdie
6079117701 builders: Fix typo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 15:42:17 +01:00
Richard Purdie
d87126c419 builders: Use full option parameters to run-config for clarity
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 14:31:01 +01:00
Richard Purdie
14046de06d builders: Pass build_type parameter to run-config
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 14:28:02 +01:00
Thomas Goodwin
c10ea24a43 README-Guide.md: Added additional documentation.
Extended the documentation set to include instructions for how to
make changes to builds, schedules, workers, etc. including a rough
map of what variables map to one another and which variables are
allowed/used in the autobuilder helper JSON file(s).

Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
2019-08-15 06:57:16 -04:00
Thomas Goodwin
4447148a5c Bug fix: added support for ABHELPER_JSON environ.
The readme suggests exporting this variable from the
environment to expose multiple configuration JSON files
but the intended behavior doesn't work without adding the
variable to extra_env.

Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:36:20 +01:00
Thomas Goodwin
2c765c32d0 builders.py: fix for AB helper repo branch being ignored.
Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:34:28 +01:00
Richard Purdie
c6ff41a4c7 README: Add pointer to the mailing list for patches
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-07-30 19:43:59 +01:00
Richard Purdie
61ae6e954d wikilog: Clean up logging messages
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-07-18 11:54:00 +01:00
Richard Purdie
6c9ac90b54 wikilog: Ensure we use a separate thread for blocking wiki network access
Buildbot would hang for several minutes when cancelling builds. We need to defer
this work (which involved network calls) to a thread so that the reactor isn't
blocked.

Use a lock to ensure we only update the wiki one entry at a time.

Also tweak the logging to allow easier debugging (include the parent build ID)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-07-18 11:46:03 +01:00
Richard Purdie
bb9b3ff95e steps/observer: Try and use correct logname for warnings/errors
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-06-26 15:15:59 +01:00
Richard Purdie
20f4bbc93f steps/observer: Mention which log contains an error/warning
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-06-25 15:10:26 +01:00
Richard Purdie
0bb3b30fbe config.py: Update workers to match recent autobuilder changes
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-29 12:45:49 +01:00
Richard Purdie
858129edbd config.py: Add ltp test targets for x86 and arm
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-29 12:36:40 +01:00
Richard Purdie
0533fdde07 config.py: Add fast ptest targets
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-17 14:40:48 +01:00
Richard Purdie
4351b9482f schedulers: Remove obsolete branches from release branch selector code
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-14 17:43:57 +01:00
Richard Purdie
6a8acca22f config.py: No longer need meta-qt4 since rocko and qt3 is also long dead
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 10:20:24 +01:00
Richard Purdie
bfe50984af config.py: No longer build eclipse plugins
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 10:19:22 +01:00
Richard Purdie
72927543c3 schedulers: Fix typo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-12 09:53:55 +01:00