Commit Graph

71 Commits

Author SHA1 Message Date
Richard Purdie
64b67aa878 Add SPDX License Identifiers
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-01-18 23:49:01 +00:00
Richard Purdie
ccc041a8e8 builders/schedulers: Add 'Should SWAT monitor?' boolean field to build schedulers
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-12-21 14:19:19 +00:00
Richard Purdie
99cafafe1a builders: Cascade the yp_build properties so skipped builds show more cleanly in the UI
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-29 23:51:37 +00:00
Richard Purdie
c8db821860 builders/runconfig: Add ability to skip targets if the don't exist in the branch configuration
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-20 23:36:40 +00:00
Richard Purdie
7898d68ccc runconfig/observer: Simplify log handling for new format tasks
For new tasks, hide errors/warnings if not present, don't monitor steyXY
logfiles as they're no longer needed and ensure description is provided
by our code as shellCommand doesn't handle it.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-12 10:29:32 +00:00
Richard Purdie
3a9b218c83 builders: Clean up buildirectories of successful builds
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-11 18:07:11 +00:00
Richard Purdie
25d5a7d0ae builders/runconfig: Allow execution of run-config steps individually
Rather than running all the work in a single run-config command, split this into
multiple steps. This allows for separate result code reporting, timestamps
for indvidual steps and is generally much cleaner. The naming and so on will need
further work but this is a start.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-11 18:07:11 +00:00
Richard Purdie
97104f0a69 builders: Move run-config handling to its own module
Also abstract the calls into a function to allow for easier further
development.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-10 16:47:16 +00:00
Richard Purdie
0088756388 builders: Add bitbake repository to docs build
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-06 13:32:56 +00:00
Richard Purdie
d81c7ca443 builders/config/schedulers: Add support for 'docs' builder
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-05 12:24:56 +00:00
Steve Sakoman
ad5c6f7089 builders.py: At the end of trigger builds use rm rather than clobber to clean up
Since clobber is crossing two file systems in this case the worker
can delete the files faster than it can move them

Also fixes a occasional race that results in build failures

Signed-off-by: Steve Sakoman <steve@sakoman.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-07-14 21:23:02 +01:00
Richard Purdie
bec33fd671 builders: Add workername parameter to shared-repo-unpack calls
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-27 16:59:33 +01:00
Richard Purdie
452b0255c2 builders: Pass in workername to run-config
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-06 14:40:54 +00:00
Richard Purdie
4f990e3f6d builders: Fix string formatting to use Interpolate
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-17 23:21:13 +00:00
Richard Purdie
3204310119 builders: Add a posttrigger component to the build
This means the source mirror check is run a significant time after the source mirror
update allowing the mirroring code to have time to take effect rather than showing
errors on first build runs.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-17 16:56:56 +00:00
Richard Purdie
3b290ec6d7 builders: Add randomised nextBuild function
nextWorker  can block a request if there is no worker available.
_getNextUnclaimedBuildRequest will always return the first request
which then will always fail to find worker, and this will block the queue
We therefore randomise the build requests queue with nextBuild to avoid
blocking.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-07 11:37:06 +00:00
Richard Purdie
75b4e77973 builders/config: Allow filtering of workers for previous releases
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-06 17:36:03 +00:00
Richard Purdie
b0f684ee64 builders/scheduler: Add ability to select the worker to run on
Thanks to tardyp for the pointer to an example of how to make this work!

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-18 17:15:11 +01:00
Richard Purdie
6079117701 builders: Fix typo
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 15:42:17 +01:00
Richard Purdie
d87126c419 builders: Use full option parameters to run-config for clarity
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 14:31:01 +01:00
Richard Purdie
14046de06d builders: Pass build_type parameter to run-config
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-06 14:28:02 +01:00
Thomas Goodwin
4447148a5c Bug fix: added support for ABHELPER_JSON environ.
The readme suggests exporting this variable from the
environment to expose multiple configuration JSON files
but the intended behavior doesn't work without adding the
variable to extra_env.

Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:36:20 +01:00
Thomas Goodwin
2c765c32d0 builders.py: fix for AB helper repo branch being ignored.
Signed-off-by: Thomas Goodwin <btgoodwin@geontech.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-02 17:34:28 +01:00
Richard Purdie
5d50ac3a33 builders: Add -R option to send-qa-report to pass test results to the script
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 16:52:07 +00:00
Richard Purdie
8ebe2d26c6 builders: Write test results into testresults subdir
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-08 19:49:13 +00:00
Richard Purdie
cc4bc40b28 builders: At the end of triggers builds, cleanup the shared repo directory
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-12-04 12:39:42 +00:00
Richard Purdie
ba73db0480 builders.py: Filter the list of properties we're passing to triggered builds
This reduces unnecessary properties being set in builds where we don't need
them by filtering to the list of repos the build really needs.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-22 12:48:49 +00:00
Richard Purdie
9315359ffb builders.py: Don't hardcode the url to the autobuilder-helper
Use the standard list of repos we already have instead.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-22 12:47:59 +00:00
Richard Purdie
3efe9831ba config/schedulers: Use 'a-' prefix to quick/full to improve sorting in UI
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-22 10:29:47 +00:00
Richard Purdie
1a473c18a4 builders/config: Fix configuration problems
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-21 23:26:02 +00:00
Richard Purdie
b7a5d4bd7a config/builders/schedulers: Split nightly into quick and full targets
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-21 23:21:10 +00:00
Richard Purdie
dd64ea1197 builders: Improve non-release directory structure
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-20 23:48:29 +00:00
Richard Purdie
cfa0545484 builders: Add option to always collect up test results from builds
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-20 23:32:52 +00:00
Richard Purdie
1d533e410f builders.py: Simplify publish directory logic to be more reusable
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-20 23:25:00 +00:00
Aaron Chan
81273de5ac builders: Inherit build properties from nightly scheduler
This change enables the children jobs to inherit the build
property from nightly scheduler. Build property inherits
yocto release, milestone and rc number from parent job.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-07 10:42:06 +00:00
Richard Purdie
ad5baf5ce1 builders: Increase maxsteps to 9 to match current helper configuration maximums
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-10 11:12:25 +01:00
Richard Purdie
b1d2a6b8fb Revert "builders.py: Fix invalid option"
This reverts commit 85cd275481.
2018-09-05 20:48:32 +01:00
Richard Purdie
24085f2a34 builders: Improve log handling to match run-config step numbering
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-05 14:30:27 +01:00
Richard Purdie
b972e58722 builders/yocto_console_view: Add yp_build_branch property
This corresponds to the poky branch being used by default so its easier
for users to tell the builds apart and know which ones they are.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-05 11:50:56 +01:00
Richard Purdie
85cd275481 builders.py: Fix invalid option
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-05 11:50:56 +01:00
Richard Purdie
aed82199a1 builders.py: Fix invalid option
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30 14:59:32 +01:00
Richard Purdie
772544ee27 builders: Adapt to autobuilder-helper argparse changes
In particular this lets us drop the horrible 'None' sentinals.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30 14:43:55 +01:00
Richard Purdie
40fe66b97f Add custom log observer
We want seperate log files in the UI for each of the build steps. This
changes buildbot to monitor the command.log.X files which run-config
generates. It also searches the log output for errors and warnings and
summarises these neatly in the UI.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30 14:41:44 +01:00
Richard Purdie
9200e30765 builders: Add an example of adding extra configuration to workers
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-24 09:22:12 +01:00
Richard Purdie
3ef80817ae builders: Connect in send_email form control to script
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10 23:22:32 +01:00
Richard Purdie
223720737f schedulers/builders: Clean up deploy_artefacts/send_email/is_release into true boolean types
Lets use the proper BooleanParameter input type and boolean values for these.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10 23:22:30 +01:00
Richard Purdie
2856c3283d builders: Drop got_revision hack and replace with yp_build_revision property
The got_revision trick, whilst quite neat, doesn't quite work and is a bit of
a hack breaking other buildbot internals. It gets et late in the builds leaving
a confusing build display in the meantime.

Use a dedicated property to store the "Yocto" build revision instead. This
property will be used by our own custom console UI.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10 17:17:22 +01:00
Richard Purdie
ea05bf56ed builders: Pass sharedrepolocation to QA emails script
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-16 16:04:19 +01:00
Richard Purdie
a1596a5f29 builders: Fix basename version of get_publish_dest
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-15 15:54:32 +01:00
Richard Purdie
7e6b5d4119 builders: Add deploy_artefacts selection/property
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-14 15:12:56 +01:00