Commit Graph

29 Commits

Author SHA1 Message Date
Alexis Lothoré
8b16d49789 scripts/send-qa-email: add symlink to preserve compatibility with autobuilder
Merely renaming send-qa-email to send_qa_email.py would imply to update
yocto-autobuilder2 scripts, which can be daunting. In order to preserve
compatibility with current configuration, add a symlink pointing to the
new script

Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-01-26 22:40:07 +00:00
Alexis Lothoré
5adb7a7dc3 scripts/send_qa_email.py: Rename send-qa-email to send_qa_email.py
This rename fixes send-qa-email regarding python guidelines, which allows to
import the script content in another script (for unit testing purpose for
example)

Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2023-01-26 22:40:02 +00:00
Richard Purdie
effb9b0fcd scripts: Ensure gplv2 revision isn't listed and repos aren't used
We disabled meta-gplv2 for master, ensure the repo isn't used in the
collection or QA scripts.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-09-26 13:01:37 +01:00
Richard Purdie
8702fdbb72 Clarify license and copyright information
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-05-17 10:29:45 +01:00
Richard Purdie
aff49e938e shared-repos: Use tar instead of rsync for speed
The rysnc of 20,000 files (650MB) onto the nas is slow taking ~3 minutes
at idle and worse at load. This is due to the number of files which
is a pain point for NFS. This piece of the build is also a bottleneck
since the rest of a build depends on it happening.

If we switch to zstd compressed tar, it takes 2.49s. Other compression
methods were much slower but zstd seems 'accptable' and speeds things
up too.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-31 17:37:34 +00:00
Michael Halstead
f8c2faaf20 send-qa-email: Save the QA email in case it doesn't reach the mailing lists.
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-23 10:24:01 +00:00
Richard Purdie
3634672674 scripts/send-qa-email: Fix buildtools handling
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-24 12:27:58 +01:00
Richard Purdie
e47a9a26f5 scripts/send-qa-email,utils: Use buildtools if present
resulttool has python version requirements so use buildtools if present.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-17 07:44:46 +01:00
Michael Halstead
01c16fa772 scripts/send-qa-email: Update to dedicated push capable domain
Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-01 18:14:31 +01:00
Richard Purdie
eb86b7fd11 send-qa-email: Fix stable branch test result history issues
On stable release branch builds, it will clone "master" since comparebranch
is None. It will then fail to push since there is already a dunfell
branch upstream with changes on which it needs to rebase on top of.
The change to use shallow clones significantly increases this problem.

To fix this, fall back to cloning basebranch by name, then master
if it doesn't exist.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-06-09 16:51:23 +01:00
Steve Sakoman
00df7cbc02 scripts/send-qa-email: fix bug in git push logic for yocto-testresults
We were mistakenly doing a force push if the branch was in either
BUILD_HISTORY_FORKPUSH or BUILD_HISTORY_DIRECTPUSH.

Now we force push for branches in BUILD_HISTORY_FORKPUSH, regular push
for branches in BUILD_HISTORY_DIRECTPUSH, and no push if the branch is
in neither list.

Signed-off-by: Steve Sakoman <steve@sakoman.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-04-23 14:43:36 +01:00
Richard Purdie
37955b4b8d send-qa-email: Limit results clone to shallow depth to avoid timeouts
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-10 22:22:36 +00:00
Richard Purdie
ee6fc35569 build-perf/send-qa-email: Fallback to master as a comparision branch
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-03-01 17:44:34 +00:00
Richard Purdie
1b78039d41 scripts/send-qa-email: Allow force pushing of basebranch based comparisions
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-08 15:25:42 +00:00
Richard Purdie
5f423e3a26 scripts/send-qa-email: Handle older git clients
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-02-08 14:32:10 +00:00
Richard Purdie
79dd2f94aa send-qa-email/utils: Improve new branch regression script handling
There are several issues:

* New branches don't currently have git regression history
* The regression tool errors if there isn't anything to compare against

To fix this, create a branch with history and only generate a regression
report if there are commits to compare against.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-11-16 16:25:43 +00:00
Richard Purdie
520ea457e8 send-qa-email: Fix typo causing wrong report contents to be written
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-25 09:34:22 +00:00
Richard Purdie
2deb018441 send-qa-email: Be specific about which test result branches to push
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-23 22:53:50 +00:00
Richard Purdie
e67a6aab27 send-qa-report: Add handling of results files with resulttool
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:19:02 +00:00
Richard Purdie
13eb8eb282 scripts/send-qa-email: Add optional -R option for test results directory
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-02-21 17:13:16 +00:00
Richard Purdie
5fe0e21b8a scripts/send-qa-email: Handle systems with sendmail in sbin
Many of the distros we use have sendmail in /sbin or /usr/sbin
which may not be in the path for non-interactive users. Handle
this in the script to avoid failures where tests work but the
real QA email fails.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-05 16:57:37 +00:00
Paul Eggleton
d7d1a2b345 scripts: use argparse for command line parsing
[RP: Minor tweaks made to adpat to buildbot and option naming

Fixed shared-repo-unpack for publishing when no cache-dir supplied]

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30 14:36:07 +01:00
Richard Purdie
b7cf6d8209 utils: Allow customisation using ABHELPER_JSON from the environment
Usage is documented in README and an example, local-example.json is
included.

Also clean up the parameter to loadconfig() as its actually not needed.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20 23:16:10 +01:00
Richard Purdie
d6253df2bc scripts: Convert to use data expansion pretty much everywhere
We want to be able to use data expansion/variable substitution
in most variables so convert to use the utils API for this.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20 16:21:16 +01:00
Richard Purdie
fcd4a3891f scripts/send-qa-email: Handle form enable/disable of email
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10 23:17:51 +01:00
Richard Purdie
001353ea6f send-qa-email: Ensure we don't run when not publishing
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10 14:10:29 +01:00
Richard Purdie
51054804fc send-qa-email: Resolve revisions into full hashes
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-16 16:03:42 +01:00
Richard Purdie
477d511aa0 send-qa-email: Allow execution (chmod)
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-14 17:00:42 +01:00
Richard Purdie
25d574946a config.json: Add QA/publish info and script to mail QA
Add a script which allows QA to be emailed upon build completion
for QA test runs.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-14 13:04:50 +01:00