yocto-autobuilder-helper/scripts
Richard Purdie aff49e938e shared-repos: Use tar instead of rsync for speed
The rysnc of 20,000 files (650MB) onto the nas is slow taking ~3 minutes
at idle and worse at load. This is due to the number of files which
is a pain point for NFS. This piece of the build is also a bottleneck
since the rest of a build depends on it happening.

If we switch to zstd compressed tar, it takes 2.49s. Other compression
methods were much slower but zstd seems 'accptable' and speeds things
up too.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-31 17:37:34 +00:00
..
auh-config auh: update the from address to valid domain 2021-10-25 19:47:31 +01:00
yocto-3.3 scripts: run-docs-build: patch yocto-3.3 and 3.4 releases 2021-10-28 23:48:08 +01:00
yocto-3.4 scripts: run-docs-build: patch yocto-3.3 and 3.4 releases 2021-10-28 23:48:08 +01:00
build-perf-test-wrapper build-perf/send-qa-email: Fallback to master as a comparision branch 2020-03-01 17:44:34 +00:00
buildhistory-init buildhistory-init/collect-results: Use a tag to make buildhistory data consistent 2019-02-23 17:23:52 +00:00
check-gplv3 Add gplv3 check from existing AB code 2018-02-28 17:37:04 +00:00
checkvnc scripts/checkvnc: Add checkvnc script from old autobuilder codebase 2018-08-30 13:22:16 +01:00
collect-results scripts/collect-results: publish everything in tmp/log/oeqa/ 2021-10-14 22:23:15 +01:00
generate-testresult-index.py scripts/generate-testresult-index.py: update index to list host data 2021-07-12 22:36:20 +01:00
layer-config layer-config, shared-repo-unpack: Sub-repos in NEEDREPOS 2019-08-02 17:34:48 +01:00
oe-build-perf-report-email.py build-perf-test-wrapper/report-email: Tweak for ab-helper usage 2019-01-22 23:01:57 +00:00
oe-build-perf-report-scrape-html-report.js scripts: Import build-perf scripts from oe-core 2019-01-22 22:58:11 +00:00
pre-commit-hook.sh pre-commit-hook: add a pre-commit hook to verify the JSON 2018-05-11 11:36:06 +01:00
prepare-shared-repos shared-repos: Use tar instead of rsync for speed 2021-10-31 17:37:34 +00:00
publish-artefacts publish-artefacts: Improve sha256 checksum handling 2020-05-27 07:55:06 +01:00
run-auh scripts: run-auh: update upgrade-helper name 2020-08-17 11:38:32 +01:00
run-config summarize_top_output.py: add script, use it and publish summary 2021-06-24 14:24:54 +01:00
run-docs-build scripts: run-docs-build: patch yocto-3.3 and 3.4 releases 2021-10-28 23:48:08 +01:00
runqemu-renice.c scripts: Add runqemu-renice.c for renicing runqemu 2020-09-05 14:59:14 +01:00
send-qa-email shared-repos: Use tar instead of rsync for speed 2021-10-31 17:37:34 +00:00
setup-auh auh: update the from address to valid domain 2021-10-25 19:47:31 +01:00
setup-config scripts/setup-config: Update to use new overrides syntax 2021-07-30 23:34:30 +01:00
shared-repo-unpack shared-repos: Use tar instead of rsync for speed 2021-10-31 17:37:34 +00:00
summarize_top_output.py summarize_top_output.py: summarize data logged on failure 2021-07-12 22:36:20 +01:00
target-present scripts: Add target present check script 2020-11-20 17:28:51 +00:00
upload-error-reports run-config/upload-error-reports: Handle builddir not existing 2019-12-12 13:02:57 +00:00
utils.py prepare-shared-repo/utils: Limit HEAD clones to shallow depth to save time/space 2021-10-31 13:03:22 +00:00