yocto-autobuilder-helper/scripts
Richard Purdie b1ca93e8b9 shared-repos: Use tar instead of rsync for speed
The rysnc of 20,000 files (650MB) onto the nas is slow taking ~3 minutes
at idle and worse at load. This is due to the number of files which
is a pain point for NFS. This piece of the build is also a bottleneck
since the rest of a build depends on it happening.

If we switch to zstd compressed tar, it takes 2.49s. Other compression
methods were much slower but zstd seems 'accptable' and speeds things
up too.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit aff49e938e)
Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-04-11 13:08:12 +01:00
..
auh-config auh-config: add non-default distro features 2020-11-17 21:56:47 +00:00
build-perf-test-wrapper build-perf/send-qa-email: Fallback to master as a comparision branch 2020-03-01 17:44:34 +00:00
buildhistory-init buildhistory-init/collect-results: Use a tag to make buildhistory data consistent 2019-02-23 17:23:52 +00:00
check-gplv3 Add gplv3 check from existing AB code 2018-02-28 17:37:04 +00:00
checkvnc scripts/checkvnc: Add checkvnc script from old autobuilder codebase 2018-08-30 13:22:16 +01:00
collect-results scripts/collect-results: Ensure selftest doesn't trigger buildhistory results collection 2019-03-25 10:07:21 +00:00
generate-testresult-index.py scripts/generate-testresult-index.py: Use bulma css to improve the look of the index 2020-10-21 21:42:32 +01:00
layer-config layer-config, shared-repo-unpack: Sub-repos in NEEDREPOS 2019-08-02 17:34:48 +01:00
oe-build-perf-report-email.py build-perf-test-wrapper/report-email: Tweak for ab-helper usage 2019-01-22 23:01:57 +00:00
oe-build-perf-report-scrape-html-report.js scripts: Import build-perf scripts from oe-core 2019-01-22 22:58:11 +00:00
pre-commit-hook.sh pre-commit-hook: add a pre-commit hook to verify the JSON 2018-05-11 11:36:06 +01:00
prepare-shared-repos shared-repos: Use tar instead of rsync for speed 2022-04-11 13:08:12 +01:00
publish-artefacts publish-artefacts: Improve sha256 checksum handling 2020-05-27 07:55:06 +01:00
run-auh scripts: run-auh: update upgrade-helper name 2020-08-17 11:38:32 +01:00
run-config scripts/run-config: Disable output buffering 2021-01-31 11:21:47 +00:00
run-docs-build run-docs-build: build from tags dynamically instead of static list 2021-04-13 15:13:42 +01:00
runqemu-renice.c scripts: Add runqemu-renice.c for renicing runqemu 2020-09-05 14:59:14 +01:00
send-qa-email shared-repos: Use tar instead of rsync for speed 2022-04-11 13:08:12 +01:00
setup-auh scripts: add a pair of scripts to set up and run Auto Upgrade Helper 2020-05-17 16:57:25 +01:00
setup-config config.json/utils: Allow buildhistory to be configurable and disable for oe-selftest in qemu-arch 2019-04-12 16:23:54 +01:00
shared-repo-unpack shared-repos: Use tar instead of rsync for speed 2022-04-11 13:08:12 +01:00
target-present scripts: Add target present check script 2020-11-20 17:28:51 +00:00
upload-error-reports run-config/upload-error-reports: Handle builddir not existing 2019-12-12 13:02:57 +00:00
utils.py run-config: Adapt to two pass execution 2020-11-20 23:32:26 +00:00