poky/meta
Ross Burton c6f23f1f0f oe/utils: by default cap cpu_count() to 64 cores
Larger systems may have large numbers of cores, but beyond a certain
point they can't all be used for compiling: whilst purely
compute-intensive jobs can be parallelised to hundreds of cores,
operations such as compressing (needs lots of RAM) or compiling (lots of
I/O) don't scale linearly.

For example, the Marvel ThunderX2 has 32 cores, each capable of
executing four threads, and can be configured with two sockets, making
256 CPUs according to Linux. Zstd using 256 threads has been seen to
fail to allocate memory during even small recipes such as iso-codes.

Add a default cap of 64 CPUs to the cpu_count() method so that extreme
parallisation is limited.  64 is high enough that meaningful gains
beyond it are unlikely, but high enough that most systems won't be
effected.

(From OE-Core rev: 765d0f25ce48636b1838a5968e2dc15de2127428)

Signed-off-by: Ross Burton <ross.burton@arm.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-11-25 21:55:10 +00:00
..
classes sstate: explicitly name the checkhashes thread pool 2021-11-25 21:55:10 +00:00
conf bitbake.conf: Pass -D option to ranlib for determisim 2021-11-24 09:55:54 +00:00
files rust-common.bbclass: rewrite toolchain wrappers in (native) python 2021-10-14 11:48:45 +01:00
lib oe/utils: by default cap cpu_count() to 64 cores 2021-11-25 21:55:10 +00:00
recipes-bsp lrzsz: patch is not upstreamable 2021-11-03 11:12:26 +00:00
recipes-connectivity bind: update 9.16.22 -> 9.16.23 2021-11-25 21:55:10 +00:00
recipes-core systemd: update 249.6 -> 249.7 2021-11-25 21:55:10 +00:00
recipes-devtools python3-setuptools: update 58.5.3 -> 59.2.0 2021-11-25 21:55:10 +00:00
recipes-example rust-hello-world: add missing Upstream-Status to a patch 2021-11-21 11:05:02 +00:00
recipes-extended logrotate: add a link to upstream review for one of the patch 2021-11-24 10:00:10 +00:00
recipes-gnome librsvg: submit system-deps patch upstream 2021-11-21 11:05:02 +00:00
recipes-graphics vulkan: update 1.2.191.0 -> 1.2.198.0 2021-11-25 21:55:10 +00:00
recipes-kernel kernel-yocto: conditionally enable stack protection checking on x86-64 2021-11-24 09:55:54 +00:00
recipes-multimedia gstreamer1.0-plugins-base: add support for graphene 2021-11-21 11:05:02 +00:00
recipes-rt rt-tests: update 2.1 -> 2.2 2021-10-11 18:41:38 +01:00
recipes-sato webkitgtk: remove unneeded patch 2021-11-11 17:09:16 +00:00
recipes-support gmp: fix CVE-2021-43618 2021-11-23 10:53:15 +00:00
site site/common-musl: Enable qsort_r in glib 2021-11-01 10:41:18 +00:00
COPYING.MIT
recipes.txt