From nobody Mon Oct 28 02:10:48 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XcH162pl6z5bjFC for ; Mon, 28 Oct 2024 02:10:50 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XcH156gPgz4N6y for ; Mon, 28 Oct 2024 02:10:49 +0000 (UTC) (envelope-from david@catwhisker.org) Authentication-Results: mx1.freebsd.org; none Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.18.1/8.18.1) with ESMTP id 49S2AmhC009205; Mon, 28 Oct 2024 02:10:48 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.18.1/8.18.1/Submit) id 49S2Am1E009204; Sun, 27 Oct 2024 19:10:48 -0700 (PDT) (envelope-from david) Date: Sun, 27 Oct 2024 19:10:48 -0700 From: David Wolfskill To: Maku Bex Cc: freebsd-current@freebsd.org Subject: Re: speedup build time Message-ID: Mail-Followup-To: David Wolfskill , Maku Bex , freebsd-current@freebsd.org References: <012d01db28cc$5fc66ac0$1f534040$@gmail.com> <015001db28db$690b03c0$3b210b40$@gmail.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="An6ek7JNpR4F+Y8l" Content-Disposition: inline In-Reply-To: <015001db28db$690b03c0$3b210b40$@gmail.com> X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US] X-Rspamd-Queue-Id: 4XcH156gPgz4N6y X-Spamd-Bar: ---- --An6ek7JNpR4F+Y8l Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Oct 27, 2024 at 08:47:55PM -0500, Maku Bex wrote: > Hi David, >=20 > * What (if any) "max_jobs" (make's "-j" parameter) are you using? 16 >=20 > * For a 16T system, I expect I would start with a value of around 28. Sho= uldn't this number be equal to $(nproc --all)? Not necessarily. You might want to watch the output of "top" as the machine is busy, and try changing the max_jobs parameter. Basically, if the machine is spending "a lot" of time during "make buildworld" (& friends) in "system" time, well ... that's likely (mostly) overhead. I typically (mostly, and from memory) see 0% idle with <2% system CPU. You almost certainly don't want a thread to need to hunt down the next bit of work to be done when the current bit's time slice is up or it goes into a wait: that next work should be queued up, ready to go. > * Are you using make's "meta" mode? I do. Yes. >=20 > * Can you get more memory for that system? Yes, I can bump it to 32GB. Th= is is a Dell OptiPlex 7080 Micro, and not sure if it is worth upgrading the= other components. I suspect that additional memory would be "helpful." > If your laptop can complete the builds in such a small amount of time, th= en there's either something wrong with my machine or the config files. Oh! = The build just finished as I was typing this reply and...(not for the weak = hearts): :-} > -------------------------------------------------------------- > >>> World built in 32437 seconds, ncpu: 16 > -------------------------------------------------------------- =20 >=20 > Here are the contents of: >=20 > make.conf: >=20 > CPUTYPE?=3Dicelake-client > CFLAGS=3D -O2 -pipe -march=3D${CPUTYPE} > #CXXFLAGS=3D${CFLAGS} > MACHINE_CPU+=3D avx512 avx2 avx sse42 sse41 ssse3 sse3 f16c > MAKE_JOBS_NUMBER=3D 16 > BATCH=3Dyes > WRKDIRPREFIX=3D/var/ports/tmp > CCACHE_DIR=3D/var/ccache/tmp >=20 > OPTIONS_UNSET+=3D QT5 QT6 CUPS VESA SCFB TWM XCONSOLE XCLOCK GNOME KDE EX= AMPLES \ > DEBUG ASPELL NLS DOCS > -------------------------------------------------------------------------= ------ > src-env.conf: >=20 > WITH_META_MODE=3Dyes > WITH_CCACHE_BUILD=3Dyes > #WITH_DIRDEPS_BUILD=3Dyes < #WITH_DIRDEPS_CACHE=3Dyes <=20 > WITHOUT_TALK=3Dyes > WITHOUT_TELNET=3Dyes > WITHOUT_TFTP=3Dyes > WITHOUT_IPFILTER=3Dyes > WITHOUT_IPFW=3Dyes > WITHOUT_FLOPPY=3Dyes > WITHOUT_GAMES=3Dyes > WITHOUT_BLUETOOTH=3Dyes > WITHOUT_EE=3Dyes > WITHOUT_FREEBSD_UPDATE=3Dyes > WITHOUT_GPIO=3Dyes > WITHOUT_MAIL=3Dyes > WITHOUT_TESTS=3Dyes > WITHOUT_AMD=3Dyes > WITHOUT_CLANG=3Dyes > WITHOUT_DEBUG_FILES=3Dyes > WITHOUT_EXAMPLES=3Dyes > WITHOUT_HYPERV=3Dyes >=20 > Happy Hacking, > .... My config files are much simpler (these are for stable/14; head is nearly the same): /etc/make.conf: NET_SNMP_SYS_CONTACT=3D"david@catwhisker.org" NET_SNMP_SYS_LOCATION=3D"variable" NET_SNMP_LOGFILE=3D/var/log/snmpd.log NET_SNMP_PERSISTENTDIR=3D/var/net-snmp EXTRA_PATCH_TREE=3D/usr/local/port_patches WITH_BSD_JDK=3DTRUE WITHOUT_RUNTIME_CPUDETECTION=3D YES WITHOUT_CJK=3D YES NO_SUID_XSERVER=3DYES INSTALL_AS_NCFTP=3Dyes OPTIONS_SET=3DOPTIMIZED_CFLAGS DISABLE_VULNERABILITIES=3Dyes FORCE_PKG_REGISTER=3D YES PKG_NOCOMPRESS=3D1 SENDMAIL_MC=3D/etc/mail/laptop.mc WITH_DEBUG_PORTS=3Dx11/nvidia-driver /etc/src-env.conf: WITH_META_MODE=3Dyes /etc/src.conf: KERNCONF=3DCANARY PORTS_MODULES+=3Dgraphics/drm-61-kmod =2EMAKE.META.IGNORE_PATHS +=3D /usr/local/etc/libmap.d IWN_DEBUG=3D1 IEEE80211_DEBUG=3D1 BATCH_DELETE_OLD_FILES=3D1 WITHOUT_REPRODUCIBLE_BUILD=3Dyes WITHOUT_LLVM_TARGET_ALL=3Dyes [Some of the above may well be a bit dated; I am not always good about cleaning up after an experiment.] Peace, david --=20 David H. Wolfskill david@catwhisker.org It has been said that history repeats itself. This is perhaps not quite correct; it merely rhymes. -- Theodor Reik See https://www.catwhisker.org/~david/publickey.gpg for my public key. --An6ek7JNpR4F+Y8l Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQSTLzOSbomIK53fjFliipiWhXYx5QUCZx7yqF8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0OTMy RjMzOTI2RTg5ODgyQjlEREY4QzU5NjI4QTk4OTY4NTc2MzFFNQAKCRBiipiWhXYx 5RAHAP9gNm8kS8D7nVuXdK1HKrbgy0ZvSyMrBhWtLD77mfmz5AEAyAJjPA+qouFh b+z0yAZhAt0/mrseJxXWZsDPuKnV4wU= =fIUg -----END PGP SIGNATURE----- --An6ek7JNpR4F+Y8l--