From nobody Wed Oct 25 13:43:35 2023 X-Original-To: ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SFqrs2hwqz4xX7G for ; Wed, 25 Oct 2023 13:43:41 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SFqrr2fj2z4Hnd; Wed, 25 Oct 2023 13:43:40 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; none Received: from [188.174.51.18] (helo=c720-1400094.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qveAb-00B2wy-6U; Wed, 25 Oct 2023 15:43:37 +0200 Received: from c720-1400094.fritz.box (localhost [127.0.0.1]) by c720-1400094.unixarea.de (8.17.1/8.14.9) with ESMTP id 39PDhZ6d001755; Wed, 25 Oct 2023 15:43:35 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by c720-1400094.fritz.box (8.17.1/8.14.9/Submit) id 39PDhZIU001754; Wed, 25 Oct 2023 15:43:35 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: c720-1400094.fritz.box: guru set sender to guru@unixarea.de using -f Date: Wed, 25 Oct 2023 15:43:35 +0200 From: Matthias Apitz To: Matthew Seaman Cc: ports@freebsd.org Subject: Re: Rust build huge memory consumption Message-ID: Reply-To: Matthias Apitz References: <09a4bfb8-ba61-4e05-b646-973104337f77@groumpf.org> <20231025064626.A5DA6168@slippy.cwsent.com> <5816a79c-9bd0-4c41-9520-eed853aa15a4@groumpf.org> <344ca749-411b-4a0e-94ae-7d0055a633b1@FreeBSD.org> List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <344ca749-411b-4a0e-94ae-7d0055a633b1@FreeBSD.org> X-Operating-System: FreeBSD 14.0-CURRENT r1400094 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.51.18 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE] X-Rspamd-Queue-Id: 4SFqrr2fj2z4Hnd I'm building 2200 ports on a Dell PowerEdge r210, 16GB RAM, 34GB swap, 8 CPU; system is 1400094 and ports from git October 14; and I use for rust a single podriere job. The build time was: ... ===> Cleaning for rust-1.72.0 build of lang/rust | rust-1.72.0 ended at Sun Oct 15 03:04:41 CEST 2023 build time: 02:37:44 What really improved my overall building with poudriere (normaly 4 builders) are the following settings before building: # cat sysctls4poudriere.sh sysctl vfs.read_max=128 sysctl vfs.aio.max_buf_aio=8192 sysctl vfs.aio.max_aio_queue_per_proc=65536 sysctl vfs.aio.max_aio_per_proc=8192 sysctl vfs.aio.max_aio_queue=65536 sysctl vm.pageout_oom_seq=120 sysctl vm.pfault_oom_attempts=-1 With these settings I have no page faults or killed processes anymore. matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub