From nobody Thu Oct 26 17:07:44 2023 X-Original-To: ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SGXL63CH6z4y3CC for ; Thu, 26 Oct 2023 17:07:58 +0000 (UTC) (envelope-from bofh@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SGXL62HSJz4ThK; Thu, 26 Oct 2023 17:07:58 +0000 (UTC) (envelope-from bofh@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1698340078; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=womd89zviMgknOVDP600tgk5HkHWFmMq27YE866J1Fk=; b=ur70t8A0S7eZPtKqLDxqin+XN9ajRHxblgncgz+MxbCAmmERkBPThqXlKpcwf/6RM5HaIk 82rRAVFUql9Hm39iZlqXFJc30cCwLrL04dFK8qxB2eUo7F7TsYRG14UwNm2T6UuYUQ0cWW 0T/PMygG+qskGyDEhCcAOmdrQCrXXxPJL39TA7n27zohDFim36mGx9NN2ywRiXsq49wQjM EeiFj+KVHD3T6a7XWDZoXuYuSEss4yrCu0wHePWcPGAenlz7asxhNwao0ykSjyd6pPclBC aiYu2i7XO5cz0nLsYfdWEFeWmN1u8Vi8A1ONP5F4Gs7pFgL1zlbXHUOclOFSoA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1698340078; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=womd89zviMgknOVDP600tgk5HkHWFmMq27YE866J1Fk=; b=ovVNAFo4BJcjZMxLU3mcB3bIqlduc/xNQZn7Z4MBhFa/e4JK56ZmrjJyoXogL2HhVmpvdZ Tud5rZFY1jIuqoMgyBlFFquCPOw4aHzb1+BH8QYOFyjMwioIJwSuJsN/2zWNP4V6wdCrbM PWq8X0CT8xFeseiu8sRy++OHR6eVuWO78UskIdLdlZU9xzjWg3u+i3LMW5pZNbilXVVB6h KBffzUoXs6u4Ha6XEGc2NLgBM2tmoV58+cWRukapzhEuB45xA1YhbCOxHo+kSLZzdo2b36 PqBqDUv6J9osz5TMAfeG2BdwI4azBOWpSnNZVQJS0NMjIGyH/nkmq7H0izMjvg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1698340078; a=rsa-sha256; cv=none; b=dv9JMKJ23FDlL1cVmnZSK9RXtcixBd5sKqB08A18QfDskLSRPY1ZX7Vre/uHrT2vSNh33x ONOxVHgYvyq9wKdmefRGQJF1OtErejzZl9taiElH/nupDA/9JvPqUxeWQrLGyM4X3L6PpZ f84l5QV+jgVMEPkRv1dugdWR9IdM8c2tn2k04dP/7qT/wkSZv05iVS0DM63HeAz2E//cI8 MQidrp5HhcbcpNNh/919nmYJEncioe2FLq4XZ+TQUBe49eva6L33utz4DCuLt3THbaURau 7KL/ruPcswogxf/BcMxfrYDB7bRj81Ck2uqwwTvDUnr31hmEVNxjFFwwPSeqsg== Received: from mx.bofh.network (mx.bofh.network [5.9.249.227]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: bofh/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4SGXL55t5Rz1Mf2; Thu, 26 Oct 2023 17:07:57 +0000 (UTC) (envelope-from bofh@freebsd.org) Received: from smtpclient.apple ( [217.117.226.147]) by mx.bofh.network (OpenSMTPD) with ESMTPSA id fc5c6e24 (TLSv1.2:ECDHE-ECDSA-AES256-GCM-SHA384:256:NO); Thu, 26 Oct 2023 17:07:54 +0000 (UTC) Content-Type: multipart/signed; boundary="Apple-Mail=_5C4C1185-056C-4C69-8A28-B93C369672A7"; protocol="application/pgp-signature"; micalg=pgp-sha512 List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: We need to do something about build times From: Moin Rahman In-Reply-To: Date: Thu, 26 Oct 2023 19:07:44 +0200 Cc: ports@freebsd.org Message-Id: References: To: Robert Clausecker X-Mailer: Apple Mail (2.3731.700.6) --Apple-Mail=_5C4C1185-056C-4C69-8A28-B93C369672A7 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=us-ascii > On Oct 24, 2023, at 9:12 PM, Robert Clausecker wrote: > > And it seems I'm slowly killing my build SSD like that. After just about > 9 months, it is already at 100 TB of writes just from port builds. > Building with workdirs in memory is no longer an option as that frequently > kills my build server by filling all its RAM with build files until no > processes can be started anymore. Poudriere does not have an effective > mechanism to prevent this (tmpfs limits don't work as the ports in > question require very large workdirs, tend to take very long to build and > tend to be built all at the same time for multiple jails). I will just address a small part of the mail as I am mostly the one maintaining tex. Today I have committed some changes which will reduce the size of the downloads and increase the timing of fetch and install target although it won't be helping too much in the stage and pkg target. In previous I have tried with static plist which often used to timeout more hence I moved into TMPPLIST. Additionally the pkg-plist becomes something like 10MB in size I believe. texlive-texmf is one major requirement for doxygen which is a requirement of many other ports. This is one reason texlive-texmf is a common requirement. If you know of a specific reason this one is rebuilt more frequently let me know I will try to see if the dependency can be avoided to reduce the build frequencies. Kind regards, Moin(bofh@ with all hats off) --Apple-Mail=_5C4C1185-056C-4C69-8A28-B93C369672A7 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEETfdREoUGjQZKBS+fvbm1phfAvJEFAmU6nOBfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDRE Rjc1MTEyODUwNjhEMDY0QTA1MkY5RkJEQjlCNUE2MTdDMEJDOTEACgkQvbm1phfA vJGNnA//Te/Of04G2KUkgKF/Q1BjLk5q3ronV9gzlpZvRcB3U/bN6iYnxF9L5xV/ Y+tzXo0d5AiT/Dx3fhChNqWBHpzBZXViSeGi2RoHGOC0Qb6B6RknGJUo58vkZpJ1 h2I5wfUBfydSn390yyRxUda/tCpewcf+9QjJPAgNYEew9T6tmkfEvfislnhaOZ4c JAbY1I1Fop9LSTO6BBGnn5S5ywjHxcx8PinWFDDgeKmUFJLxfkF0bTfGPmirJEl3 fCf3k7Yep+2rJeqh1C07YtrNHwHdkFVmSeLNOWQlnc6myuiZc+JmZD6CcaCBMLFF /vgDQ3muvhhaRArjrBDbvjEelbzmiq3w/YpS3RqkZR6V7BjvfZAFDQxw6W3cqdBN kZwADdjefhaGpQ9UgbXpCIWLTIcN9ZcFn0Px6NbSD0cP2WQGVMXiO2LrJY7dngIZ auiZmfNIqWY9CpHBGKtgCy9KLGQrGQVdQ3jkPAkScEd1aEP1gRuTxmdadGX5K+rA 8vKgmLJjQug+5NWumaS9no+pJ7gk5I1CDJ6WyRM+3Sf6PTktdgKSsM4er8eDXRqT Pfj3IJ+A7u/fNJNgv2zvlZXpa+F6c4Rzg+fULF9JdLoGIejv3ICLaZQyjEPpQpoC TimhXTOJ2zO+RnTPoqAb6f8d7mABpalevQyaafHIiFx7pDxvGlE= =UB9R -----END PGP SIGNATURE----- --Apple-Mail=_5C4C1185-056C-4C69-8A28-B93C369672A7--