From nobody Mon Feb 10 21:48:07 2025 X-Original-To: freebsd-pkg@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4YsJ9R3pC5z5mr2L for ; Mon, 10 Feb 2025 21:48:27 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-20.consmr.mail.gq1.yahoo.com (sonic314-20.consmr.mail.gq1.yahoo.com [98.137.69.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4YsJ9P3Mnfz3PLF for ; Mon, 10 Feb 2025 21:48:25 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Kujmn15r; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1739224103; bh=Zl3Dj3AwrzAlXQXPPTqaEz9j8q8PABttugP4KqITLPM=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=Kujmn15rvFhU0b+yzaOdGdv1jajkwiMPdW2yalzhM8Dt0yknbV9cNR3w88JRdFjgVlME/hcj6HGeMt01vVf7q7OPY1QJw1MYlm/0DdX/HhiwXPo+n5o+ONRbWnftGlbHRuwK1UoJghrWveE9yYp7TgljQl4YJPrfvvSpfQuLTrertBN1Mmd5BPu0mH69snJbU3Arb3/51Mlukhodaos9WuPANBwJhe/BFrT9/Lla6z8MVnKPsSH9RDp1AU1fpFZ1AW33+DoYKYZT8wfdv7hrGnAoSeRbkPTbO4ZOazQzU3q8+2i+fZdmp6Tt33L587yxnF+vhGc7HJ9XijYvxJ4nkQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1739224103; bh=zc4pSW6IE0bnAsAgjTY2wljMa1FWJl2slYIvAP3a8j4=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=gTjwNXM3IWRYypsSBu4H/YP/vqGE2DG9yHfEPPpHPMnlmGto+RpMo1qfxgOwY4KssGXVBGnnDm7E6/csMxvU1lDzEWzMfWMJLQs48ckoYykpBjpoynOOZEtsbneeRJxZuHLMV3fe5wAJjTZ2shQvRoIYUAENA0MdXwN6r6y+ywTbcrQChF0BgmBLet/Ra2VGpYLO6fmh6+5ylImfCyx92L5eiWjVw3SfL/4qBe/m9RYwrv10ooNSYFOHHqCIHFFaf79yjR2gA5J5jZpwnhH56QmpiUIXOtb60ZSWEKXdsF/LL/r6X/2ZYun3r4InCM0aMaT54/cshtv7HhYGUyyPSQ== X-YMail-OSG: g3UGRTUVM1mSukhjX3GmQy3uDPJFLTpMCEUNK5_zalKYoslTkyvwce.IjotA1x1 8uoXes64PN4iVmx_iawVGsDhzmT2qFwUsoExGyGD_b0JirE06xsAAA0G_Q89cVALcSafKb1J4A0P YyqtfglHKWnGLT9b98KrTmQcHkGuDwl5eS5T0ytPefUwo7a7Uh9VNCcZt5Erpmn4DMFsdf2DsOHV fboSPJuwMuT7q7feSblTPj_uyscShQpq7tLWJVYWsWWIa9XJ091HxTzN4hDDTp90_VSohi8USNci F8WRtd6UMpPjZ.IjkPbg2TwkPi_DlufxhjGw.SozzHAsgQUxz1gUT6j74roGa2QPzb_JDgDTB0K1 1834BAKX2bTs_ljeOXxhqsbFR8hrpMJyS2GHsFquUz12IIbpQCyWtOllTmg6ilb1UXyvNaC8RL50 kDK2EtM0t9qwqfao.9zNISELjg4GJ70ZqhqbBP7MDUt.co3E8SYUjvsI2bf1QpHyso_bnNjTkSM_ EnddNltOjdiP9rmVQK9oVWsSjzl1vYHLV5owaLqtortM7OX3EwmmRgWiS39GAd0hFrePB0BHs.Ga y.jS5FE6ypx1lnQjFKLlOO137csZS68zWfAFynjFNyXcUbPn1cqhXZF3knrVJOzq8io92G43nwTy yliFH4VQx7Om5kzo5fBnvwurKQMl2Oa6VCOjfnUwflZO4VohZ6vN2uxfJbrJFoPm_cfWkvpQGN05 e2aagPAZ8KiiPA4DVOlyilURRZ0HoeodtEtt.fzxkTtle96sZ0bNTvQYaTwqKn14N0CTS5PfySPB yZ3CZcFUTn4.ncamvgIVluUO5bo_.yKIQc6_wgo2qd30oisKsE7e_oMwXJxZwiSRgusLGH5uQsYU m5zU.JI_bM.VM0gyfbruqcORJSEL3kwKxGZVBcaQYUJtb0orGPe9h1wScM_qEVuOJ4is3W9rYBjf v1qEhjVHyzwRn45JOZY8Czrb6KVStJ42GFhdL3TKMazybYgVPwKGjEtccWvrlOn9bOMhs.jFJSWn q4g0d5my4cb6bbP7ULnFTa40lAj1QNAEQbsCw3rD9IdKRhFkXXERdL4.knSGKx2RGKsH.8oWHnPY gyvfyddztzo_pLkb.BwwGlh.LOOtL51ZtR6RsUs77oy3.xskzKuuLz3oVCZeITr9uAM8RvzBiuJL Bmgq6qODzh5QD5llNPNpB2grBkZ_7qPWzU_.F4C33.xOaJIKfobEWPLuYHyJow4kXdlJ3op01cQb mDsdO7XNNqKS3iUKM4h6ifFaaNHdxAtD15or08y_51qxq.L7.WFiQklCYocw3VW4Tiu6qvXuFFDJ _MiUjie0_yThbuxFHlzdnHBELehm_xL3ZEIsvkz.0G.e69KOslC5hPrqb0hx8632gJS68__jLGHv mvo1BRkhyhAxYqIqLFliQkx15HKdZISi7OC6urlyAw0Z8.4qj_i3XNktaNgM7fo3kea0aGV7fMja 6gYDYXNXwgNptA27aq5lKAL2tHLSGAummsvbYZilCWUvJKaAT2w5p2EVRik.Wyara1h9KCpFxNg. mD3jGgOG9HK6uPd46gPHW2gRaz0xAZmphT1naPH0dVrRzLSrAer27i.9taApLPwxbzjT_ARJAmKh Qvf5Mfd7C5c_3ebGldF4c4DXc23cPXkZ53lc4LGz5pA8_0SqR.mrndQCTaLXbZW7JwtnfACP.Hcm TOf.sfNhgX7EegqAbCgGkKlinXTSEOpVvdM2dd4pWiFS7Fn6Qk6A2dV7VfDGRds_ULOZTpXUJvpr 7QBASHmICAo9C7uZJoME4VzVHMXoD54VWroJlAZ0HXO3cJzWktEDghj4fVONUkzAzIxC74DBPyo7 OS.3muYejxdhp_zEPGrkxFJO.9p77hM4aYw5M4B0Aoa7754HpoYWKX07HrgO6.ljhcwuVk13ftpd ZGX2XHNL.n4mb.sx1J5bWO5eLsdeo34z0erMYOUnmMoG_c2n5C_SDzvjoLsiyHCQqNHoFj0P0bap cHaACsx7S6jb3Oo7GCcTze7nxKhlEM9RA6GtqXyI.XRSdZsFU30IpugcsD2vd7sQ3gT_G6b8bqRD g_HsYNopDGHQjnL4OX5Kf8Ff0KMh.95YKyH.zJF7w9855sCCwUcpeD4YkRxwMURa.Zjfqy94WCMe PXNVk.2s8mue5FYRmSTJgvhWIrAnA7Matnyu9.sKCl50K5g6sflYEiB9b80cu_8CnDe.ArntIW3e owrD_BSWdm5HFllwWpy73s0YXIGhoXaHpvB3qyE7LTGvagpjluuKaSsZXZbnm6LMOz6aYI3HY_H_ iGZg- X-Sonic-MF: X-Sonic-ID: 92829447-4856-49a3-b8cd-b9fa84319dd8 Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Mon, 10 Feb 2025 21:48:23 +0000 Received: by hermes--production-gq1-5dd4b47f46-9j75b (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID e8338ccc225cb57bbb1c2aa933de4fe0; Mon, 10 Feb 2025 21:48:19 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Binary package management and package tools discussion List-Archive: https://lists.freebsd.org/archives/freebsd-pkg List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-pkg@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.400.131.1.6\)) Subject: RE: arm64 pkg building is taking longer Message-Id: <566D4C18-A850-4394-A717-4E61FF0EA129@yahoo.com> Date: Mon, 10 Feb 2025 13:48:07 -0800 To: diego@bsd.com.br, FreeBSD-pkg@freebsd.org X-Mailer: Apple Mail (2.3826.400.131.1.6) References: <566D4C18-A850-4394-A717-4E61FF0EA129.ref@yahoo.com> X-Spamd-Result: default: False [-3.37 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RBL_SENDERSCORE_REPUT_9(-1.00)[98.137.69.83:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; NEURAL_SPAM_SHORT(0.13)[0.126]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[FreeBSD-pkg@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.83:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.83:from] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4YsJ9P3Mnfz3PLF Diego Linke wrote on Date: Mon, 10 Feb 2025 12:07:19 UTC : > I noticed that ARM64 packages take a few days longer to build and = become > available on the official FreeBSD servers compared to AMD64 and i386. The amd64 systems are generally faster and there are a lot more of them used as package builders. There are only 3 aarch64 build systems: ampere[1-3]. By contrast, there are 10 amd64 build systems, 3 being fairly modern and vastly faster than the ampere*'s (far more hardware threads, for example). ampere1 cycles through building and distributing: 141arm64-quarterly 141releng-armv7-quarterly 1341arm64-quarterly 134releng-armv7-quarterly amd64 systems do not build that many variations on the same machine: in fact each normally only builds one variation, no waiting for other cycle members to finish. As each takes longer, the next time it gets back to the same type of build, it is likely that far more packages that need to be built (compared to the analogous amd64 context). It is not as extreme for quarterly as it is for default (a.k.a. latest). ampere3 is similar (default here is a.k.a. latest): 141arm64-default 141releng-armv7-default 1341arm64-default 134releng-armv7-default ampere3 likely builds the most per poudriere bulk run compared to ampere1 above, taking the largest to get back to the next build of the same member of the cycle. ampere2 has only 2 cycle members (as stands, main is 15.0): main-arm64-default main-armv7-default So that makes 10 separate variations overall, spread over the 3 ampere*'s. amd64/i386 has 10 separate variations as well, but 1 per amd64 system that does the type build. 141amd64-quarterly , 141amd64-default , and 141i386-default are what get the fastest 3 builder machines. > For example, last Monday, Mat committed the Bind 9.2 (dns/bind920) = update > to 9.20.5 in the quarterly branch, which has two security fixes. This > update was available on amd64 and i386 2 days later. It's still not > available (after 7 days) for ARM64. Expected sort of result, given the resources available to put to use. > Could we prioritize building packages with security updates, = especially for > the quarterly branch? Already done: The more and bigger "default" builds do not complete for the machine time on ampere1. Mixed on the same machine the "default" builds would further delay the quarterly builds. > Is anyone aware of any initiatives to improve this > process? Unless the aarch64/armv7 system resources are considered as part of the "process": it is not basically a process problem. (I'm not intending to imply that "no optimization is possible", just that such is not likely to lead to a large change of scale for how long things take in order to reach similar times to amd64 now takes.) > PS: I=E2=80=99m aware that I can set up my own package build = infrastructure using > Poudriere and am considering it as a fallback option. However, I=E2=80=99= d like to > explore whether we can improve the process for everyone. That last note repeats here: it is not basically a process problem for what is the major constraint. =3D=3D=3D Mark Millard marklmi at yahoo.com