From nobody Tue Mar 26 19:46:25 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4V40g845Ptz5Fh1t for ; Tue, 26 Mar 2024 19:46:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-20.consmr.mail.gq1.yahoo.com (sonic305-20.consmr.mail.gq1.yahoo.com [98.137.64.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4V40g74Qh9z44dn for ; Tue, 26 Mar 2024 19:46:43 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b="Y4/ZJM92"; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1711482401; bh=LCI47Uzfqt/shcd31ZqC/Y7ICfL1KPPiCx43f6dQyx0=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=Y4/ZJM92GEmJp173Jp8lS+dOtaIrvk+If716Z7h+OPAcgnptJhntl11hxpbXbZmvff6oe0lFaVBW5sJvt0z01KFg5XbdWILfJXOmWk8vQIr5BWatml3p09b5GZqordOPhgxrnedc5C7V+dQAGYPvAz7cwfYkRFyKqyl0VONxhfD6VcQkliQm31fK9e5i07vITHI4J6z9RE4LXLCjxzjWgeVbDuG3U8HnmmYo0jfrQL07UIv3zqoAJCEORTZvh6vcgLMeq8qANkkXhD7f/sdgargu0IZzzf+fbK1JAHJBXcLmvYGMLj3oCYdlgpJBFQmnFfHFwK9eHOBOw0nAzy1iSA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1711482401; bh=sVAIxJ2VJ7AAZuOrA+X2HMDLk26BIdXUUqTiaUnNgZL=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=eBAlbS+mE8QQX5jMDc8YttMKLrbqgaWme4Wk+tzzrjpMC4S9f8Dy7CmdwCPXO15mCdDdPNwk/LQOMZFOi93WcZp2ELNqSRJfEk4uGdyvMd48zTbGBFj2efbaXdmeHoVAJ8IABQwB7/6pyaPOfmKbBbiqaWMm+Cr9yKjn8JmK7WYBVjtiJ0hn6pERtL6QAaDW4Y8b7/WyS43XT96JqqpVPMd22vkf+7Jr+XBxmlHpBZE932CqSEYkTedHieDZ6VkxS2NGFBLebQw7ZGsIyjvRZ9/t26xX4c3k5Qu7MflS20q5lplqrkXyoz/lYlL9648jCGw7MJbc2AnADS69llKEig== X-YMail-OSG: vFe58XEVM1nLD.omO3vZ7N0xogLte1xcXR_MueJK5.ZtPe7VBEzL2rFrZZ3vdCg yhQhgBSAYs5jXMoUyu288Fn5Sg3AbYGzE07M8VHe_sAiC5PNgy.1gtgGEwKzF65hb3SgDDrTYfrr GTR8qhynoJMZDllW39O9235Q4bJ6jx73P2SAJIF_Ey3SL_i2wQ3EZuf8BiGV7Fgx8KjTG26huod2 KqIbrgpsnl.Od_aUec3MZczgLVNdUuZBnDatxA6sjQiqBLt5D_8JkYP9_ssmnz34d89wm9NMOp0u ABTKGtfqMcmdtsIm0oCrOcUDMbJhsDky79dwgp.AAFhkAiAYLh.dYB7Z.tQ2nDr0Heif_WAsQ3dO Fg7RKNPmBkfcfKsvaCzp.mn7xxmI3sTGHSLYn.fEMf2EBpcRaRZb4svunRy.lFyhuHCLDdUjdgF4 hmKueRMUQ0_jQiTZcIacn90BM20rCFmqy1FqNXZRGLEv2XbHvU6I30g_m0TcPFX.oP0nDbX_noWZ AqgHDaIoXJos3sWJNkPmFKiHqEtOFIXbGjik1LLNtBl8kxrRd5BqE2Fy0OnTOIvEKNhj5UCEwHn4 3Q_F_arB7hP9d1pN4eg9xEgr6IV2SrYNq.5vIkFSdINKl7KL8SCPY4uURhF9A425_Wz0UJPL0Vrw QqL1d_0w1Prbx0EuxRJuZJpJRirxseOmM.6.KYjZHNffTFsfg5wKJvLMA6B95YEHYtM4YRQzK1J_ Au__Dzqy5mgv1zbVO6PhTdeKDvbDqclQNgTKm9_y01R.UBqmaYHWbYILkn6KDZL7T3jIVM6n9NYH C7mqFuCRryFq3LOEEJ707Dp7XQklPtjWJHjkgZx10dY.ebs7K2Vmmx0o5rjNma4S.Q01uELdJur5 glSqmK9_yjBOt53M2_1SWOZ6Yzd_.tfytx1nNXK5hHTE35_B13YmlQf7l7G2jDCY0GU28VQ1l0dp 8UIMOtOClUiZd6IpyviQbR5BXHmuS19XIz4burkXnT7K2lq5.9_Ag48bhil1LTSCn26em.jckaC_ 6kdM3J3TKK0r_rUuTNOHDoINVw8wIxV9cvjHPmxg3RroD_PdnKtgOy.AxwsxhaoDhklZUMbfVi43 _b61xLqbOuWjv5vLw4VHfZ6VoOlzHE1MeYCzGWdyueD_CXPDoa0TcZLFIegQfG1KJlLnfb8v_J8t Wll.e_mm1SjYJxhL6NYYjtJZKjtfp5wIs1BpRrXzbd5S4JlWgQH8cn2tgiZqoR9FMjFcV8.E3jlR f1otnXzLbdu90pcGmJW25PrXk0tJZG_N2wrtecRwuFFr5f6GcIl4LGOP25ZVhjuN0A.i0y.cX1ON j40Vre8aiQCjXMIJQidpw8L8BtkDNhDNkM8gfcWGag3TyGUGmTf1ZkTDJ8iLq4uO11zKuUajfK.e FHV9qsNpgLK6rvoBs50.iGet0hZKaDftNUn_2_pdwhaPq8tPbU6dzJvY4Kuje495hLt0RW8VLpTs TteABVAotUaGkJBCK2C0oxvec.0QObyEZGbV1SrntDffl3IYR.Q6EmO8phcUFoVLHqGWkgIHAMUq c2uk9zLpWvbR5toSGKFrT2dhXKeo5iHVWpSyTryCNPdbvxZivqsGZXLwAZHXCbWFUTeSHhFN_1_S Tj6.lb9UZiCWLTtXKnMeBah7O0ARmaHP_EkpuG1Q2C8Weh_iKDAJ0s.goN12Db8O8ubz_X9W6NF5 HzcdX2pbIgdr927a6MauJIVH0HwNVkx5pIIS68_Barinp6zrG56p4TdOGZYvtRCBBbY8jlal1m2J mZz3hcxYDMAzR3x9duydMhYP8EJYAtWsuvbQg0awLHvbe4jy034BNk5IFe3MF5l.Jqk.XCLWhQRv T.OKtOFqOC5kLeybp6QgFHEUMhwt4YCQ2HVV5lOOjx2pUqtD8GPYWRdYKa5H3JEBEyBdrhok9FGX J4jzwotFHzKucU2g4v6o4ScOTtE_GCPNL1wCBMrGPbHBb8oCYQGxIZsABR9y4RV3ZYC_byqcdiQr 4PXgiDw_A2ZpZraoGAbnIvyeo18XmT7sQIHDic1au3wxV4.eoMya6T1VCjYJBxZRmK5gJcbVOfwM 2a1Ob2poG.Qw93o8XS8IdhQNBupnxjC68BdH8Syndm20zJayK3lmNUpRTd6j3zwWDeLZNTpS9we0 SIKzjcOlxGJToPbq4fzxTbJxYw.1n_pamuX2NMjyGd0UYyEBB37nbA2i_lzFGMp9zW9IVaJ3dMaF dutNW4xtaS8aKoSLV9PYsYQVKiZK7BY7p._UiXYeE3UxKjXaX6wxMH.vla8jFOI6NRIBtNYrUInE - X-Sonic-MF: X-Sonic-ID: ebc3b4c7-8e43-44a2-84cf-c2f7f6ece846 Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Tue, 26 Mar 2024 19:46:41 +0000 Received: by hermes--production-gq1-5c57879fdf-27p5r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 2e4686134e8f9dd1a749f41fa9530510; Tue, 26 Mar 2024 19:46:36 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: devel/llvm18 building example: building with BE_AMDGPU can greatly increase RAM+SWAP use compared to not Message-Id: Date: Tue, 26 Mar 2024 12:46:25 -0700 To: freebsd-hackers , FreeBSD Mailing List , Nuno Teixeira X-Mailer: Apple Mail (2.3774.400.31) References: X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.96 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.959]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_THREE(0.00)[3]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.83:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.83:from] X-Rspamd-Queue-Id: 4V40g74Qh9z44dn I've been doing some poudriere bulk testing of RAM+SWAP use by some package build activity recently. The below is based on using amd64 Hyper-V to run FreeBSD with 2 GiBYTes of RAM and 4 single-thread cores. But it should give a reasonable idea for aarch64 and indicate the direction for armv7 for such core counts. (The amd64 Hyper-V context in use takes far less time for an experiment, like hours instead of days for the RPi4B overclocked and for the OrangePi+2ed .) I started with my normal build context analogous to what I use on aarch64 and armv7 systems: A) BE_NATIVE instead of BE_STANDARD B) No MLIR The examples here are poudriere bulk single-builders, effectively with MAKE_JOBS_NUMBER_LIMIT=4. I use a modified version of top that tracks and reports various MAXimum OBServed ("MaxObs") figures and a little more. For building with BE_AMDGPU enabled: RAM: 1402Mi MaxObsActive 807392Ki MaxObsWired 1944Mi MaxObs(Act+Wir+Lndry) SWAP: 5329Mi MaxObsUsed RAM+SWAP: 6534Mi MaxObs(Act+Lndry+SwapUsed) 7089Mi MaxObs(A+Wir+L+SU) [Abbreviating more what is not additional] 7254Mi (A+W+L+SU+InAct) [Abbreviating more what is not additional] (The 7254Mi (A+W+L+SU+InAct) is from when 7089Mi MaxObs(A+Wir+L+SU) was live but is not a MaxObs [MAXimum OBServed] figure itself.) The peak RAM+SWAP is during llvm-tblgen for AMDGPU related materials. For building with BE_AMDGPU disabled: RAM: 1401Mi MaxObsActive 786872Ki MaxObsWired 1944Mi MaxObs(Act+Wir+Lndry) SWAP: 1252Mi MaxObsUsed RAM+SWAP: 2613Mi MaxObs(Act+Lndry+SwapUsed) 3160Mi MaxObs(A+Wir+L+SU) [Abbreviating more what is not additional] 3190Mi (A+W+L+SU+InAct) [Abbreviating more what is not additional] (The 3190Mi (A+W+L+SU+InAct) is from when 3160Mi MaxObs(A+Wir+L+SU) was live but is not a MaxObs [MAXimum OBServed] figure itself.) The around 7254Mi/3190Mi =approx.= 2.27 suggests that low-end build-machine activity that does not need to build BE_AMDGPU possibly should have devel/llvm18 configured to avoid BE_AMDGPU . Notes: The 2 GiBytes of RAM forces memory pressure required to observe reasonable RAM+SWAP usage figures, at least for package builds needing a sufficient about RAM+SWAP. === Mark Millard marklmi at yahoo.com