From nobody Sat Jan 29 00:33:11 2022 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 421A01977BFA for ; Sat, 29 Jan 2022 00:33:25 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-25.consmr.mail.gq1.yahoo.com (sonic303-25.consmr.mail.gq1.yahoo.com [98.137.64.206]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JlwKb6W94z4Ssw for ; Sat, 29 Jan 2022 00:33:23 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1643416396; bh=wpiDUSRbbdO/i5EovUgX7eOcMVk4cIxRIesGFdHgQrQ=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=EuENBx/eBycG1OpA0kwV1FCE7wY9RPWBnshCfuFYzYphEImAc6oh0W2klvKCkg/+xtJ6FfkbGyO50PwROY1GNqOByyZrOmvqoVqWNG8igQN9ItRv/AU/9dHtxWID5AyyyzfZCKH6p4YEVjc/o/2WZ3TWFjshDn+1bHGrEZwtuBGS+ETOT+7GsAU4J/+N54JpDcG6uurAXXbpHHapS4mDoWioTKiVFSD/aACzZdjvx77huZBmAQ8H8t/B5tipkPx83MTR3zx7IF8r+ZCe9lwwTBHLDUsJoY34CY2nRFb9SPt+m8TGwyrmnFCd8AcmqbKBMmX6fPxsZNk0XyoQWUcDLA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1643416396; bh=zgHmTwb+g6U5WWrkwoKR2qxJRgivtuArSvb7IpyPWz3=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=ZVtunJJKOmL3aZqn1DhjfqM1cZbSaZui3woYJkaA+dBHLsoPbVSHyJcdwAQqDBkpkVxhJiNMYilz8EbFrk4miqXYQrkmdegMeOrLa7wHjoc7gU+Zr/lDE97of7Tu5Dj0sT78y7XvXBgar6z95V5wKMRnY0a9bsqNYmYmbJj2IJ3rWscEBk8uTxLUCUwvmZ1Y35hQPQNQwKRZA+f+U7hvsGCoZ+6O07jv/PkNCeKlQ5SeePjSx4sO+5EmXW++71NA1TQwLO0OFwqANBb8JTX7f3kDXy7Av0Ex7RHf9Z6SjzuEXS0M25xh97dgZuXBVmSlJOML+7izmkxxTvYFinBWkA== X-YMail-OSG: mIwT0zUVM1l6N6.B7yB4SFU3ggYIjOwm5EnOw.mlGJAn8Wy2DKmN5dZV1Gj1ua3 Fj2NQobo5IuBuJO_I8mH5XJzTY6F4MRohlPQYYw9SNa0EKY1OFbt5RLCsZ9O8c8X21jR2LDEq.ST GYi4R0hdC2Rhe.LssgR3twRpCe.SNg_vjUC933Bl4UktE5hZP2QzpKQZa4H9lL7BwHFOtl4pM9T1 yYMuPMr8ExxANkJlXSPtRLfAx_uj313bO5RbEVr1D4Qa27z7nHL8jt5DhrFCvZ10xb8K9FAbb97m kDzRhEzrzb6g7ZI1Tsh0zUZD0J8b9Z49Bcn8psrrLOhckeKXJwJPaX45l.bGBUgFkh1pzjL3xbua rQoYqcxADGsJuPYhMFyLkn35QjKlFs.hyfkUiQumE3ricsKnGCX8mjGyV3U50E2WQj3dXUH_21Q8 JueVKL0BJt2YFnMCJmFqdEV_MNglay5bWxhGJOx5bRxllCZRlig5FHfAZtBzHPrWp3zlDV6zCG00 Z.lJymMpbfx6HGDVzgUXV2kmlDDwoV_siBT06wQN7STw68Kb03MVpVfYJovAiFDkz_..oXgNEJOr BzfoC0fNmklDNqAuDE4uhpT_KuJtd_ClLJOfdrAVjID1C1hMCS3J7yw2j7fzAfWWWa.h1Ll8wyYm RauTSsLvvY1Ay18G_0uvtRmiFAZ.pyjhdDIllwX8_B75f.7MEPcFC5Afq6ppYleuZgB1Sbc5tH0n CMFKdSeNWXknW2ObD1w9yROixKGgVSpAKSN3afqWsfdN_MNvV0SBIrtuOsqEk53m5GgSsb_dRRAJ RJHIwME3LenlZi3N3GE3vh_HtcQACfVZ8Cz0Apoy5uOp.qrmfaR8ovRWO.s04LSxIJXNMvC_3vqM uFLSX.IKhzmQAMt6S0HBX3FujFI3X8tUEtsgmg1.Z8za4Kc1TWNo_6948cGXSrWrxZpqIxVNrW_H Xr.qUg5lawOhOi53psApbcofjltAYtMJSN78v22Tkp5T4bLJmvY9ZjdIBLsslBIkZ7FDZlAcRwM1 v3M1lpmg19Z98E9pQGucG.gEo0LE6pfR_Hevsv31HeOao4aPCTaHZHmZ5KKk4Fp5ZwPpvIjixSjn rrf1PDyAS3QJU5fLes4nECzRXa7XxXqGk38r4Xe9t37SHdx1xmUHv0TYu1QtztP6qPpGd9FmfJtS EJgALFNoSlL7YPllq9eGJ6hKzx3NvT1F80IDomorYE2GCSVILsOV9TgzsYVLW6T6UweNTuJHuCFH dKrxFydhY8MDg06HgE2k7.un4ylemhKdyeDCj8ecpL22Yd25w1fd0PxP80UE4lL9fviB.pxZKJsh Zz.0dfbYpIkxM1KeA4GiOSoNJ5TCEVQ6bfBy3vcV98p0Lc4RtzqKc79WlVp6_gHGF_8c9JqJvvYR nzz9Qi98DKU.ZwdIjb7BBcos8sF6__7UgXbEbNN8neaguD9SLRhFxd.DzKBGierY7cOaPOymiTdJ zjuLuAozDhoiry6MUUkcUt_ExyxCY8Ef2iIegCYIDeT33RRkEUlaB.zapSJAwHc9F9UelT9HNW1U uDr.ti6qM8GrxNWC9M.RnUCcINut11r5W1nYiZ5WuAVh1UMg__8tVoJDArcS0ML5b75344aNb0fc VK.VsjYZOZ0vqrjdqlWoneDvlr32sd35uUDDPBdo2CcOMYAVa5i92Ccwb8ScwIDwdUCZx9GjDUde iTaDWAQaWwNooWI7HTE0UQLJoZk07O8Q2.9nV5zv7xJrVdY6DpZhf1Y4EwDynxIc2rGB9p8sv16p HCQzSO8wAzkqq4VIgZDvWNKH073Wl.dEqFV6QIJOFd.ZbQYop1evsrUM9iWLZd8XjQghzVVz4zNq boakZ7nTvPrUfT9O8_tOuXTzzb0jEVGgqcqxBW2Sh7DVM7CXtxKQnc2jJMt0z6CX1kIYJTDAumMe EO6hwINFY0DFtI2zR7Ey7cuXy8palBKSv_GBvVJaA74MrrKvfLk4kFWruQRlg5GAiIXcQau_uXZ9 qSC7i3r3Qsh3RpvlF7dAJccO1dc3HCAxXQ.7WUBh6W6zFrU94OnMLtvLV4KRbxOTS.36nOlqbuE1 IyI8aTLhsJC9VmVyGbKXLrKbYvQOL1gETAa5lRYCIg.DjnYrtNajx9UYEAefKvWYq3sfmGdscO8c kpTPW8b2LAjOqaLrF6nlGMWjgRQ41h8_bpnOAD07flU0sf7puKdztvr7fkEpMf3FKmsE9d.AfCu5 HhPKLjp5BLmhmCdt2ICuGIOBgqZiqn5YP7mfmJobZirkhNvNzZEMqNN9rlhKmAFEEbyEzi8lEv_l _5hVQMw35ZwM- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.gq1.yahoo.com with HTTP; Sat, 29 Jan 2022 00:33:16 +0000 Received: by kubenode514.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 7767b1d395d075a9dcc219bf45e75b7f; Sat, 29 Jan 2022 00:33:12 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: devel/llvm13 failed to reclaim memory on 8 GB Pi4 running -current [UFS context: used the whole swap space too] From: Mark Millard In-Reply-To: <20220129002017.GA58768@www.zefox.net> Date: Fri, 28 Jan 2022 16:33:11 -0800 Cc: Free BSD Content-Transfer-Encoding: quoted-printable Message-Id: <03306779-68BB-4C87-9B03-81756EFC519C@yahoo.com> References: <20220127214801.GA51710@www.zefox.net> <5E861D46-128A-4E09-A3CF-736195163B17@yahoo.com> <20220127233048.GA51951@www.zefox.net> <6528ED25-A3C6-4277-B951-1F58ADA2D803@yahoo.com> <10B4E2F0-6219-4674-875F-A7B01CA6671C@yahoo.com> <54CD0806-3902-4B9C-AA30-5ED003DE4D41@yahoo.com> <9771EB33-037E-403E-8A77-7E8E98DCF375@yahoo.com> <20220129002017.GA58768@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4JlwKb6W94z4Ssw X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b="EuENBx/e"; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.206 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.206:from]; MLMMJ_DEST(0.00)[freebsd-arm]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.206:from]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On 2022-Jan-28, at 16:20, bob prohaska wrote: > On Fri, Jan 28, 2022 at 03:05:06PM -0800, Mark Millard wrote: >>=20 >> I'll set things up for swap totaling to 30 GiBytes, reboot, >> and start it again. This will hopefully let me see and >> report MaxObs??? figures for a successful build when there >> is RAM+SWAP: 38 GiBytes. So: more than 9 GiBytes per compiler >> instance (mean). >>=20 >=20 > Am I mistaken to think there's been a drastic and abrupt increase > in memory needed to compile clang13 and friends?=20 >=20 Not that I know of. I've still never managed to repeat your RPi3B + 2 GiByte SWAP problem (.cpp and .sh example). I'm still trying. At this point I've still no clue what is going on. One thing that you could check is the content of /usr/src/lib/googletest/tests/Makefile.inc . It should look like (up to email whitespace oddities): QUOTE # $FreeBSD$ .include "../Makefile.inc" # Keep the existing tests directory structure (with subdirs per = component) # rather than installing all of them to /usr/tests/lib/googletest TESTSDIR=3D ${TESTSBASE}/lib/googletest/${.CURDIR:T} # Clang's optimizer spends a really long time on these tests at -O2. = Changing # -O2 to -O1 reduces the -j32 time for lib/googletest/test from 131s to = 71s. # Using -O0 further reduces the time to 29s, and also reduces the disk = usage # from 144MB (at -O2) / 92MB (at -O1) to 82MB, so we use -O0. # Note: Building without debug info saves about 10-15% of the build = time, so we # only enable debug info if DEBUG_FLAGS is not empty (71s -> 64s at -O1 = and -j32). CFLAGS.clang+=3D -O0 .if empty(DEBUG_FLAGS) MK_DEBUG_FILES:=3Dno CFLAGS.clang+=3D -g0 .endif END QUOTE The part of it that has: CFLAGS.clang+=3D -O0 .if empty(DEBUG_FLAGS) MK_DEBUG_FILES:=3Dno CFLAGS.clang+=3D -g0 .endif is important to limiting memory use for building googletest. It is also important to not have done anything that forces -O2 for some parts of googletest. As I remember, this issue predates clang13 but still applies. =3D=3D=3D Mark Millard marklmi at yahoo.com