From nobody Thu Jan 27 23:51:05 2022 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 06919199570F for ; Thu, 27 Jan 2022 23:51:21 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JlHRX0y21z4qLp for ; Thu, 27 Jan 2022 23:51:20 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1643327473; bh=gHpqo0wQqf1te8qTLpkEDS+fZB5bXjsvren3PTsk170=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=D3tBMeuZm1Q9f9PJY9WXgYUrPcm0LSRepiNA5JmeVMn0am03TWndQDCsEIlW1YuF7yppTx0jmCCYRhXAWvvzENRdqc2bnbwzrKmD8cgjnVucmCh2801IN6v0VoL9MsjbdYUE5s9ZB1XjRN9yF5Tu3IiMJ+xf9t2pGoWW5e9P0TgyrAiZEi/L0U6kJm8+NNnRn1geCouOUWd6gaeFBlEKSVZQo2G8s0L/F8Ku+HKyYpkVlojoyieOTN3I05vLW29170bbUDniF/MPwN9xbr7GFzhtRqFjHURRmOG/7v4Y0Xti/8aZGbi7HALKKtefjyceh4yJ+5zd8/vxLMRrOiKRQQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1643327473; bh=Saab1kWW4BNRQsbXmyoxSbfI4r0ym5fwizTujFpOwuD=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=K+cD3DRrktKj3PUdDaj1xffwImLkciZmeLrZUL8fji8P1zKqDF7S78bMMcdgE77Z7pbpjnAeA9xLzii0PXeGV718/RskqX9X7wEeEpGzE0eC1ndCcICCOJ3ZrC5kM3ELFIdYA3+Iuqh4HLyb7WuezJwuZ2aJpkYiCnG4QpGsY94PkpqdXTzrBC1elx9qKotRchRMouFSHuHONyhcH33mXjLa5dQr5c3UqwUqOIFwWlNbH82IZopoN4rGPG+XA0OlrONOFXlxn7UY3PHqaKlovbs52uQ1hiDFAAiGMKNrEV4nrvy2fCupRE9eyybn3NH27+Ise3WXeDxz/P2P9/evfw== X-YMail-OSG: ZFRimQoVM1mkFbKEiN2IXh856hm8ENYpjFqxHmPRrtA3wZ57aoTgga4iKvDheBa odS4QsG6A2bNNbnceZ8u6BHG6DxZPsK3fihvBYAfRls9PDyVTPGa6Fj4CcBeV4p07iFvRw3rIVya ODg3OV9jcARLGQDj9I1BnVVRWPA9IxFnGaBUWVJRJJGKLJ6gpwPwna2cPBO7pxFIMDIeEJyMEOWB kaYAxVQic6ewLsPvYuW4X3b7HTTWGdgHoeXA19bhSqLtc5UaWYhmIOLPb960IKX6O9wfgKjWzMbz 71JcMx6QEHrDIahi79ThLCXCt3Du_sHFvcB7toPtefbcozw5kIPnXNbcIKrbWyh3kLHTr.I3SAOO drXmgVpH_J5YfIeqS6QOrL4AFC6I9PQ4tIJNVEv17FJo9psa5QS3o0EggmX2l3c2_bQiDYsdMwJc w8c2SMIjeswSSEHizEonQQkmfKqGweAPf7kH9qh_KEUo3Aiqf8SE5osr0wlUZZa4_MRcFfka5rY9 Duxr4FeKp1XPANdaQf0FZwtcqR5KAtwFXpSjyKTTlT.bWVy9Z4ByBqUCAoIWyRM2OzCfHih3vmlg aG86tNOECuyjkwkqkNH3AWiMT6Q1IWd8eyZPIVUNnV_tk7wVn7FSYBYRU1mHWXacRC3n.mZNs2Fu lXJS3OCoy3ZEvpCbYZZjFcUL0SEoaae9EY9e590JeF66Wa8.F8Jrl.Hbwa6nAd2kKMEPCchDQP3Y MHPrCAKZ8bxIAIm7FR5rIlXLpReXNP5XCBqZrjxhxVsoY1G.w7tV1LcLSg1IuM37T8cI4nWYSSbN k_1UWadMzLJMFXMg72nwUtjc0BleeGu_iO9IA5bhPdOE1l77tmWsjfoulFbgV6XfuVo_kumpcjFF 0kAbPp2S09qqKzXAXxLUrx6ggzaJGXxdMUnt3EqB5CKYjiy7gAuC9ibB.yEVdBI0HsK0MLcCddfU ktWFCQ54YtS2SgPlvBBIdcccMMIyFYpyKrLiNZKUWyXVqqrdzC5H0GC3PiLtH2y9hrCbiAdzKzMh USdNntkzNQK7RFNZAAlyL2FFaqeVuBqy4bP5PdorNEPcaiipT5aLE1X8LaM0npk6nSXaGhUuzTj7 xn0J3gRPz2YEyKA.CG2I692t0Wt5Sujq8721FZe7L.aUuA7P.c01ZgLYduo7t_1kyDJeIvKN1tnD mu61Pdz_zlPlKyOsIk5NsZ9YonRQu7UHvCwTUm1Ubbh3qRAZR2lJLl47vlJkdY_TX6xyGcZJoSNY JKrWOLK37OT.1oq43hAhI9sWA_DOJsXS9QFSdBwHSzXLlofioC05W8_TSFWX0pamNsLpG_Z1sj81 RlTqJHGJyMFPRrjYlFMycWQ_gqi349PAmjcYB.1jdnfFAnqhrQfLla7WOMposN3JtKqE100UFXRJ cjSUIOEr1XljKZ9_DLN34urKLN1ILbh9_6ZBB06gzKIrwx1MGv7bPLjRKqTx4n2XAAlRkXYepT.E 16i7p_nTYTf6CAbep0bfD4S8kzYZa7B4TOwxexvPjlYXBGtWsv1U36Veb.n766ieNpg5RQIeJlDo 9kZZ3SsPceNbKdq66Sy79olSx8UP1mIkqCuYwi3na9Z3.lpfOXsOgh5BCLAoYSnxX82ZfaE4O8hs Ze89ieVMBXEBlLt1Q819rHTjVpKtr26B_8engoLDlhDOhxiM9BhReUu.MFbUm7pQ579PdIbdru7y 09ss5zuBpzlZfsDJuLdGlmTyuCfVdO2lkB3HfyqRlLpFVDqegfWanFsgpNmKt6L6FXwOPyYyxGwi 3rsqZErdL8gW0Buavo.6gW7X22Pq5vESmevWgokpPhaNyeGJBnqrRmNjSVNldNbh_iZB4qnViKJM U7GPtkW1SpJmW.ZbmlJDcRjabNchHY9lsM12h5kuWz1SDMc_z7IyE5QO54S869aeMVFQ0haXjvHj uuUdmA8OL9aKnreVmdhuaxjV2050xMZrtW4sGaF08eOIr5REx8QzLDi.toDu13K9DSDKDF09r_jH XXcHPzmroZpo5wp0wdr4g3JNimDhjKBrYn4zDJhfEcL94Zb4pk.g20ACxlGMW.E.R65RVa2KLZwD uzJUueaAlMXCIknpi2KqPTDKni7omvNYOG8YobJd86vS5GWVEW.wLuEPSuu2ua__ZBBcAD.6BEFu gRjgadSs1iMGLskaatolLr._k1HNO1VpnCgyJGUy3InxXQYop0LsZpPh0JQ1bkYgBUyZwvzBdMjl WQLVbaJJBCH52EZ9OMSlz8plswbR9MTzh3ryBEPi4FZbAUCgc1kxenK41rbKjUFHSYWWy5czoge2 sIk1sLWn8JWiNbEs- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Thu, 27 Jan 2022 23:51:13 +0000 Received: by kubenode550.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 3c77974896e9fb41811c8a7143aba5bd; Thu, 27 Jan 2022 23:51:07 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: devel/llvm13 failed to reclaim memory on 8 GB Pi4 running -current From: Mark Millard In-Reply-To: <5E861D46-128A-4E09-A3CF-736195163B17@yahoo.com> Date: Thu, 27 Jan 2022 15:51:05 -0800 Cc: Free BSD Content-Transfer-Encoding: quoted-printable Message-Id: <72E71144-DBBD-4611-825B-CCEA4C30A6CE@yahoo.com> References: <20220127164512.GA51200@www.zefox.net> <2C7E741F-4703-4E41-93FE-72E1F16B60E2@yahoo.com> <20220127214801.GA51710@www.zefox.net> <5E861D46-128A-4E09-A3CF-736195163B17@yahoo.com> To: bob prohaska X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4JlHRX0y21z4qLp X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=D3tBMeuZ; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-0.998]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.84:from]; MLMMJ_DEST(0.00)[freebsd-arm]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.84:from]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On 2022-Jan-27, at 14:21, Mark Millard wrote: > On 2022-Jan-27, at 13:48, bob prohaska wrote: >=20 >> On Thu, Jan 27, 2022 at 12:12:20PM -0800, Mark Millard wrote: >>>=20 >>>=20 >>> On 2022-Jan-27, at 11:31, Mark Millard wrote: >>>=20 >>>> On 2022-Jan-27, at 08:45, bob prohaska wrote: >>>>=20 >>>>> Attempts to compile devel/llvm13 on a Pi4 running -current = (updated >>>>> on 20220126) with 8 GB of RAM and 8 GB of swap has failed on two = occasions using=20 >>>>> make -DBATCH > make.log &=20 >>>>> in /usr/ports/devel/llvm13 using the system compiler. The system = is >>>>> self-hosted.=20 >>>=20 >>> Context question: ZFS? UFS? >>=20 >> UFS >=20 > Okay. I just started a poudriere bulk devel/llvm13 build > in a ZFS context: >=20 > . . . > [00:00:37] Pkg: +BE_AMDGPU -BE_FREEBSD +BE_NATIVE -BE_STANDARD = +BE_WASM +CLANG +DOCS +EXTRAS -FLANG +LIT +LLD +LLDB +MLIR -OPENMP = -PYCLANG > [00:00:37] New: +BE_AMDGPU -BE_FREEBSD -BE_NATIVE +BE_STANDARD = +BE_WASM +CLANG +DOCS +EXTRAS +FLANG +LIT +LLD +LLDB +MLIR +OPENMP = +PYCLANG > . . . > [00:01:27] [01] [00:00:00] Building devel/llvm13 | llvm13-13.0.0_3 >=20 > I have my patched top monitoring and reporting various > "Maximum Observed ???" (MaxObs???) figures. >=20 > May be I can get a 8GiByte RPi4B UFS context updated and > going as well. I just started a poudriere bulk devel/llvm13 build in a UFS context: . . . [00:00:49] Pkg: +BE_AMDGPU -BE_FREEBSD +BE_NATIVE -BE_STANDARD +BE_WASM = +CLANG +DOCS +EXTRAS -FLANG +LIT +LLD +LLDB +MLIR -OPENMP -PYCLANG [00:00:49] New: +BE_AMDGPU -BE_FREEBSD -BE_NATIVE +BE_STANDARD +BE_WASM = +CLANG +DOCS +EXTRAS +FLANG +LIT +LLD +LLDB +MLIR +OPENMP +PYCLANG . . . [00:02:13] [01] [00:00:00] Building devel/llvm13 | llvm13-13.0.0_3 >>>=20 >>> (In things involving memory usage issues, knowing which is >>> always appropriate because of differences in memory use >>> patterns.) >>>=20 >>>>=20 >>>> Your context proves the metadata problem really happens, so >>>> the messaging should be fixed to not be misleading. >>>>=20 >>=20 >> I looked for and didn't find any "too much swap" >> warnings in the boot output, as expected with >> RAM=3DSWAP. >=20 > Good to know that nothing was odd about the boot's > swapon activity. >=20 >>>> But it looks like you have identified a test context >>>> for the "swap blk uma zone" and "swap pctrie uma zone" >>>> handling. >>=20 >> I was hoping to reproduce the first failure, with clang=20 >> exiting on error 139. Just for curiosity's sake I restarted=20 >> the build of devel/llvm13 without cleaning. Looks like the >> result won't be known until morning.=20 >=20 > Note: I dropped Mark Johnston from the TO/CC --at least until > we have technical information about the vm subsystem's > behavior that might be interesting, such as which metadata > caused the messaging. (The context being uFS may have been of > interest, for example, but nothing in my reply does him any > good.) For reference (lines split for readability): # uname -apKU FreeBSD CA72_4c8G_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #37 main-n252475-e76c0108990b-dirty: Sat Jan 15 21:53:08 PST 2022 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400047 1400047 # uname -apKU FreeBSD CA72_UFS 14.0-CURRENT FreeBSD 14.0-CURRENT #37 main-n252475-e76c0108990b-dirty: Sat Jan 15 21:53:08 PST 2022 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400047 1400047 =3D=3D=3D Mark Millard marklmi at yahoo.com