From nobody Fri Jan 28 01:43:48 2022 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 97EA51972236 for ; Fri, 28 Jan 2022 01:44:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4JlKxY2qJ0z4Ww2 for ; Fri, 28 Jan 2022 01:44:01 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1643334234; bh=POlbT9tbFhxykurVgTBk72M82vy/Jce5XKYSLeG2dLQ=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=aFD9K1a4w5F+zXksbwUx/uPt5GDuz029lQ/1XKbVHCW/kTFyrh+olfMCwhD5PhICWT2y3cnRYzh23k6CwUrmr4BXONbmSmMvu1CR6RN5cKv1Mn/OCf4Z9XFvQeCZ7aS9RrnNNBRXlFZQYWpCNMgWqnTcxzIr4Itp6tjyNuwljPglhs/XPL8rgGSDNJ3MPgS7vE1gMDxWyi9t3vOjHZ+iu4+phpg6N+bbtUgkL+XIjnWVvUKhlRpQ6kyg/tuZsujrMP7VaWx6Vas2em8VdlOqPmi875cxkkboWZ20c5+yCdYtqOSTapPd6466Eoxwnmeu8mfkGvl1EwHETWdHVtjz8g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1643334234; bh=pAAkG09uHD0pC8GocPabWywfFcYYW5kOCvJ22YqO3zc=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=rc6d9NM4Qwl138duWUF53t+oYcDbPG22M3L4hJVxu5fJv4QXYCxZlB6XKo4hMr6p0NnJLBb3Gu5oelZrmoHZNeEzHFE65Ut6RUYazlsr4MHFpwq/TrzRS74bfOi+bYQLMBbc66MgyeDjQ771FnEDyagRz5FBQqWMCvYXMhPEdn9sXXyFMyLvyyX+QXawCTjsblts4t5UdIZrMzxFWFTyh2vMO2JlA0JksYvbCx/Pt/0+bWYS41aZ9DEW2uDukCq3ngB0NDWglhqWDfssg3xWmHy1KnazMWtta1uEifwNhlyKsY03GROifFkWFjoT1LEL7g3qQ3FUKNWVs+ymD87aug== X-YMail-OSG: wtqF06IVM1nylGRuJ.e.soWA8U6pztXlPWPrXHh.SS8D73cQ8YI1tA0rtBsd4Ce ag_Uv5jtxCrqsC99Vag6r070aM2yWC746tKhHp8EKEn4.6zLYwzlvGStoPLuxB60foF72dov4JIA u6WKr8r6L6l0NcHGN.OV4zsEmynImol4L.p5ytiGsi0K0VN5WgVzbyTFZolkrWYC_qqKS4zJask2 vJQuFsbZq90bmfV_tsSY2atEq1nkCkV.ZewypQ33zeifJQqC3zMwC6R6bwsywqRmk2ga90dH54gg Xyyb3l5HmLqiDL4eYPFyJfAJzt.KIq1P_U8lklgpwU8z1btR4gUOuUuKd6MvoIpJj5ZFTVSpjdrB nxKFACa9AqCaeWGus7eiC2JmVyHVFSuAPhB2WeV7_eHpoYg_F8KPwnWssXqdGsU8XUaDRbKqNDpZ ATtvbGpbgi0TvjV.2z4WkK6oeiApvm2RyjoMi3Stc0IyXGNik1J1r8cLyNskxpwRx0NEWyEoysLZ F8LK3QWzNsGrGrhiuEl7Pg8LGMKDPYgcOCyRm6eyIjZRgP.FH7wNe5N6K48P1aPs8dunLMvENRZY PAKr90NAriAnN1aUM_in.h.4R200BAB7I7QfCF6anY79YOxXkBeSp8eoMmzzyepDPzew99KJIxaM Q6Cij2XsBSbeJZ9ZmLDfF7QcyOMEsDXb3nJORGaERa7scvCo3PLYZGNMbhxA4pzaffkzAcFW3vJx Rgh8pKREBKrirpu63XkQQ0VCf.491naAxKRiIQ7hu37lDcjz_aJS2Gnx9OtvMoHP4vlyUG3CWJ6e BsCS6UKNKTu0H1ZBHIvFHYuQgGuxlVxut_AQw7eutKyz1LaOHzERuDB6apyLmadObEuXcsSs0i8p RLAYvXk5qGXaI6Nh535KvIW99Fvor7CyyU2cjGA1KP_XQYDSKw1k1kqLHvtq47IypVrDB1ztqrbE Ntze5ljpmInm2f3mXBUqCVnpznU2JUEaetMMr53v7gWsESc8tIrahO9.Q6p8FuVJKLc_4.95zHrw OsA4MN.RCWTO7pLLzNgwpVURIxp2cmnlzPIrmiRay2a7cxSLPNfH4YiKNbzsTzltnwIuCTqlF2rz N4kD4qez90rM.OipHJbnorwOFP.snf8tkoMi7CY_HmF2AZDXrkBXvlotVubE6Bh59snXn67UKVJT pPVG5oqae5NcrvgB79nWBKz_7Sx_bYPe0beCnvWGWDD58BpZcH3CA7gOc_SPOekoX9QIjbJ8uo08 KRv2Avuh3RkXZfF9QADzwup95TL1gh_QVTt_eoV8g.SSAO41gLtoD8Apyl33tkVuqvIGkfZdfuHf j9hpcjtvXIg9tKPi47YkjvdUj.yIZYSSxvCDV4km.0e0aTbYmvGHfC66rGq4HuEsUaoo2JJuHsHZ H7EbwnX6i5D6CMqPLiQ5L1FparNLTMp.C9oWySIizCBm8yEXto2gb2rrJwJWnROTd4iLmfBeGJY_ PKyygG8wgUUfUS60W4rBb429pGO7qZ5Jr73pjjQRFBdcF5rbeQZUKYW9glbrjUUKMFc4RLUf3eWe Jd6fXnhZoIoIii7ZNonUzUQ9G581KWhSgweiGVzuTG73N5dw6lDKsM.RFxnF3PJ5C1Im63Bcbfts CvOcZjQL7SlQGNoSTkaKpQS87W8mGlUEGJCLBUaxTYVkjAPr59ulH.0Srk7iWIoYgJZCJL8bHlwg mMDKLB1OK1Db_nSW0ziFtgNzhqQcyYfSfZT4jMwF5oN6oope5A_UYQZv9CBmHryRSgbtsh1vYWqt fVWZz9mZ95Uz7UUV.UvbK2vNH4dGvoh_enY4ycGCvYvDNjVKAWIKbGQcW236u6aczTTl6HRkmjex y2JDWUaZQ5YvZoQ23fgdVSTp_9JMahKQhDi9gqYhr5OD.XkuljemHRPB7bcEYGNqoWkDJEKNAn3I j13AJhDn7a_nfMF188V43zNad0LrTzXYCCWSrh.NGoNQVY0Sp0YW50UbLW2q9gPpED_nAYAxUv.Q 5hmn27y2xzi8pt7SYYMLBY0..OJ75teFVDxpomyj.VV7SPMv.YtMKwzIfgsthT_JbFXqLL._WQnh G8Nc90TXuDfcoA3GKTOXMyjOCBjC2isB4mjtXlTbfLw92J.3TZA_bQwaciquPDgGzw2s715UySM8 TmSFPkNAerL9kPqLHD6f1enLJ.GywSq3tNQlcyfVwq4xC0TmZzGxpiEyWtWUH0PwuFXnwxCL4Z9w 7uO7vHxMJom7mGoenT0HiqkiNyZBTDAklNB2tMO16LiOPQamV27gH1VRlkida4Jvu0iGiUEIvk4n 5zCAcTXnVIjbX4MMb7w-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Fri, 28 Jan 2022 01:43:54 +0000 Received: by kubenode520.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 9af686dde52f5bb8d36f6425200cac18; Fri, 28 Jan 2022 01:43:50 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: devel/llvm13 failed to reclaim memory on 8 GB Pi4 running -current From: Mark Millard In-Reply-To: <20220127233048.GA51951@www.zefox.net> Date: Thu, 27 Jan 2022 17:43:48 -0800 Cc: Free BSD Content-Transfer-Encoding: quoted-printable Message-Id: <6528ED25-A3C6-4277-B951-1F58ADA2D803@yahoo.com> References: <20220127164512.GA51200@www.zefox.net> <2C7E741F-4703-4E41-93FE-72E1F16B60E2@yahoo.com> <20220127214801.GA51710@www.zefox.net> <5E861D46-128A-4E09-A3CF-736195163B17@yahoo.com> <20220127233048.GA51951@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4JlKxY2qJ0z4Ww2 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=aFD9K1a4; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.31:from]; MLMMJ_DEST(0.00)[freebsd-arm]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.31:from]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On 2022-Jan-27, at 15:30, bob prohaska wrote: > On Thu, Jan 27, 2022 at 02:21:44PM -0800, Mark Millard wrote: >>=20 >> Okay. I just started a poudriere bulk devel/llvm13 build >> in a ZFS context: >>=20 >> . . . >> [00:00:37] Pkg: +BE_AMDGPU -BE_FREEBSD +BE_NATIVE -BE_STANDARD = +BE_WASM +CLANG +DOCS +EXTRAS -FLANG +LIT +LLD +LLDB +MLIR -OPENMP = -PYCLANG >> [00:00:37] New: +BE_AMDGPU -BE_FREEBSD -BE_NATIVE +BE_STANDARD = +BE_WASM +CLANG +DOCS +EXTRAS +FLANG +LIT +LLD +LLDB +MLIR +OPENMP = +PYCLANG >> . . . >> [00:01:27] [01] [00:00:00] Building devel/llvm13 | llvm13-13.0.0_3 >>=20 >=20 > Is this ARM hardware, or an emulator? 8 GiByte RPi4B, USB3 NVMe media with a ZFS partition. The content is a slightly modified copy of the HoneyComb's PCIe slot Optane media. The UFS-based 8 GiByte RPi4B is also based on copying from the same Optane media, both for the system materials and various ports/packages/pouriere related materials. (Not, necessarily, other things.) > I've been using plain old make in /usr/ports/devel,=20 > might it be informative to try a poudriere build as well? The Pkg:, New:, and llvm13 lines I listed are poudriere(-devel) output. I am doing my builds via poudriere. ALLOW_PARALLEL_JOBS=3D and USE_TMPFS=3D"data" in use. I have a context in which almost all prerequisites had already been built. (The change in options lead to 2 very small ports to build before devel/llvm13's started in a builder.) (You might not have a jail that already has the prerequisites.) > One would expect the added overhead to increase memory use. >=20 Well, from the context I started in, only devel/llvm13 is being built once it starts. Once it gets to the build phase (after dependencies and such are set up), there is not much overhead because the only activity is the one builder and it is only building llvm13 --via make in the builder. At the end there would be extra activity as poudriere finishes up. During the build phase, I only expect minor overhead from poudriere monitoring the build logs and such. I expect that the mere fact that a poudriere jail is in use for the builder to execute in does not contribute to significantly increasing the system's memory use or changing the system's memory use pattern. There are some other differences my context. The instances of main [so: 14] are non-debug builds (but with symbols). The builds are optimized for the RPi4B (and others) via use of -mcpu=3Dcortex-a72 usage. My /usr/main-src/ does have some personal changes in it. (Some messaging about the kills is part of that.) The RPi4B's are using: over_voltage=3D6=20 arm_freq=3D2000=20 sdram_freq_min=3D3200=20 force_turbo=3D1=20 (There are heat-sinks, fans, and good power supplies.) The media in use are USB3 1 TB Samsung Portable SSD T7 Touch's. I'm unlikely to see "swap_pager: indefinite wait buffer:" notices if the cause was based on the media performance. (You have spinning rust, if I remember right.) I do not have a monitoring script making a huge log file during the build. So less is competing for media access or leading to other overheads. (But, as I remember, you have gotten the problem without having such a script running.) =3D=3D=3D Mark Millard marklmi at yahoo.com