From nobody Sat Jun 04 21:49:21 2022 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E7AAC1BE2685 for ; Sat, 4 Jun 2022 21:52:57 +0000 (UTC) (envelope-from saper@saper.info) Received: from q.saper.info (q.saper.info [IPv6:2605:2700:0:2:a800:ff:fec7:5c61]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "q.saper.info", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LFtls2942z4lPW for ; Sat, 4 Jun 2022 21:52:57 +0000 (UTC) (envelope-from saper@saper.info) Received: from q.saper.info (localhost [127.0.0.1]) by q.saper.info (8.16.1/8.16.1) with ESMTPS id 254LquQq073334 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Sat, 4 Jun 2022 21:52:56 GMT (envelope-from saper@saper.info) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=saper.info; s=Sep2014; t=1654379576; bh=17JdTYDeaId6UAmwg+JDUTTOLbMq053A+bHZiTju4x8=; h=Date:From:To:cc:Subject:In-Reply-To:References:ReSent-Date: ReSent-From:ReSent-To; b=MK+YDOhzI+miQfDrkIgJ7XtBGi06M0Ped2jHMTGkadClvsVphRCXsowp7s/0Vixed qeqTdDqmN01ulzxup8ZZCh99FENhNyxybnCy73VmLQtfLNMq5IwUfxfj4sYlzizva3 8lVAzrmB4PyiNcKOWqFRmOtu0Uk86RRUDpx9ASxg= Received: from localhost (saper@localhost) by q.saper.info (8.16.1/8.16.1/Submit) with ESMTP id 254Lquu2073331 for ; Sat, 4 Jun 2022 21:52:56 GMT (envelope-from saper@saper.info) X-Authentication-Warning: q.saper.info: saper owned process doing -bs Date: Sat, 4 Jun 2022 21:49:21 +0000 From: Marcin Cieslak To: freebsd-arm@freebsd.org cc: bob prohaska , Mark Millard , Mark Johnston Subject: Re: devel/llvm13 failed to reclaim memory on 8 GB Pi4 running -current In-Reply-To: Message-ID: <99rror60-3pnn-s3q6-2q70-5ss2p968r658@fncre.vasb> References: <20220127164512.GA51200@www.zefox.net> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 8BIT ReSent-Date: Sat, 4 Jun 2022 21:52:49 +0000 ReSent-From: Marcin Cieslak ReSent-To: freebsd-arm@freebsd.org ReSent-Subject: Re: devel/llvm13 failed to reclaim memory on 8 GB Pi4 running -current ReSent-Message-ID: <795s9oon-865s-54r7-no49-323s76pq3o30@fncre.vasb> X-Rspamd-Queue-Id: 4LFtls2942z4lPW X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=saper.info header.s=Sep2014 header.b=MK+YDOhz; dmarc=none; spf=none (mx1.freebsd.org: domain of saper@saper.info has no SPF policy when checking 2605:2700:0:2:a800:ff:fec7:5c61) smtp.mailfrom=saper@saper.info X-Spamd-Result: default: False [-2.59 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[saper.info:s=Sep2014]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; DMARC_NA(0.00)[saper.info]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[saper.info:+]; NEURAL_HAM_SHORT(-0.79)[-0.792]; MLMMJ_DEST(0.00)[freebsd-arm]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; CTE_CASE(0.50)[]; ASN(0.00)[asn:47066, ipnet:2605:2700::/32, country:US]; FREEMAIL_CC(0.00)[www.zefox.net,yahoo.com,freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On Fri, 28 Jan 2022, Mark Millard wrote: [ Reviving old thread ] > After that I intend runs with 30 GiBytes of swap (so RAM+SWAP 38 GiBytes). > Hopefully that will complete and I'll be able to report how much swap was > observed to have been used. I thought I will get LLVM14 + OpenJDK built quickly so I fired up a c6g.4xlarge AWS instance (16 vCPUs, 32 GB RAM), or even c6g.8xlarge (32 vCPUs, 64 GB RAM) and even these are unable to build llvm14 under FreeBSD 13.1-RELEASE with poudrière enabling MAKE_JOBS for llvm build. The build proceeds on 1 CPU only now - and casual observation with top confirms that compilation of certain C++ files requires 7..8 GB of RAM. If 16 of them are built concurrently, no wonder that there is not enough memory. Files tha crashed my compiliation: /wrkdirs/usr/ports/devel/llvm14/work/llvm-project-14.0.4.src/flang/lib/Evaluate/tools.cpp /wrkdirs/usr/ports/devel/llvm14/work/llvm-project-14.0.4.src/clang/lib/Sema/SemaOpenMP.cpp /wrkdirs/usr/ports/devel/llvm14/work/llvm-project-14.0.4.src/flang/lib/Semantics/check-omp-structure.cpp /wrkdirs/usr/ports/devel/llvm14/work/llvm-project-14.0.4.src/flang/lib/Evaluate/fold-integer.cpp Sure, poudrière could get Kubernetes-like capabilities to control resources during the build one day, but aren't amounts of memory needed to build the compiler excessive a bit? saper