From nobody Sun Jul 17 07:34:22 2022 X-Original-To: toolchain@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LlxgL4hMYz4WTvk for ; Sun, 17 Jul 2022 07:34:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LlxgL2fXPz452s for ; Sun, 17 Jul 2022 07:34:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LlxgL1RXCzsKP for ; Sun, 17 Jul 2022 07:34:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26H7YMf8070559 for ; Sun, 17 Jul 2022 07:34:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26H7YMdW070558 for toolchain@FreeBSD.org; Sun, 17 Jul 2022 07:34:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 265254] lang/gcc11: build gets stuck Date: Sun, 17 Jul 2022 07:34:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mandree@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: toolchain@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback+ X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Maintenance of FreeBSD s integrated toolchain List-Archive: https://lists.freebsd.org/archives/freebsd-toolchain List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-toolchain@freebsd.org X-BeenThere: freebsd-toolchain@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658043262; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BHhPhD8NWr/v7qor5DnPAK/LiCYHnx2YgtqvJ6SA2HE=; b=irUhOmUeyawBwpH0TnLRXn/X29/OKV3teskj9ol2BaSgpLRqpew4RkWqlqKMryX/iN4JnM t6dWNGO//2jXJz8DcgGy4hDSZRwx491VxB7B8Of6Ox6MOmQaecxGBCuMGJiBWHoVxdbXrr W/gYwX8HeRSg/Jgdg8shal2ccirLzQidb29dgswQK2ls43ahZ+p/rOtcZH8FgUIZ8gmQIQ jZiqPPb2K0rgvw/CdDe+YGHnnydpoorzo9Bp5eWTVYWWtF34OrxITnLGQvypW2sU2W+e4u jGaAwrsoT6C2t0u6SGaU4UNLe1Rj6fAhqQEnohZycLKVeugrvaoFKBuI1kFAYw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658043262; a=rsa-sha256; cv=none; b=dg/DL0hSx4ce6pXARj87OcgSKtBUZIpzHaRoxExMf8pMBovZh6n3ewL/9QoJuffOCcWele WzBGJLNOlcfnsRX+cl7vzhw4JgWb54RZc/Fmtzg40b+66livjB9NvcN0244RYw1CCXpRhh 0efp4PoU0gtniARQwjUQGxef+Nv0ZT8DHMqJ1mWYAH5jeOPszh9spgJM/UdBX1EXwkF1SD QYscjdKenIiSoFvKzbvKHg2/J1lhkAoYS69HjDIVNIC07Tk8KPIsAGKEeTMc+rk95j5LUx +O4bBerNzIkWPSVQ1xgTPd1QmTQzwFBvQr6aaezzRiIIntTU0hFDBx/VlRes2A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265254 Matthias Andree changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mandree@FreeBSD.org --- Comment #20 from Matthias Andree --- So there's some discussion where people are seemingly talking at different levels. Yuri is observing an exploding number of jobs, and if some parent is swapped out under memory pressure - and possibly with ZFS filling up memory and/or disks getting very slow - then the parent process can't collect the children that have exited, hence many zombies.=20=20 Grim process reaper caught up in a traffic jam if you will. Then some of the GCC drivers seem to be trying to interact with the GNU make jobservers to avoid that, but either this is not configured (port but, eith= er upstream or FreeBSD's port) or not working in a bootstrap =3D> someone could investigate that and I am not sure off-hand if it pertains to GCC11. I recall that GCC has a hefty discussion when it was introducing LTO that it going slow because you have, say, 16 processes generate code and the LTO li= nk just run one because at that time (again, not sure which linker exactly) the assumption still was that linking is serial, disregarding the "LTO global optimizer and code generation" phases. Then there are fat and thin LTO variants... So it is a complex matter and GCC11 is not the only offender, apparently mongodb50 was recently told not to use LTO in FreeBSD's port factory settin= g, and there is more.=20 I frequently see my builds killed because my many-GB 8-core 2-threads-per-c= ore Ryzen 1700 fills up the disk during compiler builds, and I FREQUENTLY see multiple compilers competing in poudriere.=20 It's one or two LLVMs, one GCC, and Rust at the same time, and then I usual= ly fill up the disk. Especially if anything generates debugging information intermediately without my setting WITHOUT_DEBUG because someone thought it = wise to have -flto -g or something.=20 Python 3.8 did the latter on my mailserver and could not build with 1 GB RA= M + 1 GB swap, but the Python port has since been fixed. So yes, arguably my own FreeBSD builer VM should have more disk space ;-) --=20 You are receiving this mail because: You are the assignee for the bug.=