From nobody Tue Jul 11 03:51:23 2023 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4R0RkP4sNTz4dTDj for ; Tue, 11 Jul 2023 03:51:25 +0000 (UTC) (envelope-from jbeich@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4R0RkP4NVPz3pmT; Tue, 11 Jul 2023 03:51:25 +0000 (UTC) (envelope-from jbeich@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1689047485; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9D9NQRR2/FL/jr6coHiDcXJec7egLJ0xsi25ZeM06v8=; b=WnaWNEWFczbHuP6ITAC5imAQOcZlWAno5W83LzqbL1yICASQdVqR5I3EtrkWUke4QXSED2 LGNhLX8d84vujt9+EhEVGEL5j5vK7px1m0m5nfmt9WGPxsxXubVOGgVy051B5feKC3IQMM 9pu5CZXmUrh4PF/Dms3oHo0peBVY1/K3IYqxzTMFJ/Bs50p3qROogTNQK0gHr4ozgkH8qy Bt9ABmYpj0gaO/7rWc4WYBlMFEFPX0TSpNtCVi+XKcVDWs1Byfivq9t9NtKqJrondLjrAd I0MU/R41l/2k5L0Ve2ysxiQswtiyifol1FuOsRuALGCXSJCUHs3nS1kVf7zaFQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1689047485; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=9D9NQRR2/FL/jr6coHiDcXJec7egLJ0xsi25ZeM06v8=; b=lalORpPTtDWLUodbmOvoxrGZt6pAaxqE3nyrsWCdcNT/PRW3joqdEtxEMdyLtCG7glZRGQ Y4S/Cq/Y8zV0aaFr0im08DbecKWk6VzJfiCVzXYTzvpT8PX3bcXW1q9in/VhgSEcSlSF7W kG8Wf8fS68WWYlvdlX0SusHucpI8EWwuaOmv/iSnZwr4TzX9oIFViAJxglZYndYZUydlo/ EZ7f5rNvvTrP/ialJEWp1HUegHA6vwVZlK7rNfYxpJa4OuRXttn1W8rpA5L4ul4juMaflk bBXKNFbg5nDi42qhtE4wI5s+STw+H2dVsFLclQuRBG5jBP0Bdt69qsXMqmqbBw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1689047485; a=rsa-sha256; cv=none; b=ocPjZCpDOQzFvFTNXcec7nLEDDS3EDsLSVhKLuqRede/+MvqMpir78h59Vwi/bJLnAv646 fyTx86aQy0bzu9mwdqPTx6AeJ7bbZ/jBrZ2TRQqeebgfHEw0aGj79Eq+ANgmuUzQpQoIwr N0SSSJrdGbB0fLzw7h+cRAi1L0X7BstNw7kPaJRrkVOrD5cjwjbtsHbs3RpA86/6vZ1aYQ gWptWgYZN0jueHfWDGnF75kGQB2IsqaakjuqLLfiprFL2Y2wOFjMQ90tyfhd3RSvFyQSFs 2fWoBGH2XNuqUnTUJS30hq9OybY0scdZXn/HPV/lkcjGii1c0CJX3zGLGcOX5Q== Received: by freefall.freebsd.org (Postfix, from userid 1354) id 78A79147FC; Tue, 11 Jul 2023 03:51:25 +0000 (UTC) From: Jan Beich To: Kevin Oberman Cc: "Hurling, Rainer" , Mark Millard , Konstantin Belousov , FreeBSD Mailing List Subject: Re: Problem with the package builds In-Reply-To: (Kevin Oberman's message of "Mon, 10 Jul 2023 14:26:04 -0700") References: <2DCC0132-0307-4A73-A473-B749ABF87367.ref@yahoo.com> <2DCC0132-0307-4A73-A473-B749ABF87367@yahoo.com> <1aaeafcc-9812-64bd-a369-bae7b9fc0e5f@gwdg.de> <422DBC3B-D85F-4AFB-ABDE-842A08482EC8@yahoo.com> <58250d08-ce0a-c1ac-ed15-7d55d517218e@gwdg.de> <2ea168aa-3e0e-ee31-d4a3-82b4ce46b330@gwdg.de> Date: Tue, 11 Jul 2023 05:51:23 +0200 Message-ID: <8rbn-qf5w-wny@FreeBSD.org> List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ThisMailContainsUnwantedMimeParts: N Kevin Oberman writes: > On Mon, Jul 10, 2023 at 10:31=E2=80=AFAM Rainer Hurling = wrote: > >> Am 10.07.23 um 08:15 schrieb Rainer Hurling: >> > Am 10.07.23 um 08:08 schrieb Mark Millard: >> >> On Jul 9, 2023, at 22:52, Rainer Hurling wrote: >> >> >> >>> Am 10.07.23 um 06:53 schrieb Mark Millard: >> >>>> Konstantin Belousov wrote on >> >>>> Date: Mon, 10 Jul 2023 01:18:05 UTC : >> >>>>> On Sun, Jul 09, 2023 at 05:52:50PM -0700, Kevin Oberman wrote: >> >>>>>> Something looks really messed up on the beefy16 package builder f= or >> >>>>>> 13.1amd64. >> >>>>>> >> >>>>>> It is building about 9500 packages and started almost two days >> >>>>>> ago. It has >> >>>>>> only completed 459 packages, a rate of 10 packages/hour and, if it >> >>>>>> continues at this rate, will not complete for about 40 days. Nt >> >>>>>> sure if >> >>>>>> this was triggered by the recent updated to pkg, something that >> >>>>>> may have >> >>>>>> changed in poudriere or in the configuration, but almost all jails >> >>>>>> are are >> >>>>>> in one of the depends states, lib-depends, build-depends, >> >>>>>> run-depends, >> >>>>>> often running for hours. >> >>>>>> E.g. gnome-desktop-42.4_1 is in lib_depends and has been building >> for >> >>>>>> 1:09:59. Last build of the port took about 55 minutes. ATM there >> >>>>>> are 7 >> >>>>>> lib-depends builds, 5 build-depends, and 1 run-depends building. >> >>>>>> No jail is >> >>>>>> actually boulding the package, itself. >> >>>>>> >> >>>>>> Wild guess... It is rebuilding all depends every time. In any >> >>>>>> case, someone >> >>>>>> needs to look at this. >> >>>>>> >> >>>>>> Build report is at >> >>>>>> >> http://beefy16.nyi.freebsd.org/build.html?mastername=3D131amd64-default&= build=3De81dafc952d7 >> >>>>> >> >>>>> I noted that 'pkg-static install' seems to be much slower locally. >> >>>>> Not looked into it. >> >>>> Summarizing the later observations: >> >>>> Slow: pre-1400000 Jail OSVERSION and recent ports (such as pkg) >> >>>> ("default") >> >>>> Fast: pre-1400000 Jail OSVERSION and older ports (such as pkg) >> >>>> ("quarterly") >> >>>> Fast: 1400093 Jail OSVERSION and recent ports (such as pkg) >> >>>> ("default") >> >>>> (Host OSVERSION 1400089 is a common context across them all.) >> >>>> Details: >> >>>> The list of build contexts with 50+ hr Elapsed but under 500 >> >>>> ports built looks like: >> >>>> All started on Sat, 08 Jul 2023 01:0[12]:?? GMT: >> >>>> beefy6 124amd64 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1204000 >> >>>> beefy15 131i386 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1301000 >> >>>> beefy16 131amd64 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1301000 >> >>>> But the following 2 built over 5700 ports in under 50 hr Elapsed. >> >>>> Both started on Sat, 08 Jul 2023 01:01:?? GMT: >> >>>> beefy14 131amd64 quarterly >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1301000 >> >>>> beefy13 131i386 quarterly >> >>>> Jail OSVERSION: 1301000 >> >>>> Ignoring armv6's qemu based builds, the more recently started >> >>>> main-amd64 and main-arm64 builds do not show the problem. >> >>>> Started Sat, 08 Jul 2023 01:29:09 GMT and built over 4400 ports >> >>>> in under 51 hr: >> >>>> beefy18 main-amd64 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1400093 >> >>>> Started Sun, 09 Jul 2023 03:11:16 GMT 25:00:07 GMT and built over >> >>>> 1500 ports in under 26 hrs: >> >>>> ampere2 main-arm64 default >> >>>> Host OSVERSION: 1400089 >> >>>> Jail OSVERSION: 1400093 >> >>>> =3D=3D=3D >> >>>> Mark Millard >> >>>> marklmi at yahoo.com >> >>> >> >>> Since this does not seem to be mentioned in the previous posts. The >> >>> phenomenon does not only occur in the pkg clusters. >> >>> >> >>> In fact, I also observe this severely delayed behavior under >> >>> Poudriere on my very current 14.0-CURRENT box. All *-depends sections >> >>> need a multiple of the usual times ... >> >>> >> >> >> >> So, something like: >> >> >> >> Host OSVERSION: 1400093 >> >> Jail OSVERSION: 1400093 >> >> and: >> >> /packages/All/pkg-1.20.1_1.pkg >> > >> > Yes, this corresponds exactly to my versions of the system, the jail a= nd >> > ports-mgmt/pkg. >> >> The newest update of ports-mgmt/pkg to version 1.20.2 by bapt@ solves >> the problem for me :) >> > > Great! So, can anyone restart the build or kill it until it will start > again at 1:00 UTC tomorrow morning or will it start building with the > updated pkg? I see no signs of using any change to this point. Even with pkg-1.20.2 many running jobs are stuck with *-depends in Status. https://pkg-status.freebsd.org/beefy18/build.html?mastername=3Dmain-amd64-d= efault&build=3Dpd6fe15e0ee7a_s1ec7cb1b5d https://pkg-status.freebsd.org/beefy17/build.html?mastername=3Dmain-i386-de= fault&build=3Dpd6fe15e0ee7a_s1ec7cb1b5d https://pkg-status.freebsd.org/beefy16/build.html?mastername=3D131amd64-def= ault&build=3Dd6fe15e0ee7a https://pkg-status.freebsd.org/ampere3/build.html?mastername=3D131arm64-def= ault&build=3Dd6fe15e0ee7a https://pkg-status.freebsd.org/beefy15/build.html?mastername=3D131i386-defa= ult&build=3Dd6fe15e0ee7a https://pkg-status.freebsd.org/beefy6/build.html?mastername=3D124amd64-defa= ult&build=3Dd6fe15e0ee7a https://pkg-status.freebsd.org/beefy5/build.html?mastername=3D124i386-defau= lt&build=3Dd6fe15e0ee7a