From nobody Mon Jul 10 21:26:04 2023 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4R0HB62hC6z4gwbW for ; Mon, 10 Jul 2023 21:26:22 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-vk1-xa29.google.com (mail-vk1-xa29.google.com [IPv6:2607:f8b0:4864:20::a29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4R0HB613HQz3G3Z; Mon, 10 Jul 2023 21:26:22 +0000 (UTC) (envelope-from kob6558@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-vk1-xa29.google.com with SMTP id 71dfb90a1353d-47e57b8498aso1611539e0c.2; Mon, 10 Jul 2023 14:26:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1689024381; x=1691616381; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=VB82SEMxuNGPqZEKJMw+A1/lFV8pZpypLcQYTenZbLI=; b=I3Ti+FhwYgMNptyJf7QYtUKBj77CSOwEncTZ1nNdiAvS2kGhfuevBjkdgI8oAp1Efk 0G/ghSiJF+ynX0xCZ/JNWsQRHygeOkM3emkwCyiZ7mK4oH46BymK5WKPElo9Yaj1g7Hd hNMcDyR1N7g9TrduYux01U8/r93kb4syNxQi05qsrp+BlReuhQ840ev6zE9VwWZIEfFj FxwsbUkENs9IYUeKYJNyAp4UgK5Y4O/HborwxVzL8sHUqKw0H7X35S1E4puoD3DqMXLw gpFVG7FcA0UWFpBntkiCSjmEvjQ2BVSFMZDW4xTH9TPgkJT9H3/gfh0JHvyhUpC3f4fy 48SQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1689024381; x=1691616381; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=VB82SEMxuNGPqZEKJMw+A1/lFV8pZpypLcQYTenZbLI=; b=XAAmekBcZIKIj5GdKEMgLiITedcaTC8LYgmSjvkmYe2Y8P1B2SOOH6hbnKRaNc0M+Z DGArX70n7XdxGbMHVHBuWeDhf4AYMxYRzzdO4ei7IVvU4WaxIRJg3YiY/ZLonH/gTaLr +bm5qK8rlqlJwzxK/Z30ftGe5QIjIPnFB3gvEE26iy+uuTBXIO9HU1f6yfS587pZlplO lv2aaCgIvBHTqhvD8n4C26fMvXGgzJNzxmfHP4uduINTA/2svCZGyuHKFXD1FCMYhBGP jYBZiO4iDueItkaNbfnzbqHcL+HlSs1E2Tm7D3jslrEMspx/t3JoMfdeJ/VexsihfcuV wQ6g== X-Gm-Message-State: ABy/qLYQAKqhqHTk6WdcM9y2nGDoSNvBoXWr0Fk5QL2PIfsCkfmkPATA Foo7zm0oXodUL3Q/o1qGi12tJG4+KGIgs2SmEp1LHi+M X-Google-Smtp-Source: APBJJlGY8or+B7v4i3OyZuyP6sz3GKPYUSX5NQLXQ5vqGGA2FjLJjK3Cl8A6qluE1q2z2SGW2spuZWrN3QUK+EWr8u4= X-Received: by 2002:a1f:3f0c:0:b0:471:5770:fe99 with SMTP id m12-20020a1f3f0c000000b004715770fe99mr6175522vka.12.1689024381210; Mon, 10 Jul 2023 14:26:21 -0700 (PDT) List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org MIME-Version: 1.0 References: <2DCC0132-0307-4A73-A473-B749ABF87367.ref@yahoo.com> <2DCC0132-0307-4A73-A473-B749ABF87367@yahoo.com> <1aaeafcc-9812-64bd-a369-bae7b9fc0e5f@gwdg.de> <422DBC3B-D85F-4AFB-ABDE-842A08482EC8@yahoo.com> <58250d08-ce0a-c1ac-ed15-7d55d517218e@gwdg.de> <2ea168aa-3e0e-ee31-d4a3-82b4ce46b330@gwdg.de> In-Reply-To: <2ea168aa-3e0e-ee31-d4a3-82b4ce46b330@gwdg.de> From: Kevin Oberman Date: Mon, 10 Jul 2023 14:26:04 -0700 Message-ID: Subject: Re: Problem with the package builds To: "Hurling, Rainer" Cc: Mark Millard , Konstantin Belousov , FreeBSD Mailing List Content-Type: multipart/alternative; boundary="000000000000425568060028a2c7" X-Rspamd-Queue-Id: 4R0HB613HQz3G3Z X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --000000000000425568060028a2c7 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Jul 10, 2023 at 10:31=E2=80=AFAM Rainer Hurling w= rote: > Am 10.07.23 um 08:15 schrieb Rainer Hurling: > > Am 10.07.23 um 08:08 schrieb Mark Millard: > >> On Jul 9, 2023, at 22:52, Rainer Hurling wrote: > >> > >>> Am 10.07.23 um 06:53 schrieb Mark Millard: > >>>> Konstantin Belousov wrote on > >>>> Date: Mon, 10 Jul 2023 01:18:05 UTC : > >>>>> On Sun, Jul 09, 2023 at 05:52:50PM -0700, Kevin Oberman wrote: > >>>>>> Something looks really messed up on the beefy16 package builder fo= r > >>>>>> 13.1amd64. > >>>>>> > >>>>>> It is building about 9500 packages and started almost two days > >>>>>> ago. It has > >>>>>> only completed 459 packages, a rate of 10 packages/hour and, if it > >>>>>> continues at this rate, will not complete for about 40 days. Nt > >>>>>> sure if > >>>>>> this was triggered by the recent updated to pkg, something that > >>>>>> may have > >>>>>> changed in poudriere or in the configuration, but almost all jails > >>>>>> are are > >>>>>> in one of the depends states, lib-depends, build-depends, > >>>>>> run-depends, > >>>>>> often running for hours. > >>>>>> E.g. gnome-desktop-42.4_1 is in lib_depends and has been building > for > >>>>>> 1:09:59. Last build of the port took about 55 minutes. ATM there > >>>>>> are 7 > >>>>>> lib-depends builds, 5 build-depends, and 1 run-depends building. > >>>>>> No jail is > >>>>>> actually boulding the package, itself. > >>>>>> > >>>>>> Wild guess... It is rebuilding all depends every time. In any > >>>>>> case, someone > >>>>>> needs to look at this. > >>>>>> > >>>>>> Build report is at > >>>>>> > http://beefy16.nyi.freebsd.org/build.html?mastername=3D131amd64-default&b= uild=3De81dafc952d7 > >>>>> > >>>>> I noted that 'pkg-static install' seems to be much slower locally. > >>>>> Not looked into it. > >>>> Summarizing the later observations: > >>>> Slow: pre-1400000 Jail OSVERSION and recent ports (such as pkg) > >>>> ("default") > >>>> Fast: pre-1400000 Jail OSVERSION and older ports (such as pkg) > >>>> ("quarterly") > >>>> Fast: 1400093 Jail OSVERSION and recent ports (such as pkg) > >>>> ("default") > >>>> (Host OSVERSION 1400089 is a common context across them all.) > >>>> Details: > >>>> The list of build contexts with 50+ hr Elapsed but under 500 > >>>> ports built looks like: > >>>> All started on Sat, 08 Jul 2023 01:0[12]:?? GMT: > >>>> beefy6 124amd64 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1204000 > >>>> beefy15 131i386 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1301000 > >>>> beefy16 131amd64 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1301000 > >>>> But the following 2 built over 5700 ports in under 50 hr Elapsed. > >>>> Both started on Sat, 08 Jul 2023 01:01:?? GMT: > >>>> beefy14 131amd64 quarterly > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1301000 > >>>> beefy13 131i386 quarterly > >>>> Jail OSVERSION: 1301000 > >>>> Ignoring armv6's qemu based builds, the more recently started > >>>> main-amd64 and main-arm64 builds do not show the problem. > >>>> Started Sat, 08 Jul 2023 01:29:09 GMT and built over 4400 ports > >>>> in under 51 hr: > >>>> beefy18 main-amd64 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1400093 > >>>> Started Sun, 09 Jul 2023 03:11:16 GMT 25:00:07 GMT and built over > >>>> 1500 ports in under 26 hrs: > >>>> ampere2 main-arm64 default > >>>> Host OSVERSION: 1400089 > >>>> Jail OSVERSION: 1400093 > >>>> =3D=3D=3D > >>>> Mark Millard > >>>> marklmi at yahoo.com > >>> > >>> Since this does not seem to be mentioned in the previous posts. The > >>> phenomenon does not only occur in the pkg clusters. > >>> > >>> In fact, I also observe this severely delayed behavior under > >>> Poudriere on my very current 14.0-CURRENT box. All *-depends sections > >>> need a multiple of the usual times ... > >>> > >> > >> So, something like: > >> > >> Host OSVERSION: 1400093 > >> Jail OSVERSION: 1400093 > >> and: > >> /packages/All/pkg-1.20.1_1.pkg > > > > Yes, this corresponds exactly to my versions of the system, the jail an= d > > ports-mgmt/pkg. > > The newest update of ports-mgmt/pkg to version 1.20.2 by bapt@ solves > the problem for me :) > Great! So, can anyone restart the build or kill it until it will start again at 1:00 UTC tomorrow morning or will it start building with the updated pkg? I see no signs of using any change to this point. --=20 Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 --000000000000425568060028a2c7 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Mon, Jul 10, 2023 at 10:31= =E2=80=AFAM Rainer Hurling <rhurlin@g= wdg.de> wrote:
Am 10.07.23 um 08:15 schrieb Rainer Hurl= ing:
> Am 10.07.23 um 08:08 schrieb Mark Millard:
>> On Jul 9, 2023, at 22:52, Rainer Hurling <rhurlin@gwdg.de> wrote:
>>
>>> Am 10.07.23 um 06:53 schrieb Mark Millard:
>>>> Konstantin Belousov <kostikbel_at_gmail.com>= wrote on
>>>> Date: Mon, 10 Jul 2023 01:18:05 UTC :
>>>>> On Sun, Jul 09, 2023 at 05:52:50PM -0700, Kevin Oberma= n wrote:
>>>>>> Something looks really messed up on the beefy16 pa= ckage builder for
>>>>>> 13.1amd64.
>>>>>>
>>>>>> It is building about 9500 packages and started alm= ost two days
>>>>>> ago. It has
>>>>>> only completed 459 packages, a rate of 10 packages= /hour and, if it
>>>>>> continues at this rate, will not complete for abou= t 40 days. Nt
>>>>>> sure if
>>>>>> this was triggered by the recent updated to pkg, s= omething that
>>>>>> may have
>>>>>> changed in poudriere or in the configuration, but = almost all jails
>>>>>> are are
>>>>>> in one of the depends states, lib-depends, build-d= epends,
>>>>>> run-depends,
>>>>>> often running for hours.
>>>>>> E.g. gnome-desktop-42.4_1 is in lib_depends and ha= s been building for
>>>>>> 1:09:59. Last build of the port took about 55 minu= tes. ATM there
>>>>>> are 7
>>>>>> lib-depends builds, 5 build-depends, and 1 run-dep= ends building.
>>>>>> No jail is
>>>>>> actually boulding the package, itself.
>>>>>>
>>>>>> Wild guess... It is rebuilding all depends every t= ime. In any
>>>>>> case, someone
>>>>>> needs to look at this.
>>>>>>
>>>>>> Build report is at
>>>>>> http://beefy16.nyi.freebsd.org/build.html?mastername= =3D131amd64-default&build=3De81dafc952d7
>>>>>
>>>>> I noted that 'pkg-static install' seems to be = much slower locally.
>>>>> Not looked into it.
>>>> Summarizing the later observations:
>>>> Slow: pre-1400000 Jail OSVERSION and recent ports (such as= pkg)
>>>> ("default")
>>>> Fast: pre-1400000 Jail OSVERSION and older ports=C2=A0 (su= ch as pkg)
>>>> ("quarterly")
>>>> Fast: 1400093=C2=A0=C2=A0=C2=A0=C2=A0 Jail OSVERSION and r= ecent ports (such as pkg)
>>>> ("default")
>>>> (Host OSVERSION 1400089 is a common context across them al= l.)
>>>> Details:
>>>> The list of build contexts with 50+ hr Elapsed but under 5= 00
>>>> ports built looks like:
>>>> All started on Sat, 08 Jul 2023 01:0[12]:?? GMT:
>>>> beefy6 124amd64 default
>>>> Host OSVERSION: 1400089
>>>> Jail OSVERSION: 1204000
>>>> beefy15 131i386 default
>>>> Host OSVERSION: 1400089
>>>> Jail OSVERSION: 1301000
>>>> beefy16 131amd64 default
>>>> Host OSVERSION: 1400089
>>>> Jail OSVERSION: 1301000
>>>> But the following 2 built over 5700 ports in under 50 hr E= lapsed.
>>>> Both started on Sat, 08 Jul 2023 01:01:?? GMT:
>>>> beefy14 131amd64 quarterly
>>>> Host OSVERSION: 1400089
>>>> Jail OSVERSION: 1301000
>>>> beefy13 131i386 quarterly
>>>> Jail OSVERSION: 1301000
>>>> Ignoring armv6's qemu based builds, the more recently = started
>>>> main-amd64 and main-arm64 builds do not show the problem.<= br> >>>> Started Sat, 08 Jul 2023 01:29:09 GMT and built over 4400 = ports
>>>> in under 51 hr:
>>>> beefy18 main-amd64 default
>>>> Host OSVERSION: 1400089
>>>> Jail OSVERSION: 1400093
>>>> Started Sun, 09 Jul 2023 03:11:16 GMT 25:00:07 GMT and bui= lt over
>>>> 1500 ports in under 26 hrs:
>>>> ampere2 main-arm64 default
>>>> Host OSVERSION: 1400089
>>>> Jail OSVERSION: 1400093
>>>> =3D=3D=3D
>>>> Mark Millard
>>>> marklmi at yahoo.com
>>>
>>> Since this does not seem to be mentioned in the previous posts= . The
>>> phenomenon does not only occur in the pkg clusters.
>>>
>>> In fact, I also observe this severely delayed behavior under <= br> >>> Poudriere on my very current 14.0-CURRENT box. All *-depends s= ections
>>> need a multiple of the usual times ...
>>>
>>
>> So, something like:
>>
>> Host OSVERSION: 1400093
>> Jail OSVERSION: 1400093
>> and:
>> /packages/All/pkg-1.20.1_1.pkg
>
> Yes, this corresponds exactly to my versions of the system, the jail a= nd
> ports-mgmt/pkg.

The newest update of ports-mgmt/pkg to version 1.20.2 by bapt@ solves
the problem for me :)

Great! So, c= an anyone restart the build or kill it until it will start again at 1:00 UT= C tomorrow morning or will it start building with the updated pkg? I see no= signs of using any change to this point.
--
Kevin Oberman, Part time kid herder and retired Network Engineer=
E-mail: rkober= man@gmail.com
PGP Fingerprint: D03FB98AFA78E3B78C1694B318= AB39EF1B055683
--000000000000425568060028a2c7--