From nobody Fri Apr 19 14:16:35 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VLcCJ4bHBz5H7r7; Fri, 19 Apr 2024 14:16:44 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VLcCJ3pNrz4JJj; Fri, 19 Apr 2024 14:16:44 +0000 (UTC) (envelope-from philip@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1713536204; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=2ac8IgFl3+vkTjQbNvhekb08BVw7n8hvoERUu/kBL80=; b=epOHNEQogBfVk+5NKrFFhEZ26DFFm96HuF5r99pbYaxbggP+4gG+lNUTyX7HbnVnu8Z2RM w1C/3HQGkJX+f7LZTpU/6MQ+WLBh+F4Bh3ZqQy/RKhQvmRW7tci8UyBAc1JQsDJwuS6kQr 0HCsxjXb/e+hYFdCrw85C4zSX8i7VpCEJkHUDKILVKdrTVGsj9a50kC3KyJylHUNFq+s6L 3H1XsWpWGd0PpwNMF5pGxkzgrbnqMCflM2KhNYON4VgsZrismdPCPecjVO9xk1CbtSjPAu ikbZClsIfUgxnbxxRd6prXlEzVqwXpImqOslUqfUvU1WgDap0xOWdLGewyAF4w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1713536204; a=rsa-sha256; cv=none; b=lb7VqlUe1TFQ8ez2V/jlMtJBX5Fe41GJ/ttjSGWYCAsCmZRj66pjel7RC71HiXUcj3lmls j/5j2LMzdxnLGMFT4RCFrKq37201UkfnecmmP0BUlL0v51PjJwmdIGeHlKe0Jd1SSb4Fbc nn2+snQ9Tg7kabUw11jbKwy1qTYqrHLWiDm55boogMjUT8/fP2bx72UCgeoGAEWcDqLqSx P1Bjcrzb5bMjHlqdFQB9k9nxy41jpRG2ucwLuy+yuZAP/YHt28lxwdi6ND1H9Ucw0PDA4i 3A4up0Z5WrPzFFsvS7qL3tfHdUV3C7R5J7uELMFtL07jMFmVB3bgsChjYlTBJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1713536204; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=2ac8IgFl3+vkTjQbNvhekb08BVw7n8hvoERUu/kBL80=; b=DO6Rm7Ks8dmnAB7k91OHWi3jjcrC9cQZijxuNEVh/0mg09n7xPYD4I4a7bhMUgfSghPr4a fJsmbKjdJRPLnGNdU9XKZBiXT4a+Lt8Zx3T9tmLLmnLkvBmlQO7i+tjhKLh+FlD/3Wztip zbPOfFyPPppAOy7CEDg1rWv/iyY6LydVM9j7PjKDlMVRL5WOljV8YwwFOtxt3fqz7kvat5 pSDPDggcHYPV3vmWZV5iq47ufLgg+2lHe1t82RKeZfQ4szHr9uEsCn0jUr87pBJ0Yl2kn8 bir7RxghEqlfspGc7uNFL+En5wVSR8VdnbvFQn2p1TjmuKB279LFwjLnQR5LDg== Received: from fauth2-smtp.messagingengine.com (fauth2-smtp.messagingengine.com [103.168.172.201]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: philip/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4VLcCJ2wygzd6H; Fri, 19 Apr 2024 14:16:44 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailfauth.nyi.internal (Postfix) with ESMTP id BCEFF1200066; Fri, 19 Apr 2024 10:16:43 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Fri, 19 Apr 2024 10:16:43 -0400 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrudekvddgjeehucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvvefufffokfgjfhggtgfgsehtqhhmtdertddtnecuhfhrohhmpefrhhhi lhhiphcurfgrvghpshcuoehphhhilhhiphesfhhrvggvsghsugdrohhrgheqnecuggftrf grthhtvghrnhepjedukeffgfffkeejfffgfefgledthefhffeggeevgeevhedvheegtddu vdetkeeinecuffhomhgrihhnpehfrhgvvggsshgurdhorhhgnecuvehluhhsthgvrhfuih iivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepphhhihhlihhpodhmvghsmhhtphgr uhhthhhpvghrshhonhgrlhhithihqdduudeiiedviedvgeekqddvfeehudektddtkedqph hhihhlihhppeepfhhrvggvsghsugdrohhrghesthhrohhusghlvgdrihhs X-ME-Proxy: Feedback-ID: ia691475d:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Fri, 19 Apr 2024 10:16:41 -0400 (EDT) From: Philip Paeps To: Mark Millard Cc: void , FreeBSD Mailing List , Current FreeBSD Subject: Re: pkg server for current/arm64 stopped ? [main-armv7 on ampere2, elapsed so far: 651:21:56] Date: Fri, 19 Apr 2024 22:16:35 +0800 X-Mailer: MailMate (1.14r6028) Message-ID: In-Reply-To: <03736C90-EE54-47B3-AEA7-ED1AC0343B4B@yahoo.com> References: <03736C90-EE54-47B3-AEA7-ED1AC0343B4B.ref@yahoo.com> <03736C90-EE54-47B3-AEA7-ED1AC0343B4B@yahoo.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed Content-Transfer-Encoding: quoted-printable On 2024-04-18 23:02:30 (+0800), Mark Millard wrote: > void wrote on > Date: Thu, 18 Apr 2024 14:08:36 UTC : > >> Not sure where to post this.. >> >> The last bulk build for arm64 appears to have happened around >> mid-March on ampere2. Is it broken? > > main-armv7 building is broken and the last completed build > was the one started on Mon, 19 Feb 2024 12:32:10 GMT. It > gets stuck making no progress until manually forced to stop, > which leads to huge elapsed times for the incomplete builds: > > pd5512ae7b8c6_s75464941dc 34472 12282 (+9196) 107 (+77) 4753 = > (+2247) 1390 (+529) 15940 parallel_build: Fri, 22 Mar 2024 11:05:01 = > GMT 651:21:56 > > p43e3af5f5763_sf5f08e41aa 19809 5919 (+3126) 137 (+100) 5363 = > (+2741) 1395 (+522) 6995 parallel_build: Wed, 28 Feb 2024 15:46:14 = > GMT 359:42:14 ampere2 > > ampere2 alternates between trying to build main-arm64 and main-armv7, = > so main-armv7 being stuck blocks main-arm64 from building. > > One can see that all 13 job ID's show over 570 hours: > > http://ampere2.nyi.freebsd.org/build.html?mastername=3Dmain-armv7-defau= lt&build=3Dpd5512ae7b8c6_s75464941dc > > It is not random which packages are building when this happens. = > Compare: > > http://ampere2.nyi.freebsd.org/build.html?mastername=3Dmain-armv7-defau= lt&build=3Dp43e3af5f5763_sf5f08e41aa > > By contrast, the 19 Feb 2024 from-scratch (full) build worked: > > http://ampere2.nyi.freebsd.org/build.html?mastername=3Dmain-armv7-defau= lt&build=3Dpe9c9c73181b5_sbd45bbe440 > > My guess is that FreeBSD has something that broken after bd45bbe440 > that was broken as of f5f08e41aa and was still broken at 75464941dc . I'll kill the build on ampere2 again. Thanks for the nudge. We don't really have good monitoring for this. Also: builds should time = out after 36 hours. The fact that this one does not is a bug in itself. Philip [hat: clusteradm]