From nobody Sun Jan 28 21:23:45 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TNPZ96pSBz59KpX for ; Sun, 28 Jan 2024 21:24:01 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x52a.google.com (mail-ed1-x52a.google.com [IPv6:2a00:1450:4864:20::52a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TNPZ92flvz4KfB for ; Sun, 28 Jan 2024 21:24:01 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x52a.google.com with SMTP id 4fb4d7f45d1cf-55ef011e934so552856a12.3 for ; Sun, 28 Jan 2024 13:24:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1706477038; x=1707081838; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ebR6dnB4Vprn7zgfDO3K6zfM4IituYjUO4OMAt9KNWk=; b=HA1M1PrmyJ3O6p+BUijdUlVBgK/1ZiTKYmsn5d/s/XKm8DP/SDWJd1UbqNUDGBEPwL HRgf2hU9ayFICC0Nd4PWJXXL4E2C7RXHK5d9BrwH8n0ulQTqxrFZVJPBegIRfZuGzoaR AsFcchmhhlluMX3pxPKd/p3/WLKnesJJkzNk75bOYFFuS+0AKJS533zfh/+zuO358Gyb 3PMTtAq7gJLwGbaN+L51psVLE9QR+IXeH3X2SN+4V7i2wl6GLochTBb0fcd6ZfeMJB5P C0T8o+KhAZ39O8MqI9xe8BTevNh07v94+qRWKtiKCtdB0heVlzkqELLDbndgyEGKM+Y7 sVQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1706477038; x=1707081838; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ebR6dnB4Vprn7zgfDO3K6zfM4IituYjUO4OMAt9KNWk=; b=J4oaNiW8SccCG34K+uGmaVLq0nir2dDRoU/LK7acfNzLpXLmTlDdfiDE9KyZaRx+fD C0Fo709eZ/UMdO/+an8/sSJE+1zCOOvEDzLBxK4pTWC3nq2SAyIj3N9WVzDFPYVfU9CV dsmQB23l1+vHApf86nsKkhE3EV+7/OSuRTc7yILir2CvnJK26cqr7o8yUIA+jTe3PX6l lHy88DoRM/e9do+gIjbjlAE5PWRa79na7qZBsniQ8AFLjvex4xeFZHuWRHnCeP8swzo6 qNnKlG1kzpXeey+yvPVjpqKaDPjYIU1b+lob2WQKBE6ej/vCnG+tra2Q6/vEmOE/ID26 g1ZQ== X-Gm-Message-State: AOJu0YxzJbkSnr/7SwgIFR53eF1hRzN26ERHUmUoJQL+4PrSZKpw6abd YhxH1MEofeeIM0UYaQJB1SXD0nQ3ZENRJEfakjJkLVMXYGS6CcZjVK+5Qq2vRLHUcsjb/mMEEsR frSQTDKWOBjUHu8VMrMYYe0QeiV9+5RmXXETjQw== X-Google-Smtp-Source: AGHT+IGCHZys/VEurEGzZAQawZqUJHTtdKIshngCCJz4yYPToViCQ6IcBPqcRydkH81fLpvk3eAlRUajG4QntrzR33o= X-Received: by 2002:aa7:d89a:0:b0:55e:ad26:d621 with SMTP id u26-20020aa7d89a000000b0055ead26d621mr2540301edq.16.1706477037706; Sun, 28 Jan 2024 13:23:57 -0800 (PST) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <6a33726b-eb6f-418e-9fbd-6d0b9b4bfaa8@madpilot.net> <0fc7f929-6e5b-4a33-97d2-8a9c0c07d524@madpilot.net> <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> In-Reply-To: <79a5eb0f-d04e-4c1a-9d8a-185e1fb4e4a2@madpilot.net> From: Warner Losh Date: Sun, 28 Jan 2024 14:23:45 -0700 Message-ID: Subject: Re: qemu-user-static aarch64 lockup/race? (was Re: Python failure in poudriere on arm64 (via qemu-user-static cross compiling)) To: Guido Falsi Cc: emulation@freebsd.org, "freebsd-arm@freebsd.org" Content-Type: multipart/alternative; boundary="000000000000a6716d0610082573" X-Rspamd-Queue-Id: 4TNPZ92flvz4KfB X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] --000000000000a6716d0610082573 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, Jan 28, 2024, 12:38=E2=80=AFPM Guido Falsi wrote= : > On 28/01/24 15:15, Guido Falsi wrote: > > Hi all, again, > > > > I have some more findings about this, I'm top posting because the old > > message is not really that much relevant anymore. > > > > I'm now running a machine with head (commit > > b32d49cfbaa0437d08e65e7cd7c82c5951b1a852 Jan 25th), poudriere installed > > in it, machine is amd64, with an arm64 jail, 14.0-RELEASE, installed > > from official distribution binaries (https download method), with cross > > tools. > > > > To make sure everything is aligned I rebuild everything: updated head, > > rebuild cross tools in the jail, recompiled all ports for the host > > architecture and force reinstalled them, especially qemu-user-static, > > cleaned up all packages for the arm64 jail. > > > > If I missed something important please point it out. > > > > I have made some more tests and I'm getting python failures in poudrier= e > > like the one described below from time to time (don't have hard stats > > but feels like 50% chance). If I get past that it usually is able to > > build all the not many packages, but locks up at: > > > > Creating repository in /tmp/packages: 0% > > > > BTW, forgot to mention last time this worked without issue was around > 20th December. > I think this is a bsd-user issue. There is a race somewhere in that code that causes the hangs. I'd love a reproducible test case that is somewhat smaller than python... there are bigger races with the newer stuff and I've not had the time to chase it there either. =F0=9F=98=9E Warner Warner Warner --=20 > Guido Falsi > > > --000000000000a6716d0610082573 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sun, Jan 28, 2024, 12:38=E2=80=AFPM Guido Falsi <= ;mad@madpilot.net> wrote:
On 28/01/24 15:15, Guido Falsi wrote:
> Hi all, again,
>
> I have some more findings about this, I'm top posting because the = old
> message is not really that much relevant anymore.
>
> I'm now running a machine with head (commit
> b32d49cfbaa0437d08e65e7cd7c82c5951b1a852 Jan 25th), poudriere installe= d
> in it, machine is amd64, with an arm64 jail, 14.0-RELEASE, installed <= br> > from official distribution binaries (https download method), with cros= s
> tools.
>
> To make sure everything is aligned I rebuild everything: updated head,=
> rebuild cross tools in the jail, recompiled all ports for the host > architecture and force reinstalled them, especially qemu-user-static, =
> cleaned up all packages for the arm64 jail.
>
> If I missed something important please point it out.
>
> I have made some more tests and I'm getting python failures in pou= driere
> like the one described below from time to time (don't have hard st= ats
> but feels like 50% chance). If I get past that it usually is able to <= br> > build all the not many packages, but locks up at:
>
> Creating repository in /tmp/packages:=C2=A0=C2=A0 0%
>

BTW, forgot to mention last time this worked without issue was around
20th December.

I think this is a bsd-user issue. There is a race somewhere i= n that code that causes the hangs. I'd love a reproducible test case th= at is somewhat smaller than python... there are bigger races with the newer= stuff and I've not had the time to chase it there either. =F0=9F=98=9E=

Warner=C2=A0

Warner

=
Warner

--
Guido Falsi <mad@madpilot.net>


--000000000000a6716d0610082573--