From nobody Wed Sep 28 12:31:33 2022 X-Original-To: ppc@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Mcwpv56Jhz4V5RD for ; Wed, 28 Sep 2022 12:31:51 +0000 (UTC) (envelope-from alfredo@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Mcwpv4gybz3VXF for ; Wed, 28 Sep 2022 12:31:51 +0000 (UTC) (envelope-from alfredo@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664368311; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=PHFyhUVb1N1OGTLThovNlrG2idaXCLUCRo1f5OCPtdU=; b=ASDws99FZYq2TTb8xlHy24WV3ozrKGVCehqRBgCDLLJqHH+w8U/e7lvwKmtPi2IjSSrgim frulmj90DEJuaZdmaDdvejEr6CjRzthGkcvGRYLTUjTN+G/ImLUZG7roQlUr2XAetY61+E 08ZrHImJJ87UG3jX/zDutQRgWYROi0EU6PlzF/MPuisUcCFS1iUsn7W2jYu/J6wU3FCNGN aSlnq2x9uV45VDw91xMGNUHnZyBJT14pTjpCO0Tz0eQFtWAmULlCstmKPqNHye//MnrRfA Rd65v3tXNrkcOyBetzhLfaYnr/3Ueut6capLZv3rIfPwlim0Q2HKuh43t2XZtw== Received: from mail-pg1-f175.google.com (mail-pg1-f175.google.com [209.85.215.175]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) (Authenticated sender: alfredo) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Mcwpv3d4dzs4V for ; Wed, 28 Sep 2022 12:31:51 +0000 (UTC) (envelope-from alfredo@freebsd.org) Received: by mail-pg1-f175.google.com with SMTP id u69so12103700pgd.2 for ; Wed, 28 Sep 2022 05:31:51 -0700 (PDT) X-Gm-Message-State: ACrzQf1KBpJW2Lmd0X4EThCRNUPEezNPSwvySSsp5HLxrESxtybLpDgY x+UakT17rnRfuPsvaOGZhTSX7uvRAobo+hQjoZY= X-Google-Smtp-Source: AMsMyM7L3akEvdZco1h22Gj4jKomy3kaZR1UioM0cwEa+tjVIUbPqjuuqWObNMJvcUXVp1Lov2iSLMaRl4EPeTPJX/E= X-Received: by 2002:a63:b4f:0:b0:439:cc64:50e6 with SMTP id a15-20020a630b4f000000b00439cc6450e6mr28441188pgl.483.1664368310019; Wed, 28 Sep 2022 05:31:50 -0700 (PDT) List-Id: Porting FreeBSD to the PowerPC List-Archive: https://lists.freebsd.org/archives/freebsd-ppc List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ppc@freebsd.org X-BeenThere: freebsd-ppc@freebsd.org MIME-Version: 1.0 References: <6ddde0d6-03d8-6b54-fb5d-9589e3e5c1e3@neo-zeon.de> <5fa07e44-b840-7a2d-996c-755b7f0bed7e@neo-zeon.de> In-Reply-To: <5fa07e44-b840-7a2d-996c-755b7f0bed7e@neo-zeon.de> From: =?UTF-8?Q?Alfredo_Dal=27Ava_J=C3=BAnior?= Date: Wed, 28 Sep 2022 09:31:33 -0300 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: bpvo pool exhausted To: Cameron Berkenpas Cc: ppc@freebsd.org Content-Type: multipart/alternative; boundary="000000000000e4ee7905e9bbf10b" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1664368311; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=PHFyhUVb1N1OGTLThovNlrG2idaXCLUCRo1f5OCPtdU=; b=LU1swyf25bou6gtNiqbJRZQcWEWKV6x2CKoQFG6zqXdI+7W/OX5fxTZHq9KNnck3LNkKqq wLggjx+cKEsZ8Nv/TkYOSf8DqEZQqn3k5F+XvtR2AfPjs6B1L7/jIuGGcEhuEbQVGENGZF pK0/umGwaqeYpwiRfU1+dWNFpDIZdEagSyliWF4QJWVmJfNFnxKqOlzugHgd5OOZRci8BB UKHSEvQv/HvxilHko9DGIi+K2vDkzATqW8dC2MFzxw/8fTVIKNWiZn2EscgmrgsW18NZ/Q LlTpSeCTjcNEm8EZSFWYmBpnrhTnz5oz13LSXC9J/+Kgb6XSXsc5zwupi+T0lA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1664368311; a=rsa-sha256; cv=none; b=SjAKNK/ILgJgVikitlYDDq78xngevh7/PwL9EPyVZx2nHXhewE/pv5bMmPoDgrdvNPSyqu N0Dz8nDTVTC6HSt7hAzji+J3h3yfEGZ6VoyC7bMbpUbCL8z5lUq571VXzV8wW9XcRRFwIw gJWQoS05XpeKSHs3dYvfHIqpbVNi6i+8pPi2SXln5DvkYHvyZ+OncGMKDH+sDI72wc2exQ nMfEPw45ZumYdMTit8YBIKvjsYNwNIw+aWEOiuK2wmrOGX+OwuK/X7GTLc/KIq9+2ef7dC jwtVUE/uwKIW0byMG/LmjIFL8gHxADXdDZIqKt0j3zVwB9P8OZEVbb875Z6Y5g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N --000000000000e4ee7905e9bbf10b Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Cameron, This is a boot-only option that can't be tuned by sysctl. You really need to set it in the loader prompt if just testing or add the following to /boot/loader.conf to make it permanent: machdep.moea64_bpvo_pool_size=3D655360 This option is not new but before 13.0-RELEASE there was a bug preventing users from setting a value larger than the default (327680). This was fixed by change https://cgit.freebsd.org/src/commit/?id=3D95a8fce118b24c0a7656f4ded4690210d= 9998e24. []'s, Alfredo On Wed, Sep 28, 2022 at 12:13 AM Cameron Berkenpas wrote: > Hello, > > I do not have a way to consistently reproduce this. I was finally able to > get through recompiling all of the installed ports before I was able to > test this. > > Should this show up via sysctl? Because it does not: > sysctl machdep.moea64_bpvo_pool_size > sysctl: unknown oid 'machdep.moea64_bpvo_pool_size' > > Should I be able to set this in /boot/loader.conf? > > I did try setting it at boot. I'm not sure it did anything though. Nothin= g > in dmesg. > > The VM has 12 threads and 16GB of memory running 13.1-RELEASE-p2. > > Maybe this is a new option in CURRENT? > > On 9/27/22 11:54, Alfredo Dal'Ava J=C3=BAnior wrote: > > > Hi Cameron, > > In the loader prompt I type: > > set machdep.moea64_bpvo_pool_size=3D655360 > boot > > How are you testing it? What's the FreeBSD version and how much memory do > you have on it? As reference I tested it on VMs with 64GB of RAM in the > past. > > []'s > Alfredo > > On Tue, Sep 27, 2022 at 2:41 PM Cameron Berkenpas wrote= : > >> Hello, >> >> When recompiling my ports, I started getting periodic crashes on a VM >> running on POWER9. >> >> "bpvo pool exhausted". >> >> The message says to try setting machdep.moea64_allocated_bpvo_entries, >> but this is apparently read-only. I've attached a screenshot of the >> stacktrace. >> > > --000000000000e4ee7905e9bbf10b Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Cameron,

This is = a boot-only option that can't be tuned by sysctl. You really need to se= t it in the loader prompt if just testing or add the following to /boot/loa= der.conf to make it permanent:

machdep.moea64_= bpvo_pool_size=3D655360

This option is not new but= before 13.0-RELEASE there was a bug preventing users from setting a value = larger than the default (327680). This was fixed by change https://cgit.freebsd.org/src/commit/?id=3D95a8fce118b24c0a7656f4ded4690= 210d9998e24.

[]'= ;s,
Alfredo

On Wed, Sep 28, 2022 at 12:13 AM Cameron Ber= kenpas <cam@neo-zeon.de> wrote= :
=20 =20 =20
Hello,

I do not have a way to consistently reproduce this. I was finally able to get through recompiling all of the installed ports before I was able to test this.

Should this show up via sysctl? Because it does not:
sysctl machdep.moea64_bpvo_pool_size
sysctl: unknown oid 'machdep.moea64_bpvo_pool_size'

Should I be able to set this in /boot/loader.conf?

I did try setting it at boot. I'm not sure it did anything though. Nothing in dmesg.

The VM has 12 threads and 16GB of memory running 13.1-RELEASE-p2.

Maybe this is a new option in CURRENT?

On 9/27/22 11:54, Alfredo Dal'Ava J=C3=BAnior wrote:
=20

Hi Cameron,

In the loader prompt I type:

set machdep.moea64_bpvo_pool_size=3D655360
boot

How are you testing it? What's the FreeBSD version and how much memory do you have on it? As reference I tested it on VMs with 64GB of RAM in the past.

[]'s
Alfredo

On Tue, Sep 27, 2022 at 2:41 PM Cameron Berkenpas <cam@neo-zeon.de> wrote:
Hello,

When recompiling my ports, I started getting periodic crashes on a VM
running on POWER9.

"bpvo pool exhausted".

The message says to try setting machdep.moea64_allocated_bpvo_entries,
but this is apparently read-only. I've attached a screenshot of the
stacktrace.

--000000000000e4ee7905e9bbf10b--