From nobody Wed Dec 29 19:36:44 2021 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F41C319186F9 for ; Wed, 29 Dec 2021 19:36:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JPM984pysz4yn3 for ; Wed, 29 Dec 2021 19:36:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 802BE21F6 for ; Wed, 29 Dec 2021 19:36:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BTJaiYm084126 for ; Wed, 29 Dec 2021 19:36:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BTJaiol084125 for bugs@FreeBSD.org; Wed, 29 Dec 2021 19:36:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 260805] sysctl shows bogus numa domains Date: Wed, 29 Dec 2021 19:36:44 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pmc@citylink.dinoex.sub.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1640806604; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=JgRQ7VvoD8AID11OvEZgrkol+DNwr6Toribqvaf0YHo=; b=ycIHC3Pj9m3QgaBJyd2ZDWRhFx2UfkSmOiwLfTOtPhSZliDsmXtXUuZnK6mUNl48ubC6R8 rc1YAneWBDe/Ox13bp5PGoiVmrLUQ2diN4SqDYMvtl7EwSdX4H+C5otLHD39bcig5VGI1B PYDha0QqKDj/jaiITA2U3OQ68832vK1VJ/EMjrlkUVYyQW0rxswXlVvTlJ/q2dNS7dPIxv Sg3SCP1NTHWk2scSTh1pboRZdUe9TDum5aRxK22byqLj7sX5cHGOJZnj8JmZ8i8Ps5U13h H87eqFj3gdzuqRvQ8I6GeQ9HtTD8J/llOO2PwiixobVAaSuswdy94UrwhKJvAg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1640806604; a=rsa-sha256; cv=none; b=veUagB44JdQW8vGIt4GrEnspBUrjZ1UTJZiFp97X8fYzLldis2ZKVjmCFPNEXE8XaMwU2g jGFFPQaax0eEBVEPDAny1I47GHfgrA0ndSkL+D+6I6iJBB87SqyeuovM0ogWiJZJ4hC9nh OK2oCv65c0R4v42CM1+mO8uysuHp3HjfXJ4r/EJsRaNwkAvrK5YFgozLPu22JgoSzM1wme uyC9mYI+P3RJHP2hRcoz7Omz5uNWRN3Co6e+raNQYHqe1MjhzHYt+VBRvdTxZI+tVoAQkI AfLGL2ZTokmN0NJ/wUgHLDPUUAyMUV9iwjYb61q6lLJU4eIcQ2X344UpBJMoeA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260805 Bug ID: 260805 Summary: sysctl shows bogus numa domains Product: Base System Version: 12.3-RELEASE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: pmc@citylink.dinoex.sub.org Environmental Data: ------------------- ASUS Z10PA-D8, Cluster-on-Die and NUMA enabled. CPU: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (2594.04-MHz K8-class CPU) FreeBSD/SMP: Multiprocessor System Detected: 20 CPUs FreeBSD/SMP: 1 package(s) x 2 cache groups x 5 core(s) x 2 hardware threads kern.sched.topology_spec: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, = 11, 12, 13, 14, 15, 16, 17, 18, 19 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 0, 1 THREAD groupSMT group 2, 3 THREAD groupSMT group 4, 5 THREAD groupSMT group [etc.etc.] This would say that cpu.4 and cpu.5 are SMT brothers on the same processor. But, when it comes to NUMA domains, sysctl says this: dev.cpu.19.%domain: 1 dev.cpu.18.%domain: 1 dev.cpu.17.%domain: 1 dev.cpu.16.%domain: 1 dev.cpu.15.%domain: 1 dev.cpu.14.%domain: 0 dev.cpu.13.%domain: 0 dev.cpu.12.%domain: 0 dev.cpu.11.%domain: 0 dev.cpu.10.%domain: 0 dev.cpu.9.%domain: 1 dev.cpu.8.%domain: 1 dev.cpu.7.%domain: 1 dev.cpu.6.%domain: 1 dev.cpu.5.%domain: 1 dev.cpu.4.%domain: 0 dev.cpu.3.%domain: 0 dev.cpu.2.%domain: 0 dev.cpu.1.%domain: 0 dev.cpu.0.%domain: 0 As it is highly unlikely for SMT brothers to share L1/L2 cache but use different memory banks, something must be wrong here. I did test with=20 cpuset -l 4 -n ft:0-1 sh -c "awk 'END {for(i=3D0; i < 1000000000; i++) { a[= i] =3D 2.53 } }' < /dev/null" cpuset -l 5 -n ft:0-1 sh -c "awk 'END {for(i=3D0; i < 1000000000; i++) { a[= i] =3D 2.53 } }' < /dev/null" and both do allocate from vm.domain.0.stats.free_count, so it seems the dev.cpu.X.%domain values are wrong, and there seems no obvious harm resulti= ng from it (at least until somebody grabs these dev.cpu.X.%domain values to ma= ke their software numa-aware).=20 As I have no other numa-capable hardware available, I cannot say if this mi= ght be just an individual flaw in this BIOS, or such. --=20 You are receiving this mail because: You are the assignee for the bug.=