From nobody Thu Jun 16 15:03:47 2022 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C311A833644 for ; Thu, 16 Jun 2022 15:03:52 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qv1-xf29.google.com (mail-qv1-xf29.google.com [IPv6:2607:f8b0:4864:20::f29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LP56H60MJz4T80 for ; Thu, 16 Jun 2022 15:03:51 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qv1-xf29.google.com with SMTP id o43so2472945qvo.4 for ; Thu, 16 Jun 2022 08:03:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=82P1gjR1wNE613HOyBB/wXUOigP32yPPpP763UPMQmQ=; b=FpWnRlKVq0SKNYhMBYOl9/2oIEl1svR8ZL/eLieKKneaX1uiiudCV5Fg6Nyc8Gvvkk uVnq9lN/pj5ZIdr6LbH0XRCcN2ylAASDg6gcdcgrkEa1sR2x8Gy0wqoRzG0MYStxNyCg IVSNvedv7Vvr9tx01ee7vpCd0XCSk+5DXMPqr6VQZCFj8IQWPAN+MrmkRSceUO2+/zQ6 5kjo1mciI1zLmROznEvaYmpn2+O0rUfHRVXqL9iAcD2TaZwoh1UPufQ7Ha6FZh6fj6kU oXLX4CtxeVAZ4tnCONPDDI/5OYJiM0cbxK5ajZrUaJ6FAF7eDstpspqSauyGRLLcV9NF PyYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to; bh=82P1gjR1wNE613HOyBB/wXUOigP32yPPpP763UPMQmQ=; b=PSkU2isnQ4OEtsHRII4U0c/9zwqLE7eJmkpGQ0qAO2Vwu/DURnAJCfmJ3qzYpzuQ5+ Y1tni8uj74WGLi2G+7+XTE2WPqYjO0Q3m++d1h5T2pIf1BuXlM8mlIw1FmqtI1qIJJ3g kCRzQ8vgUTQE2rN/l5L3fKq4QfqUEV46Tb4yivLmhEEeCjaW0nXXlvFOi10Ll48DWCfz eMAoqkSFXQ9F8weweQ/oa5OOguQsRyr8NK5FMpsgCOywRzEEQYZDEAhvRGqlQx/nYjWE ldToxCaPAZqH+OJT1T+NSguUF+LRZBdbBFIBcWB6n4FwjZTKQSeS0ns2MKscVRuBrFc2 2g2w== X-Gm-Message-State: AJIora/hZeMNc2j6mj0xR3LTqlBA0XsQADnKviTWgAM0UUVq1rfXbogT IQdtYDC4ZGcYaVmnCvQ0BrU= X-Google-Smtp-Source: AGRyM1uhhl57ZoqEik+NDUdLJ9zjNGb9HMAWoY0swe8ljKEBQ4TQRCmZImniUDrDuxJhPMNanD39PA== X-Received: by 2002:ad4:5de2:0:b0:464:5609:6640 with SMTP id jn2-20020ad45de2000000b0046456096640mr4546386qvb.115.1655391831317; Thu, 16 Jun 2022 08:03:51 -0700 (PDT) Received: from nuc (198-84-189-58.cpe.teksavvy.com. [198.84.189.58]) by smtp.gmail.com with ESMTPSA id g10-20020a05620a40ca00b006a6bb044740sm1946260qko.66.2022.06.16.08.03.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 16 Jun 2022 08:03:49 -0700 (PDT) Date: Thu, 16 Jun 2022 11:03:47 -0400 From: Mark Johnston To: "Floyd, Paul" Cc: FreeBSD Hackers Subject: Re: Hang ast / pipelk / piperd Message-ID: References: <84015bf9-8504-1c3c-0ba5-58d0d7824843@gmail.com> <9e5f9da7-e640-857d-5103-f5e61f69a758@gmail.com> List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <9e5f9da7-e640-857d-5103-f5e61f69a758@gmail.com> X-Rspamd-Queue-Id: 4LP56H60MJz4T80 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=FpWnRlKV; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::f29 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-0.87 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_SPAM_MEDIUM(0.83)[0.831]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f29:from]; MLMMJ_DEST(0.00)[freebsd-hackers]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Thu, Jun 16, 2022 at 02:16:38PM +0200, Floyd, Paul wrote: > > > On 2022-06-06 20:17, Mark Johnston wrote: > > On Wed, Jun 01, 2022 at 11:27:52PM +0200, Paul Floyd wrote: > >> On 6/1/22 14:16, Mark Johnston wrote: > >>> The fact that the problem apparently only occurs with 1 CPU suggests a > >>> scheduler bug, indeed. > >> > >> Here is the fresh procstat output > > > > I was able to reproduce the problem locally and narrow down the bug > > somewhat. If you can test a kernel patch, please try this one: > > https://reviews.freebsd.org/D35415 . I verified that it solves the hang > > in my test setup, but I didn't go any further than that yet. > > Hi Mark > > What would be best for testing? The latest 14.0-CURRENT with a build > from git master? Yes, that would work - I've since committed the patch. It'll be merged to 13-STABLE within a few weeks.