From nobody Tue Jul 04 15:01:08 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QwQwf4ffGz4lnj7 for ; Tue, 4 Jul 2023 15:01:22 +0000 (UTC) (envelope-from ctuffli@gmail.com) Received: from mail-qt1-x82e.google.com (mail-qt1-x82e.google.com [IPv6:2607:f8b0:4864:20::82e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QwQwd6Hp7z3qVw; Tue, 4 Jul 2023 15:01:21 +0000 (UTC) (envelope-from ctuffli@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=UHf+jKsy; spf=pass (mx1.freebsd.org: domain of ctuffli@gmail.com designates 2607:f8b0:4864:20::82e as permitted sender) smtp.mailfrom=ctuffli@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-qt1-x82e.google.com with SMTP id d75a77b69052e-40320e38b64so49843931cf.2; Tue, 04 Jul 2023 08:01:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1688482879; x=1691074879; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=+fW5eBbpgwXWEYXKyCgZ8uP/MqUV7Jn99nz+wlQcSAA=; b=UHf+jKsyig3GlzQbq8TDh+o218lZn0padyVf15syATqvGbh8dVwZSQVP9vdhFuI1R5 6NUUQx9p0ECnwcpTKF0U9djpql4NskkJ7x20I0z4OARr5DY0lBHsWsppzzAQj+xCWTH+ 3zDs+HHytJotYB0tsXbZ918YHH+RrYpi2ugh+OFoLKRIRrMhzEPPDQWBVQ57KRCgQfcn Xi1DpAt0xzXhF5lc9M94PzJ7PzauZ8mUL633nHLvX35rKrSmzJWWa8Vo0u1+QWrQV1oZ ETHtW5hV7VMMFTuAtrYSFjDDt1MrI+eskc3kdiEfVEJVgaqlAuFbr+6bkRAecpggSX1/ 7Udg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1688482879; x=1691074879; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=+fW5eBbpgwXWEYXKyCgZ8uP/MqUV7Jn99nz+wlQcSAA=; b=NIHSOMP8LEejY0xWtr0CAXjgRW6OIyA6Oh85cvHmrS1ha2nFxibTqGFlZgYHQVEzKP 2FeLaIxO0FVZuUwoCLtLK91OU++yoxAklpUbyGnxHcV8unumCAnpKtEWUHMORZc+x5Oh zOgXoHQu/hQs/NfKZ91sXTQrdzznE5KTc9+ggLlxgYdfTpVz5jbkjbgYTGP67pARWUmm u6PT4nv51Lf0Vx1MLawm5iCt3RJRQv4eReriAKJzs3YvQ7WCHGoPK8E9uAcFxVeM/gGk LvQwpDoQ6K5jM64O3i8kuuVCMat1iuCCeGaOPdAyZy4QRoXm+dIZxmRt3rNpSf1oQeYK ZesA== X-Gm-Message-State: ABy/qLZEbNe9GwHuabYgOREycDwcyY22fpYGzhgt4rRqTlycNZJNGOfB 33oTKnK+I3ABNp5sHbSh5jgoS7+K+J7DUZmnlVqAQexyURM= X-Google-Smtp-Source: APBJJlH23FHNv6l4xDs2iFAMu5SmM8CeoA4Cy8UBevN15lSC8OQJ7/vp1LERB0XwAoJTw1KcKY17o8VmoCpV1kiuVlQ= X-Received: by 2002:a05:622a:1a89:b0:403:4fa6:a5d5 with SMTP id s9-20020a05622a1a8900b004034fa6a5d5mr10527371qtc.64.1688482879471; Tue, 04 Jul 2023 08:01:19 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <664978DE-B510-4C14-A559-541C3AB00D50@FreeBSD.org> In-Reply-To: <664978DE-B510-4C14-A559-541C3AB00D50@FreeBSD.org> From: Chuck Tuffli Date: Tue, 4 Jul 2023 08:01:08 -0700 Message-ID: Subject: Re: nvme related(?) panic on recent -CURRENT To: Juraj Lutter Cc: FreeBSD CURRENT Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-0.19 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_SPAM_SHORT(0.93)[0.930]; NEURAL_SPAM_MEDIUM(0.88)[0.876]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::82e:from]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-Rspamd-Queue-Id: 4QwQwd6Hp7z3qVw X-Spamd-Bar: / X-ThisMailContainsUnwantedMimeParts: N On Thu, Jun 29, 2023 at 12:47=E2=80=AFPM Juraj Lutter wr= ote: > > With recent -current, following occured: > > db> bt > Tracing pid 0 tid 100063 td 0xfffffe00c5c35e40 > kdb_enter() at kdb_enter+0x32/frame 0xfffffe00c5e31c90 > vpanic() at vpanic+0x181/frame 0xfffffe00c5e31ce0 > panic() at panic+0x43/frame 0xfffffe00c5e31d40 > nvme_ctrlr_identify() at nvme_ctrlr_identify+0x10e/frame 0xfffffe00c5e31d= 90 > nvme_ctrlr_start() at nvme_ctrlr_start+0x91/frame 0xfffffe00c5e31e10 > nvme_ctrlr_reset_task() at nvme_ctrlr_reset_task+0xec/frame 0xfffffe00c5e= 31e40 > taskqueue_run_locked() at taskqueue_run_locked+0x182/frame 0xfffffe00c5e3= 1ec0 > taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00c5e= 31ef0 > fork_exit() at fork_exit+0x7d/frame 0xfffffe00c5e31f30 > fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00c5e31f30 > --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 =E2=80=94 > > machine is a bhyve guest. If I'm lldb'ing correctly, nvme_ctrlr_identify+0x10e is the panic in nvme_completion_poll() if the NVMe command does not complete within the timeout period (10 seconds). In this case, it is the Identify, Controller command. In the bhyve emulation, this command effectively memcpy's the data structure to the memory provided by the guest and completes the command. If this panic is reproducible, I can provide a patch to enhance the debug output to figure out if this is an emulation or driver issue. --chuck