From nobody Sun Feb 27 21:58:42 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 29EFF19EB344 for ; Sun, 27 Feb 2022 21:58:52 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qk1-x733.google.com (mail-qk1-x733.google.com [IPv6:2607:f8b0:4864:20::733]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K6HTR2zDJz4r2X for ; Sun, 27 Feb 2022 21:58:51 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qk1-x733.google.com with SMTP id b20so1657579qkn.9 for ; Sun, 27 Feb 2022 13:58:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to; bh=H24pLG6yq90y19Q9fFGw6AIWM70odFiK0tyYZfphiOk=; b=ZuM0m8GKKl/Lqmv0+RBhk96Gp9zNQQZ0Ozt4iDm5ACWdUm8j2X2FZJTpg7TePl75Su IMR6P1D57cMcV6VKQfHjhEqWzVXRfhTOsZOukxIxZ2d/YYKzf/J+ASgQLoGR4B+1eaFi Q1davYLxPDE+JhcEuzqKGfks0o9SYsmHNVNbRATdki8opSiZ6JBk5s7UBMULuQoi+QxV D0DkqY45FnQ0n2KzN1VPcZuZfqiXm6hmUCeS4mgJ0yj2XDtF6DA7UTs1GisUQYN88aJK 0qloxGlaIHVEHEcIUWksszGML2y+Q4oPGNgGD2tCeLLzc6FozWzsgj5C7TBSTUUa+2ZM pZeg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=H24pLG6yq90y19Q9fFGw6AIWM70odFiK0tyYZfphiOk=; b=EWApFw85QK+jvqfKb8FB+mr8NCzetcFH7pH3MNG5ch93ez36wDq1jScPba2hxwmUlq RyklivBMQ+EcZWs6Hmx452Fao8Ph4OPDzUAETYQnut8pQ5F3WkZCJTTXEdGb36jHMo4N IYPtXyWn2ZSnylfZRMJIvzC9qLslwywz19vcmOWtQkx+5nbsEY2XBwVc5w/LnSvhYQzo xf/JCANqcVO3ClflxF2C9h+TLuN1M+2p5XeBkZtxb3BLc+G9V3xJN84yX91dBmW1o0xm GPRpMzbhTuFcs8VTEOL9RkGQ0xp0o+cadttZuZ2mNo3aTA0tsi3QVlPT8BMEMIUr3+2T U3MA== X-Gm-Message-State: AOAM530qJwmiWst8pjxlwvnebMg9cGEVpZH16KS4oD/aLuTvw3jwFFmV ReZafkK4k7SR+WlZ8X2l5q4lj32OC6U= X-Google-Smtp-Source: ABdhPJy7sPGYtoDEafzXPU+0hc6JKmb87ozxRjToqkknjhPIb2Dy5GqUOGVVW/f18h6YVlYUMSHw9g== X-Received: by 2002:a37:27d0:0:b0:4e1:a93:412b with SMTP id n199-20020a3727d0000000b004e10a93412bmr9816758qkn.360.1645999125322; Sun, 27 Feb 2022 13:58:45 -0800 (PST) Received: from nuc (198-84-189-58.cpe.teksavvy.com. [198.84.189.58]) by smtp.gmail.com with ESMTPSA id 141-20020a370393000000b00649498f69dbsm4291727qkd.91.2022.02.27.13.58.44 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 27 Feb 2022 13:58:44 -0800 (PST) Date: Sun, 27 Feb 2022 16:58:42 -0500 From: Mark Johnston To: Larry Rosenman Cc: Freebsd current Subject: Re: ZFS PANIC: HELP. Message-ID: References: <36d3896af19acc4fdd1712822ba9d420@lerctr.org> <9f6a8ad62fc0dbd6f3a19c7d695bd302@lerctr.org> <20220225091120.Horde.76VjoVNtr5BsqAw_5ftjpRZ@webmail.leidinger.net> <04CB94C0-93FE-402B-A24E-1BDAC0D87C5D@lutter.sk> <8df623691922973b5e9b8609d78c4cfa@lerctr.org> <85057850abd46331c95b9a2f3a0c07d8@lerctr.org> <740a16472bb1073174efa709f795896c@lerctr.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <740a16472bb1073174efa709f795896c@lerctr.org> X-Rspamd-Queue-Id: 4K6HTR2zDJz4r2X X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=ZuM0m8GK; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::733 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [0.06 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; SUBJ_ALL_CAPS(1.20)[16]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_LONG(-0.97)[-0.972]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_SPAM_MEDIUM(0.53)[0.527]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::733:from]; MLMMJ_DEST(0.00)[freebsd-current]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Sun, Feb 27, 2022 at 01:16:44PM -0600, Larry Rosenman wrote: > On 02/26/2022 11:08 am, Larry Rosenman wrote: > > On 02/26/2022 10:57 am, Larry Rosenman wrote: > >> On 02/26/2022 10:37 am, Juraj Lutter wrote: > >>>> On 26 Feb 2022, at 03:03, Larry Rosenman wrote: > >>>> I'm running this script: > >>>> #!/bin/sh > >>>> for i in $(zfs list -H | awk '{print $1}') > >>>> do > >>>> FS=$1 > >>>> FN=$(echo ${FS} | sed -e s@/@_@g) > >>>> sudo zfs send -vecLep ${FS}@REPAIR_SNAP | ssh > >>>> ler@freenas.lerctr.org cat - \> $FN > >>>> done > >>>> > >>>> > >>>> > >>> I’d put, like: > >>> > >>> echo ${FS} > >>> > >>> before “sudo zfs send”, to get at least a bit of a clue on where it > >>> can get to. > >>> > >>> otis > >>> > >>> > >>> — > >>> Juraj Lutter > >>> otis@FreeBSD.org > >> I just looked at the destination to see where it died (it did!) and I > >> bectl destroy'd the > >> BE that crashed it, and am running a new scrub -- we'll see whether > >> that was sufficient. > >> > >> Thanks, all! > > Well, it was NOT sufficient.... More zfs export fun to come :( > > I was able to export the rest of the datasets, and re-install 14-CURRENT > from a recent snapshot, and restore the datasets I care about. > > I'm now seeing: > mfi0: IOCTL 0x40086481 not handled > mfi0: IOCTL 0x40086481 not handled > mfi0: IOCTL 0x40086481 not handled > mfi0: IOCTL 0x40086481 not handled > pid 48 (zpool), jid 0, uid 0: exited on signal 6 > mfi0: IOCTL 0x40086481 not handled > mfi0: IOCTL 0x40086481 not handled > mfi0: IOCTL 0x40086481 not handled > mfi0: IOCTL 0x40086481 not handled > pid 54 (zpool), jid 0, uid 0: exited on signal 6 > > On boot. Ideas? That ioctl is DIOCGMEDIASIZE, i.e., something is asking /dev/mfi0, the controller device node, about the size of a disk. Presumably this is the result of some kind of misconfiguration somewhere, and /dev/mfid0 was meant instead.