From nobody Thu Feb 24 03:15:11 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8BF1A19EADD0 for ; Thu, 24 Feb 2022 03:15:20 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-qk1-x72c.google.com (mail-qk1-x72c.google.com [IPv6:2607:f8b0:4864:20::72c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K3yhR4Y7vz4VYf for ; Thu, 24 Feb 2022 03:15:19 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-qk1-x72c.google.com with SMTP id j78so812265qke.2 for ; Wed, 23 Feb 2022 19:15:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:message-id:date:mime-version:user-agent:subject :content-language:to:cc:references:from:in-reply-to :content-transfer-encoding; bh=k2JPOKGQEGI4QrBOHkih+PjadiotiV7q8nEvmK7gjR8=; b=Hv05wPtAE0ggQ0KX/uo9cCxA6zxJWzADUwYh0EWA7Svdk9YUcETMkwD681y2XdELMx 53lhI/Fv12IyOMqDPMuILxyfeiJg6iMi6VO2xlUwYRvGe1ulq36Jp6KnFTwAnj+XqLEC habcYnzorZIuvScwtp2sEqR1Y2mMLHFcYUozVjSvngHbWHob2gyWqNYLuypeLaV2VgVs bH4e5Y4viKLTnQlgJVM31VBoAYZ3T9Lol34PV5Tw5xDP/WPKv65RRyZUkUvmIeByd5L+ jFYoezbc4M22TBpuxPqdTJcZza2uFP5OQ8zn0+0C9Cuf62Vz+rBnEwIYlLjAdP3C9pEn B36Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:message-id:date:mime-version:user-agent :subject:content-language:to:cc:references:from:in-reply-to :content-transfer-encoding; bh=k2JPOKGQEGI4QrBOHkih+PjadiotiV7q8nEvmK7gjR8=; b=cqwUhyr/JAtK8B+B0pScnQdGT72RvdtJz2YJWd3+v3ahMa9kLnCcw7lgeFxB0ho/ZP 3mkp2Qz28EZPEZc3Gn3YSbEL6nr40wCEDY2bCfeZhRJZjv3ImpRJ9Xh0rvVeLY4DBy/u MyWWg/Kngh313qX9T7gtM1P3wp7hkQwIWoNjoHzWCBGxeAukkWlbEJD1d7gaRsH3D7iQ 6B9inJETCkBJFjO7G+ZyoBgiJyHZRF+KwhSDaQmSfgPqpjWLIuVgBRGbDax3Cc8bkFT8 VQ3tLA8US4sBYRSPwmcZmF2rrY0QUPceDAildI90fh06oN1SGMLqyo8FfgYM9+WbiZ9c zYJg== X-Gm-Message-State: AOAM5336Q4lGqLCCsm69/mSb4awxFPgnE/mbl+JVFI1shEZ+7r+kAiAO hKLoXAWB7gk/jsHCtJsZlt0YmEh83Jk= X-Google-Smtp-Source: ABdhPJxI39YZiWoiunlWm1mCBjwvPsD0BVz1WboB1L+0ZcOFcYSbbARd52F+JZY/6eawPD3nnQGTBw== X-Received: by 2002:a05:620a:578:b0:649:63d7:bb15 with SMTP id p24-20020a05620a057800b0064963d7bb15mr111635qkp.3.1645672512824; Wed, 23 Feb 2022 19:15:12 -0800 (PST) Received: from [192.168.1.66] (104-55-12-234.lightspeed.knvltn.sbcglobal.net. [104.55.12.234]) by smtp.gmail.com with ESMTPSA id e9sm745531qkm.27.2022.02.23.19.15.12 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 23 Feb 2022 19:15:12 -0800 (PST) Message-ID: <7abcbe88-446f-44b9-c3a7-0997d3430b57@FreeBSD.org> Date: Wed, 23 Feb 2022 22:15:11 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Subject: Re: ZFS PANIC: HELP. Content-Language: en-US To: Larry Rosenman Cc: Freebsd current References: <07c0c9c34b4a4133acab597c96867d27@lerctr.org> <95c7c326-e2f9-6e66-7b97-b9fb2671f4ad@FreeBSD.org> <1b6b2017ba69e6fda1ca237c3016ac61@lerctr.org> <6182c57bf1859482e72af78037c399e4@lerctr.org> From: Alexander Motin In-Reply-To: <6182c57bf1859482e72af78037c399e4@lerctr.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4K3yhR4Y7vz4VYf X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=Hv05wPtA; dmarc=none; spf=pass (mx1.freebsd.org: domain of mavbsd@gmail.com designates 2607:f8b0:4864:20::72c as permitted sender) smtp.mailfrom=mavbsd@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; SUBJ_ALL_CAPS(1.20)[16]; FORGED_SENDER(0.30)[mav@FreeBSD.org,mavbsd@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[mav@FreeBSD.org,mavbsd@gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[FreeBSD.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72c:from]; MLMMJ_DEST(0.00)[freebsd-current]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 23.02.2022 22:01, Larry Rosenman wrote: > On 02/23/2022 8:58 pm, Alexander Motin wrote: >> On 23.02.2022 21:52, Larry Rosenman wrote: >>> On 02/23/2022 8:41 pm, Alexander Motin wrote: >>>> Hi Larry, >>>> >>>> The panic you are getting is an assertion, enabled by kernel built >>>> with INVARIANTS option.  On 13 you may just not have that debugging >>>> enabled to hit the issue.  But that may be only a consequence. >>>> Original problem I guess in possibly corrupted ZFS intent log records >>>> (or false positive), that could happen so due to use of -F recovery >>>> option on `zpool import`, that supposed to try import pool at earlier >>>> transaction group if there is some metadata corruption found.  It is >>>> not supposed to work 100% and only a last resort.  Though may be that >>>> assertion is just excessively strict for that specific recovery case. >>>> If as you say pool can be imported and scrubbed on 13, then I'd expect >>>> following clean export should allow later import on 14 without -F. >>>> >>>> On 23.02.2022 21:21, Larry Rosenman wrote: >>>>> >>>>> 've got my main dev box that crashes on 14 with the screen shot at >>>>> https://www.lerctr.org/~ler/14-zfs-crash.png. >>>>> Booting from a 13-REL USB installer it imports and scrubs. >>>>> >>>>> Ideas? >>>>> >>>>> I can either video conference with shared screen or give access to >>>>> the console via my Dominion KVM. >>>>> >>>>> Any help/ideas/etc welcome I really need to get this box back. >>>>> >>>>> >>> How can I import the pool withOUT it mounting the FileSystems so I >>> can export it cleanly on the 13 system? >> >> Why do you need to import without mounting file systems?  I think you >> may actually wish them to be mounted to replay their ZILs.  Just use >> -R option to mount file systems in some different place. > > I get the errors shown at: > https://www.lerctr.org/~ler/14-mount-R-output.png > > Should I worry?  Or do something(tm) here? This looks weird, but may possibly depend on mount points topology, whether /mnt is writable, etc. What happen if you export it now and try to import it in normal way on 14 without -F? -- Alexander Motin