From nobody Mon Sep 09 15:27:07 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4X2W0p6xFJz5WfyZ for ; Mon, 09 Sep 2024 15:27:22 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-vs1-f42.google.com (mail-vs1-f42.google.com [209.85.217.42]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4X2W0p0q7Nz4llH for ; Mon, 9 Sep 2024 15:27:22 +0000 (UTC) (envelope-from asomers@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.217.42 as permitted sender) smtp.mailfrom=asomers@gmail.com Received: by mail-vs1-f42.google.com with SMTP id ada2fe7eead31-49bd221ef66so1522720137.2 for ; Mon, 09 Sep 2024 08:27:22 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1725895641; x=1726500441; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=oizVqOvV3eqrfxO7lz+C5rVCBLghtf5uiu4ZvdGS+eM=; b=r/QnTr1esZf4/zR9NxNKM16OVFUPeUYUI3pMak1lDRUizqQTLyAq3MmxnY8liV3qTq wvAA/TMW6O9CjCde1i0YZrzMcunZuV139UqPWkLqb/TYyC+vkqGjDBvGqiwTeV4bbtwf RIAOdwdkMe7bnloGdtWtKav7N1qHiRxsdsO9kUzrsWjjd6iQ8KRvCi/KO5E8Tir/miGp eBYF3AVFrrwsMLycTL+KtScMRYsdaULM0kAb6ACMPRur0cHZNwWLBWyiji4iGaT25pcq 0ifAmaEe5/FATBSxYC9eU88BBSojRiyi1NKFh5C1pD/BOg1DWnFbrCCzuI3C8DnlvVoC g+OQ== X-Forwarded-Encrypted: i=1; AJvYcCUou7M6CqWOjZuCSV9G5nUPD2JxKoJaPGb3tLChhKXRU7xNugWNF16dHKuzZFv079PU3lH6+SxlPJDq@freebsd.org X-Gm-Message-State: AOJu0YxSrE3R/2EAUOIgDSmG3mrKBclpwaBzD0iqmUaxWPDrDjHrais7 Lw5EzRuB1AzBz3ivlcWqtJgoBFm123v1EvLJaDN47qSf7CJiVnyhhR8U/uq3yqz8k+RTHouFMfo BgAJoHPjxCzXCKpOegQ8rvNrQyDWHnCGG X-Google-Smtp-Source: AGHT+IHA1nKHr5Vx3ISnJE9kLz91Z/RpCk2GIz8misbn2i/IVuJ3LJ85ePR6qHtXDbI0oCQZoQjjzkmFGa/b80NVpNs= X-Received: by 2002:a05:6102:5124:b0:498:efe0:f91d with SMTP id ada2fe7eead31-49bde2c197amr12925221137.19.1725895640754; Mon, 09 Sep 2024 08:27:20 -0700 (PDT) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 References: <5ED5CB56-2E2A-4D83-8CDA-6D6A0719ED19@distal.com> <6A20ABDA-9BEA-4526-94C1-5768AA564C13@distal.com> <0CF1E2D7-6C82-4A8B-82C3-A5BF1ED939CF@distal.com> <29003A7C-745D-4A06-8558-AE64310813EA@distal.com> <42346193-AD06-4D26-B0C6-4392953D21A3@gmail.com> <50B791D8-F0CC-431E-93B8-834D57AB3C14@gmail.com> In-Reply-To: From: Alan Somers Date: Mon, 9 Sep 2024 09:27:07 -0600 Message-ID: Subject: Re: Unable to replace drive in raidz1 To: Chris Ross Cc: Wes Morgan , FreeBSD Filesystems Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: - X-Spamd-Result: default: False [-1.59 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.97)[-0.972]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; NEURAL_SPAM_MEDIUM(0.28)[0.278]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), No valid DKIM,none]; MIME_TRACE(0.00)[0:+]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; RCPT_COUNT_THREE(0.00)[3]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; MISSING_XM_UA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; FREEFALL_USER(0.00)[asomers]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RCVD_IN_DNSWL_NONE(0.00)[209.85.217.42:from]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; TAGGED_RCPT(0.00)[freebsd]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.217.42:from]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4X2W0p0q7Nz4llH On Mon, Sep 9, 2024 at 8:56=E2=80=AFAM Chris Ross wrote: > > > > > On Sep 6, 2024, at 18:53, Chris Ross wrote: > >> On Sep 6, 2024, at 18:28, Alan Somers wrote: > >> > >> If it's a 4kn disk, then what you ask for is impossible. If it's > >> 512e, then it should've already worked. With diskinfo, a 512e disk > >> will have 512 sectorsize and 4096 stripesize. A 4kn disk will show > >> 4096 sectorsize. If you cannot obtain a 512n or 512e disk, then I'm > >> afraid that you'll have to recreate your whole pool. > > > > Happy to hear other thoughts. I could move all of the data to > > another system and rebuild it with a new vdev, but I=E2=80=99m not sure > > if I care to grow the FS enough to do that. :-) > > Okay, final question. If I destroy and rebuild the pool, and have a RAID= z > with 512-byte sector drives, can I replace those with larger 4k sector > drives as long as I have created the vdev with =E2=80=9Cashift=3D12=E2=80= =9D? Absolutely. Just set vfs.zfs.min_auto_ashift=3D12 before you create the po= ol. > > You said =E2=80=9Cif your pool has a 512B block size=E2=80=9D. Does that= mean the ashift > value, or is there something else that I=E2=80=99ll need to be mindful of= if > I want to be able to upgrade to 4k disks? Correct. That means the ashift value.