From nobody Sun Dec 03 00:00:36 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SjRlN0w1wz53D7W for ; Sun, 3 Dec 2023 00:00:48 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from holgerdanske.com (holgerdanske.com [IPv6:2001:470:0:19b::b869:801b]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "holgerdanske.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SjRlL5lfsz3M3Z for ; Sun, 3 Dec 2023 00:00:46 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=holgerdanske.com header.s=nov-20210719-112354 header.b=jl36hNsD; spf=pass (mx1.freebsd.org: domain of dpchrist@holgerdanske.com designates 2001:470:0:19b::b869:801b as permitted sender) smtp.mailfrom=dpchrist@holgerdanske.com; dmarc=pass (policy=none) header.from=holgerdanske.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=holgerdanske.com; s=nov-20210719-112354; t=1701561637; bh=LWRbEnOOYU62UXTJoJ4XPIm8BD+YQ9XcklocfuCeCSk=; h=Received:Message-ID:Date:MIME-Version:User-Agent:Content-Language: To:From:Subject:Content-Type:Content-Transfer-Encoding; b=jl36hNsDsiT3Grvpe7TagBpLQKlgGDr8u6U3LUU8dzwVXapzEdCpMZr46uKwuPWrr dzMePQkNw33WumajJoqVLBTgdiNbrUQfKbj8DR0CnhyeGxboFelYLHip/5pj2VtHmY QcJr6jEo8KCXvPfWNuHpJ+OrfzTQD87Z8y3lwxXTKqRPVFldSBOJnZud1gb0KYU48t J7etpSvSNMXsxWfT7TKQLHjYURxm6oynESSYm2GNrhC11nCmSI0spDKRic4Vw2+uAt MOcdAoFHX84JWUaFGllrKAk4aqbIYvW9WuHJxVYgkBj1YwMOdEXDN9azKdFAa+cGxC 5sxzc/bB3kxT+UYX6W+0yMTiLeQDT4XTT6wkeFmGVcJLTXHSv4brHnM+zPT2AxhlRT h6GSG40ECgOSZLHWmNiIYe/BIAAwPbwt+lC6kTRnAo0bocvs6sOnMDqKRn1Z+opEyF OOJrZevBdxwtMykm6Ch2G4kQQ5/EkwRFfKIOmdqNlulm7GJka+jheD5LUZ1mo544Ir 80HdlqGr+6y0zaLbg1qCAg0UlPrcablL14JDD543llmcZjPAMTdyCxrLZF767tUWEM yKftIclGXd+wufcOkYJaJtKSAnFWmdnMX/JLvXyzStL2JfVPkNcsdtzRNYHjYJzAna 7C9PoBPhWy2lyVHH6LzzuWEQ= Received: from 99.100.19.101 (99-100-19-101.lightspeed.frokca.sbcglobal.net [99.100.19.101]) by holgerdanske.com with ESMTPSA (TLS_AES_128_GCM_SHA256:TLSv1.3:Kx=any:Au=any:Enc=AESGCM(128):Mac=AEAD) (SMTP-AUTH username dpchrist@holgerdanske.com, mechanism PLAIN) for ; Sat, 2 Dec 2023 16:00:36 -0800 Message-ID: Date: Sat, 2 Dec 2023 16:00:36 -0800 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: freebsd-questions@freebsd.org From: David Christensen Subject: FreeBSD 12.4-R zpool remove dedup devices Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.89 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[holgerdanske.com,none]; R_DKIM_ALLOW(-0.20)[holgerdanske.com:s=nov-20210719-112354]; R_SPF_ALLOW(-0.20)[+a:november.he.net]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; XM_UA_NO_VERSION(0.01)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MLMMJ_DEST(0.00)[freebsd-questions@freebsd.org]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[holgerdanske.com:+]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4SjRlL5lfsz3M3Z X-Spamd-Bar: --- freebsd-questions: I have a FreeBSD machine: 2023-12-02 15:48:22 toor@f2 ~ # freebsd-version -kru ; uname -a 12.4-RELEASE-p6 12.4-RELEASE-p6 12.4-RELEASE-p8 FreeBSD f2.tracy.holgerdanske.com 12.4-RELEASE-p6 FreeBSD 12.4-RELEASE-p6 GENERIC amd64 It has a pool built from three HDD's (data) and two SSD's (dedup): 2023-12-02 14:49:59 toor@f2 ~ # zpool status p2obs pool: p2obs state: ONLINE scan: scrub repaired 0 in 0 days 01:21:31 with 0 errors on Sat Oct 28 22:47:59 2023 config: NAME STATE READ WRITE CKSUM p2obs ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 gpt/p2a.eli ONLINE 0 0 0 gpt/p2d.eli ONLINE 0 0 0 gpt/p2c.eli ONLINE 0 0 0 dedup mirror-1 ONLINE 0 0 0 gpt/dedup2a.eli ONLINE 0 0 0 gpt/dedup2b.eli ONLINE 0 0 0 errors: No known data errors I am attempting to tear down the pool piecemeal and am unable to remove the SSD's: 2023-12-02 14:50:59 toor@f2 ~ # zpool remove p2obs gpt/dedup2a.eli gpt/dedup2b.eli cannot remove gpt/dedup2a.eli: operation not supported on this type of pool cannot remove gpt/dedup2b.eli: operation not supported on this type of pool 2023-12-02 14:52:53 toor@f2 ~ # zpool remove p2obs mirror gpt/dedup2a.eli gpt/dedup2b.eli cannot remove mirror: no such device in pool cannot remove gpt/dedup2a.eli: operation not supported on this type of pool cannot remove gpt/dedup2b.eli: operation not supported on this type of pool 2023-12-02 14:53:03 toor@f2 ~ # zpool remove p2obs mirror-1 gpt/dedup2a.eli gpt/dedup2b.eli cannot remove mirror-1: invalid config; all top-level vdevs must have the same sector size and not be raidz. cannot remove gpt/dedup2a.eli: operation not supported on this type of pool cannot remove gpt/dedup2b.eli: operation not supported on this type of pool 2023-12-02 14:53:09 toor@f2 ~ # zpool remove p2obs dedup gpt/dedup2a.eli gpt/dedup2b.eli cannot remove dedup: no such device in pool cannot remove gpt/dedup2a.eli: operation not supported on this type of pool cannot remove gpt/dedup2b.eli: operation not supported on this type of pool 2023-12-02 14:53:26 toor@f2 ~ # zpool remove p2obs dedup mirror gpt/dedup2a.eli gpt/dedup2b.eli cannot remove dedup: no such device in pool cannot remove mirror: no such device in pool cannot remove gpt/dedup2a.eli: operation not supported on this type of pool cannot remove gpt/dedup2b.eli: operation not supported on this type of pool 2023-12-02 14:53:35 toor@f2 ~ # zpool remove p2obs dedup mirror-1 gpt/dedup2a.eli gpt/dedup2b.eli cannot remove dedup: no such device in pool cannot remove mirror-1: invalid config; all top-level vdevs must have the same sector size and not be raidz. cannot remove gpt/dedup2a.eli: operation not supported on this type of pool cannot remove gpt/dedup2b.eli: operation not supported on this type of pool STFW I am starting to think that FreeBSD 12.4-R uses ZFS-On-Linux, which only recently added dedup devices, currently does not support removing dedup devices, my only option is to destroy the pool (?). Comments or suggestions? TIA, David