From nobody Wed Feb 07 12:24:29 2024 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TVK7B03QMz59Gw1 for ; Wed, 7 Feb 2024 12:24:38 +0000 (UTC) (envelope-from SRS0=uefI=JQ=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4TVK793tsgz59Tr for ; Wed, 7 Feb 2024 12:24:37 +0000 (UTC) (envelope-from SRS0=uefI=JQ=perdition.city=julien@bebif.be) Authentication-Results: mx1.freebsd.org; none Received: from belspo (unknown [10.209.1.137]) by orval.bbpf.belspo.be (Postfix) with ESMTPS id 30A861DB40; Wed, 7 Feb 2024 13:24:30 +0100 (CET) Date: Wed, 7 Feb 2024 13:24:29 +0100 From: Julien Cigar To: Andrea Brancatelli Cc: fs@freebsd.org Subject: Re: ZFS on a shared iSCSI Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="ppdebwkw7x3q32sg" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4TVK793tsgz59Tr X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE] --ppdebwkw7x3q32sg Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Feb 07, 2024 at 11:55:54AM +0100, Andrea Brancatelli wrote: > Hello guys, I'm not 100% this is the correct list to ask this question, if > not please feel free to point me in the right direction. >=20 > I was wondering what could be the best recipe to have an HA cluster shari= ng > an external ZFS storage. >=20 > Let's say I have two servers running a bunch of Jails and, thus, I'd like > to use ZFS as the underlying storage layer and I have an external (iSCSI) > storage connected. >=20 > Would it be "easily possible" to have some (2?) iSCSI LUN exposed to both > servers and then activate the pool on one or the other server? >=20 > The idea would be to reactivate the filesystem from server A on server B = if > the server A fails. >=20 > Would it be "easier" to replicate everything and zfs send datas back and > forth? Clearly that would mean doubling datas and havin a scheduled repli= ca > with a possible delay in data replication, so I'd like to avoid this. >=20 > Any thoughts? I asked something similar a few years ago, the whole thread may be an inter= esting read: https://lists.freebsd.org/pipermail/freebsd-fs/2016-June/023456.html Just to say that I tried a lot of different things, and came up to the conclusion that for critical production usage all those things are fragile and with hidden dragons everywhere. I love FreeBSD (I use it exclusively everywhere, also at work), but there aren't any supported open-source solution for something like an "highly available ZFS cluster". On the commercial side there is RSF-1 and beasts like Pure storage ($$$) but ... I would really like to see CEPH ported to FreeBSD, that would be extremely useful Julien >=20 > Thanks a lot. >=20 > --=20 > *Andrea Brancatelli* --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --ppdebwkw7x3q32sg Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmXDdnoACgkQCLYqJMpB HmkWCRAAxpLKKakPNDKjgqsrCUtD7T3wN5dxzzQrL/2ipRiG1Azt7Q179aFYqf5L H4n57+CZ8vfdE9xO7qV3v8HRN3M3JhtfF53JdzRh+s4VsIqLr1mLwvtiP9hsG3aL 3vfl50VDJamvR2qIdrdnwqNrSl9BrCK7ea6qGzRiyUB2yiLxXiOteOp7CT6GyDlV 9qFI2HGNXYNAytm3fBkmR71xsi2UcFYXtkSjkrFhD9k47SAu3VdK5APqGX1oj7QE a0v2rburG4BvbqyNuiy3U7LKFH18xY5l8HAXudiTLVzbNfPMRhgSsGYcqodIgFfH C3uNRG0+u1NDlt6Vh2MY+xvWC7CzAhZX8PkMBhPrq2PJo9keisd4qjhLXq1vBFaV MUFLZAnKz/H2WAh0bQ9PQsHMZhHWizvVdRXSy3hdIGj6A6B/xedR9j+ISzPcsthU s+6iA3rqIR4vbHDUTkbv85H7/yzmY9l6u9czYeVZX/ve1VwkYAh/XYKhZNsSgJjr BBG6eTX7QoONgnLYQSHzWneu3ainihxMk4c7PrQLUUD9oGMwsd1oR/APec5fEKtK vcpLeipmN45Rhy8nj4EHnuzy6/lQPfEs1MenbGMYBU5zNfPRqUR6ULbiMEksYWyV r8hJADa16cV5De4WRpg8Emo5zNWp5tdDBliKhwqHhyGdxpKsC2w= =dOEi -----END PGP SIGNATURE----- --ppdebwkw7x3q32sg--