From nobody Wed Feb 07 14:24:32 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TVMnY3jBjz59T6Q for ; Wed, 7 Feb 2024 14:24:33 +0000 (UTC) (envelope-from SRS0=uefI=JQ=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4TVMnY2yRCz4C8m for ; Wed, 7 Feb 2024 14:24:33 +0000 (UTC) (envelope-from SRS0=uefI=JQ=perdition.city=julien@bebif.be) Authentication-Results: mx1.freebsd.org; none Received: from belspo (unknown [10.209.1.137]) by orval.bbpf.belspo.be (Postfix) with ESMTPS id F1A4C1DA6C; Wed, 7 Feb 2024 15:24:32 +0100 (CET) Date: Wed, 7 Feb 2024 15:24:32 +0100 From: Julien Cigar To: Oleksandr Kryvulia Cc: freebsd-fs@freebsd.org Subject: Re: Re: ZFS on a shared iSCSI Message-ID: References: <761c8030-5de9-4114-9313-22ec860fb257@shurik.kiev.ua> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="75g6gu3zemzf4ret" Content-Disposition: inline In-Reply-To: <761c8030-5de9-4114-9313-22ec860fb257@shurik.kiev.ua> X-Rspamd-Queue-Id: 4TVMnY2yRCz4C8m X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE] --75g6gu3zemzf4ret Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Feb 07, 2024 at 04:12:21PM +0200, Oleksandr Kryvulia wrote: > 07.02.24 14:24, Julien Cigar: > > On Wed, Feb 07, 2024 at 11:55:54AM +0100, Andrea Brancatelli wrote: > > > Hello guys, I'm not 100% this is the correct list to ask this questio= n, if > > > not please feel free to point me in the right direction. > > >=20 > > > I was wondering what could be the best recipe to have an HA cluster s= haring > > > an external ZFS storage. > > >=20 > > > Let's say I have two servers running a bunch of Jails and, thus, I'd = like > > > to use ZFS as the underlying storage layer and I have an external (iS= CSI) > > > storage connected. > > >=20 > > > Would it be "easily possible" to have some (2?) iSCSI LUN exposed to = both > > > servers and then activate the pool on one or the other server? > > >=20 > > > The idea would be to reactivate the filesystem from server A on serve= r B if > > > the server A fails. > > >=20 > > > Would it be "easier" to replicate everything and zfs send datas back = and > > > forth? Clearly that would mean doubling datas and havin a scheduled r= eplica > > > with a possible delay in data replication, so I'd like to avoid this. > > >=20 > > > Any thoughts? > > I asked something similar a few years ago, the whole thread may be an i= nteresting > > read: https://lists.freebsd.org/pipermail/freebsd-fs/2016-June/023456.h= tml > >=20 > > Just to say that I tried a lot of different things, and came up to the > > conclusion that for critical production usage all those things are > > fragile and with hidden dragons everywhere. > >=20 > > I love FreeBSD (I use it exclusively everywhere, also at work), but > > there aren't any supported open-source solution for something like an > > "highly available ZFS cluster". On the commercial side there is RSF-1 > > and beasts like Pure storage ($$$) but ... > >=20 > > I would really like to see CEPH ported to FreeBSD, that would be > > extremely useful >=20 > What about www/minio? Does anyone have any experience of production use? = We > have a lot of bhyve vm's backened by local zfs storage, but I am interest= ing > in some kind of hyperconverged solution. I'm not sure Minio offers block storage..? >=20 --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --75g6gu3zemzf4ret Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmXDkqAACgkQCLYqJMpB HmljMhAAjYVueY5uYKSpYJC45RAT9Vj9pLesXAxmrqaxbhoCCgCYz6I6q2FkqueM CxQJ6slC9BJrLuFfRo97HE1fauG9NriMF4AZGrar+Ud8s1sggLMk03zn3J13yPze bd5GyRXiKH11FgiVI9bedKzJo/gCmGp+M3Vqoc7dDbwx0kQt6OetBB04VRpgYCAo C1e0d7DhODIQmDSL/yR+lEvKFPbe0wFIAS8MBnQhIhMmK4KCvftE01tyP9Q0CRed vzviTfH4gti72ytyzF1/w1Uvow4V30P8wnA6+PtybLhELpqEkmnH/vDZkaIM81J9 kptzf/QnHBt334o+VOaY+sJlc6x5hlyD78h+sbAKBGVy0tHiLnOFf75ghw/6Kvt1 151TJ2S4e7Yn5xInrcEvoYCtj77otC/z9+kmT5P3UKz//7otSigULedEbzQvktSO 7GcIE8iZRmr1O7QOj3lCqx/4AhoGO63SHCBaY2QczedICcrmI5VVbKm/w7gTQfd/ iN8yI2wOtpjGuwh6ho11VmBYSwPsjVQ4WGuyXqQBaKqqyI8gppWh+dX46gCTYg0X MJGc2Jflof+g9bhgry5DZ4z10iIxDC5abt95nuEu/NQe0my3IePF9lvl+4aPSQub Lb1W83IBIDw4sRlYshgJb59R7LmteZtRn6p+QbJ591+w07MGxew= =mX+1 -----END PGP SIGNATURE----- --75g6gu3zemzf4ret--