From nobody Wed May 01 19:15:46 2024 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VV6H65JHfz5Jv7P for ; Wed, 1 May 2024 19:16:02 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [66.165.241.226]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4VV6H568XDz4c5k for ; Wed, 1 May 2024 19:16:01 +0000 (UTC) (envelope-from pete@nomadlogic.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=nomadlogic.org header.s=04242021 header.b=oSxnojWv; dmarc=pass (policy=quarantine) header.from=nomadlogic.org; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 66.165.241.226 as permitted sender) smtp.mailfrom=pete@nomadlogic.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nomadlogic.org; s=04242021; t=1714590944; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=fkRXabiUn7HEo0FdQYz8m4q/7KzHldm5W65eiQAglBQ=; b=oSxnojWv15Fsh32ZiBNjWQLWbK7YHARvX55a1ttVaiRkYLIzCvjQDdNFJubnywFNxfwX5I +bU9zLaBPucn8eMw7a1MFgyeeRCps1rfbi1cMDh0+1OELPG2kLyWUUNdnSjIO/llmNIUqA dbsZrUl3ZbAu6K+/JBDCYyEGLBXZZO8= Received: from topanga ( [47.154.31.160]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 1250243c (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Wed, 1 May 2024 19:15:42 +0000 (UTC) Date: Wed, 1 May 2024 12:15:46 -0700 From: Pete Wright To: Alejandro Imass Cc: FreeBSD Questions Subject: Re: Corosync and Pacemaker in FBSD: anyone really using this? Message-ID: References: List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-questions@freebsd.org Sender: owner-freebsd-questions@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[nomadlogic.org,quarantine]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[nomadlogic.org:s=04242021]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:29802, ipnet:66.165.240.0/22, country:US]; MISSING_XM_UA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[freebsd-questions@freebsd.org]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[nomadlogic.org:+] X-Rspamd-Queue-Id: 4VV6H568XDz4c5k On Tue, Apr 30, 2024 at 05:41:37PM UTC, Alejandro Imass wrote: > Hi all, > > I've been trying to get some simple clusters to work for about a month now. > But it all seems very unstable. I got a pgsql master/slave working but with > the recent minor version update, new clusters aren't working anymore. > > These pacemaker/corosync/crmsh ports seem more like a curiosity, and many > things are not working as expected. I mean, I love and appreciate the fact > that someone is trying to make this work here, but it seems very Linux > oriented and not very stable on FBSD, much less in jails. When you ask on > the Clusterlabs groups/lists, it seems they could care less about its use > on FreeBSD. > > Is anyone really using this in the wild ? > I am using this on AWS, but I had quite a bit of hacking on my end to get failover working. In my case my primary issue was getting an elastic-ip to disassociate from one instance and reassociate to the new primary. My use-case was to build a HA pair of HA-Proxy servers, thus the need to float a VIP. If I had a real physical datacenter i'd just have used CARP, but thats not really workable in AWS or public could environments. I'd be interested in hearing about what specific issues you are running into, while I agree the upstream community is pretty linux-centric I was able to it working pretty well. Another option that might be worth exploring is using ha-proxy itself to serve a VIP of our psql db endpoint, I've found it to work pretty well for load balancing various TCP services and the REST api is super handy as well. -pete