cluster FS?

[Richard Yao]

On Sep 30, 2014, at 7:04 AM, Wojciech Puchar <wojtek at puchar.net> wrote:

>> 
>> It seems to me (just from reading the handbook)
>> that none of NFS, HAST or iSCSI provide this.
> 
> none of following are filesystems at all. NFS is remote access to filesystem, the rest presents raw block device.
> 
>> My specific needs are as follows.
>> I have multiple nodes and a disk array.
>> Each node is connected by fibre to the disk array.
>> I want to have each node read/write access
>> to all disks on disk array.
>> So that if any node fails, the
>> data is still accessible
>> via the remaining nodes.
> 
> as disk array presents block devices, not files it is not possible to have filesystem read write access with more than one computer to the same block device.
> There is no AFAIK filesystems that can communicate between nodes to synchronize state after writes and prevent conflict.

Linux tends to have most of the work in this area. In specific, Lustre, Ceph and Gluster. Gluster is FUSE-based and the server will run on FreeBSD:

https://wiki.freebsd.org/GlusterFS

The client likely can run on FreeBSD too, but it might be that no one has tested it because the FreeBSD support was done before FreeBSD supported FUSE.