Mount CEPH-FS on multiple hosts with concurrent access to the same data objects?
I'm new on the list, so a "Hello" to all! :-) We're planning a Proxmox-Cluster. The data-center operator advised to use a virtual machine with NFS on top of a single CEPH-FS instance to mount the shared CEPH-FS storage on multiple hosts/VMs. As this NFS/CEPH-FS-VM could be a bottle-neck I was wondering if CEPH- FS is capable to manage concurrent access and locking itself. Is it possible to mount CEPH-FS instances on multiple hosts (e.g. /srv) all accessing the same data objects without data-loss or dead-locks by concurrent access? Will this perform better than a single NFS/CEPH-FS instance (VM)? Thanx for any hint Renne
Hi Rene, Yes, cephfs is a good filesystem for concurrent writing. When using CephFS with ganesha you can even scale out. It will perform better but why don't you mount CephFS inside the VM? Kind regards, Wout 42on ________________________________________ From: René Bartsch <rene.bartsch@zinal-consulting.de> Sent: Monday, September 21, 2020 6:44 PM To: ceph-users@ceph.io Subject: [ceph-users] Mount CEPH-FS on multiple hosts with concurrent access to the same data objects? I'm new on the list, so a "Hello" to all! :-) We're planning a Proxmox-Cluster. The data-center operator advised to use a virtual machine with NFS on top of a single CEPH-FS instance to mount the shared CEPH-FS storage on multiple hosts/VMs. As this NFS/CEPH-FS-VM could be a bottle-neck I was wondering if CEPH- FS is capable to manage concurrent access and locking itself. Is it possible to mount CEPH-FS instances on multiple hosts (e.g. /srv) all accessing the same data objects without data-loss or dead-locks by concurrent access? Will this perform better than a single NFS/CEPH-FS instance (VM)? Thanx for any hint Renne _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
On 21.09.20 18:44, René Bartsch wrote:
We're planning a Proxmox-Cluster. The data-center operator advised to use a virtual machine with NFS on top of a single CEPH-FS instance to mount the shared CEPH-FS storage on multiple hosts/VMs.
For what purpose do you plan to use CephFS? Do you know that Proxmox is able to store VM images as RBD directly in a Ceph cluster? I would not recommend to store VM images as files on CephFS. Or even exporting NFS out of a VM to store other VM images on it. Regards -- Robert Sander Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin https://www.heinlein-support.de Tel: 030 / 405051-43 Fax: 030 / 405051-19 Amtsgericht Berlin-Charlottenburg - HRB 93818 B Geschäftsführer: Peer Heinlein - Sitz: Berlin
Hello, yes, it does. I even comes with a GUI so manage ceph and own basic-setup tool. No EC support. The only issue comes is with the backup stuff, which uses "vzdump" under the hood that causes possibly high load. The reason is not really known yet, but some suspect that small block sizes cause large readahead in ceph.. Use eve4pve-barc instead. _ _ rgds j. On 22.09.20 14:31, René Bartsch wrote:
Am Dienstag, den 22.09.2020, 08:50 +0200 schrieb Robert Sander:
Do you know that Proxmox is able to store VM images as RBD directly in a Ceph cluster? Does Proxmox support snapshots, backups and thin provisioning with RBD- VM images?
Regards,
Renne _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Andreas John net-lab GmbH | Frankfurter Str. 99 | 63067 Offenbach Geschaeftsfuehrer: Andreas John | AG Offenbach, HRB40832 Tel: +49 69 8570033-1 | Fax: -2 | http://www.net-lab.net Facebook: https://www.facebook.com/netlabdotnet Twitter: https://twitter.com/netlabdotnet
Hello, https://docs.ceph.com/en/latest/rados/operations/erasure-code/ but, you could probably manually intervent, if you want an erasure coded pool. rgds, j. On 22.09.20 14:55, René Bartsch wrote:
Am Dienstag, den 22.09.2020, 14:43 +0200 schrieb Andreas John:
Hello,
yes, it does. I even comes with a GUI so manage ceph and own basic- setup tool. No EC support. What do you mean with EC?
Regards,
Renne
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Andreas John net-lab GmbH | Frankfurter Str. 99 | 63067 Offenbach Geschaeftsfuehrer: Andreas John | AG Offenbach, HRB40832 Tel: +49 69 8570033-1 | Fax: -2 | http://www.net-lab.net Facebook: https://www.facebook.com/netlabdotnet Twitter: https://twitter.com/netlabdotnet
participants (5)
-
Andreas John
-
Lindsay Mathieson
-
René Bartsch
-
Robert Sander
-
Wout van Heeswijk