Ceph and Windows - experiences or suggestions
Hi there! I got the task to connect a Windows client to our existing ceph cluster. I'm looking for experiences or suggestions from the community. There came two possibilities to my mind: 1. iSCSI Target on RBD exported to Windows 2. NFS-Ganesha on CephFS exported to Windows Is there a third way exporting a ceph cluster to a windows machine? I have some experiences with CephFS. We have a small cluster successfully running for linux clients. I don't have experiences with RBD or iSCSI. The Windows machine will use the space for backups. The kind of data is unknown. I expect the data to be a MS-SQL dump and user data from a sharepoint system. The Windows admin does not care whether NFS or iSCSI is used. I'd be happy if some of you could share experiences. Thanks Lars
Via smb, much discussed here -----Original Message----- Sent: 13 February 2020 09:33 To: ceph-users@ceph.io Subject: [ceph-users] Ceph and Windows - experiences or suggestions Hi there! I got the task to connect a Windows client to our existing ceph cluster. I'm looking for experiences or suggestions from the community. There came two possibilities to my mind: 1. iSCSI Target on RBD exported to Windows 2. NFS-Ganesha on CephFS exported to Windows Is there a third way exporting a ceph cluster to a windows machine? I have some experiences with CephFS. We have a small cluster successfully running for linux clients. I don't have experiences with RBD or iSCSI. The Windows machine will use the space for backups. The kind of data is unknown. I expect the data to be a MS-SQL dump and user data from a sharepoint system. The Windows admin does not care whether NFS or iSCSI is used. I'd be happy if some of you could share experiences. Thanks Lars _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
I don't have samba experiences. Isn't the installation and administration of a samba server just for one "share" overkill? Thu, 13 Feb 2020 09:36:31 +0100 "Marc Roos" <M.Roos@f1-outsourcing.eu> ==> ceph-users <ceph-users@ceph.io>, taeuber <taeuber@bbaw.de> :
Via smb, much discussed here
-----Original Message----- Sent: 13 February 2020 09:33 To: ceph-users@ceph.io Subject: [ceph-users] Ceph and Windows - experiences or suggestions
Hi there!
I got the task to connect a Windows client to our existing ceph cluster. I'm looking for experiences or suggestions from the community. There came two possibilities to my mind: 1. iSCSI Target on RBD exported to Windows 2. NFS-Ganesha on CephFS exported to Windows
Is there a third way exporting a ceph cluster to a windows machine?
I have some experiences with CephFS. We have a small cluster successfully running for linux clients. I don't have experiences with RBD or iSCSI.
The Windows machine will use the space for backups. The kind of data is unknown. I expect the data to be a MS-SQL dump and user data from a sharepoint system. The Windows admin does not care whether NFS or iSCSI is used.
I'd be happy if some of you could share experiences.
Thanks Lars _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Informationstechnologie Berlin-Brandenburgische Akademie der Wissenschaften Jägerstraße 22-23 10117 Berlin Tel.: +49 30 20370-352 http://www.bbaw.de
In the larger scheme of things, "one smb server", "one nfs server" or "one cephfs MDS" doesn't differ much. You need some kind of box to translate from object storage (regardless of if this is iscsi, ceph or something else) to a kind of filesystem that can give you some extra guarantees (like being a POSIX filesystem) and keep state of locks and atomic ops so that more than one client-or-process can access the shared space without stepping on each others toes. Since there aren't (as far as I know) any native ceph access methods for windows, even a single windows client still need someone somewhere to translate the storage into a form usable by it. Den tors 13 feb. 2020 kl 10:03 skrev Lars Täuber <taeuber@bbaw.de>:
I don't have samba experiences. Isn't the installation and administration of a samba server just for one "share" overkill?
Via smb, much discussed here
-- May the most significant bit of your life be positive.
On 2020-02-13 10:26, Janne Johansson wrote:
In the larger scheme of things, "one smb server", "one nfs server" or "one cephfs MDS" doesn't differ much.
You need some kind of box to translate from object storage (regardless of if this is iscsi, ceph or something else) to a kind of filesystem that can give you some extra guarantees (like being a POSIX filesystem) and keep state of locks and atomic ops so that more than one client-or-process can access the shared space without stepping on each others toes.
Indeed. Some of these protocols may have higher overhead when it comes to translating the data through multiple storage protocols into Ceph's RADOS objects. The fewer "layers", the better the throughput/latency.
Since there aren't (as far as I know) any native ceph access methods for windows, even a single windows client still need someone somewhere to translate the storage into a form usable by it.
Not yet, but this is being worked on: https://github.com/ceph/ceph/pull/31981 https://github.com/petrutlucian94/ceph/blob/windows/README.windows.rst The intention is to implement a native windows client that will eventually be able to consume both RBD and CephFS resources. Lenz -- SUSE Software Solutions Germany GmbH - Maxfeldstr. 5 - 90409 Nuernberg GF: Felix Imendörffer, HRB 36809 (AG Nürnberg)
Hello Lars, we have full SMB Support in our Ceph management solution. You can create simple (user+pass) or complex SMB (AD) high available shares on CTDB clustered Samba with ease. Please see the attached Screenshots [image: image.png] [image: image.png] [image: image.png] [image: image.png] -- Martin Verges Managing director Hint: Secure one of the last slots in the upcoming 4-day Ceph Intensive Training at https://croit.io/training/4-days-ceph-in-depth-training. Mobile: +49 174 9335695 E-Mail: martin.verges@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: https://goo.gl/PGE1Bx Am Do., 13. Feb. 2020 um 10:03 Uhr schrieb Lars Täuber <taeuber@bbaw.de>:
I don't have samba experiences. Isn't the installation and administration of a samba server just for one "share" overkill?
Thu, 13 Feb 2020 09:36:31 +0100 "Marc Roos" <M.Roos@f1-outsourcing.eu> ==> ceph-users <ceph-users@ceph.io>, taeuber <taeuber@bbaw.de> :
Via smb, much discussed here
-----Original Message----- Sent: 13 February 2020 09:33 To: ceph-users@ceph.io Subject: [ceph-users] Ceph and Windows - experiences or suggestions
Hi there!
I got the task to connect a Windows client to our existing ceph cluster. I'm looking for experiences or suggestions from the community. There came two possibilities to my mind: 1. iSCSI Target on RBD exported to Windows 2. NFS-Ganesha on CephFS exported to Windows
Is there a third way exporting a ceph cluster to a windows machine?
I have some experiences with CephFS. We have a small cluster successfully running for linux clients. I don't have experiences with RBD or iSCSI.
The Windows machine will use the space for backups. The kind of data is unknown. I expect the data to be a MS-SQL dump and user data from a sharepoint system. The Windows admin does not care whether NFS or iSCSI is used.
I'd be happy if some of you could share experiences.
Thanks Lars _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Informationstechnologie Berlin-Brandenburgische Akademie der Wissenschaften Jägerstraße 22-23 10117 Berlin Tel.: +49 30 20370-352 http://www.bbaw.de _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Doesn’t SMB support require a paid subscription?
On Feb 13, 2020, at 3:12 AM, Martin Verges <martin.verges@croit.io> wrote:
Hello Lars,
we have full SMB Support in our Ceph management solution. You can create simple (user+pass) or complex SMB (AD) high available shares on CTDB clustered Samba with ease.
Please see the attached Screenshots <image.png> <image.png> <image.png> <image.png>
-- Martin Verges Managing director
Hint: Secure one of the last slots in the upcoming 4-day Ceph Intensive Training at https://croit.io/training/4-days-ceph-in-depth-training <https://croit.io/training/4-days-ceph-in-depth-training>.
Mobile: +49 174 9335695 E-Mail: martin.verges@croit.io <mailto:martin.verges@croit.io> Chat: https://t.me/MartinVerges <https://t.me/MartinVerges>
croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263
Web: https://croit.io <https://croit.io/> YouTube: https://goo.gl/PGE1Bx <https://goo.gl/PGE1Bx>
Am Do., 13. Feb. 2020 um 10:03 Uhr schrieb Lars Täuber <taeuber@bbaw.de <mailto:taeuber@bbaw.de>>: I don't have samba experiences. Isn't the installation and administration of a samba server just for one "share" overkill?
Thu, 13 Feb 2020 09:36:31 +0100 "Marc Roos" <M.Roos@f1-outsourcing.eu <mailto:M.Roos@f1-outsourcing.eu>> ==> ceph-users <ceph-users@ceph.io <mailto:ceph-users@ceph.io>>, taeuber <taeuber@bbaw.de <mailto:taeuber@bbaw.de>> :
Via smb, much discussed here
-----Original Message----- Sent: 13 February 2020 09:33 To: ceph-users@ceph.io <mailto:ceph-users@ceph.io> Subject: [ceph-users] Ceph and Windows - experiences or suggestions
Hi there!
I got the task to connect a Windows client to our existing ceph cluster. I'm looking for experiences or suggestions from the community. There came two possibilities to my mind: 1. iSCSI Target on RBD exported to Windows 2. NFS-Ganesha on CephFS exported to Windows
Is there a third way exporting a ceph cluster to a windows machine?
I have some experiences with CephFS. We have a small cluster successfully running for linux clients. I don't have experiences with RBD or iSCSI.
The Windows machine will use the space for backups. The kind of data is unknown. I expect the data to be a MS-SQL dump and user data from a sharepoint system. The Windows admin does not care whether NFS or iSCSI is used.
I'd be happy if some of you could share experiences.
Thanks Lars _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io <mailto:ceph-users@ceph.io> To unsubscribe send an email to ceph-users-leave@ceph.io <mailto:ceph-users-leave@ceph.io>
-- Informationstechnologie Berlin-Brandenburgische Akademie der Wissenschaften Jägerstraße 22-23 10117 Berlin Tel.: +49 30 20370-352 http://www.bbaw.de <http://www.bbaw.de/> _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io <mailto:ceph-users@ceph.io> To unsubscribe send an email to ceph-users-leave@ceph.io <mailto:ceph-users-leave@ceph.io> _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
On Thu, Feb 13, 2020 at 10:04 AM Lars Täuber <taeuber@bbaw.de> wrote:
I don't have samba experiences. Isn't the installation and administration of a samba server just for one "share" overkill?
Check out our software, you can deploy a pair of highly available Samba servers with just a few clicks: https://croit.io/croit-virtual-demo From experience: I've used Windows + Ceph with both Samba and iSCSI for backup systems. iSCSI has a few restrictions related to persistent group reservations which can be a problem (but not an issue for backup setups, usually), Samba is more compatible. If you have experience with neither iSCSI nor Samba and you only need a simple setup, then go for Samba. It's easier to configure for simple setups and you'll find lots of example that work out-of-the box. The minimum example is just mounting CephFS somewhere and re-exporting it with Samba and not setting up Samba clustering. That's super easy. If you need high availability or the Ceph VFS then the initial config can be somewhat tricky (iSCSI HA is easier) Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90
Thu, 13 Feb 2020 09:36:31 +0100 "Marc Roos" <M.Roos@f1-outsourcing.eu> ==> ceph-users <ceph-users@ceph.io>, taeuber <taeuber@bbaw.de> :
Via smb, much discussed here
-----Original Message----- Sent: 13 February 2020 09:33 To: ceph-users@ceph.io Subject: [ceph-users] Ceph and Windows - experiences or suggestions
Hi there!
I got the task to connect a Windows client to our existing ceph cluster. I'm looking for experiences or suggestions from the community. There came two possibilities to my mind: 1. iSCSI Target on RBD exported to Windows 2. NFS-Ganesha on CephFS exported to Windows
Is there a third way exporting a ceph cluster to a windows machine?
I have some experiences with CephFS. We have a small cluster successfully running for linux clients. I don't have experiences with RBD or iSCSI.
The Windows machine will use the space for backups. The kind of data is unknown. I expect the data to be a MS-SQL dump and user data from a sharepoint system. The Windows admin does not care whether NFS or iSCSI is used.
I'd be happy if some of you could share experiences.
Thanks Lars _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Informationstechnologie Berlin-Brandenburgische Akademie der Wissenschaften Jägerstraße 22-23 10117 Berlin Tel.: +49 30 20370-352 http://www.bbaw.de _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Quoting Lars Täuber (taeuber@bbaw.de):
Hi there!
I got the task to connect a Windows client to our existing ceph cluster. I'm looking for experiences or suggestions from the community. There came two possibilities to my mind: 1. iSCSI Target on RBD exported to Windows 2. NFS-Ganesha on CephFS exported to Windows
Is there a third way exporting a ceph cluster to a windows machine?
SUSE / Cloudbase Solutions ported Ceph to Windows ... bleeding edge code proably ... but potentially the best way to use Ceph on Windows. See: https://github.com/ceph/ceph/pull/31981 Gr. Stefan -- | BIT BV https://www.bit.nl/ Kamer van Koophandel 09090351 | GPG: 0xD14839C6 +31 318 648 688 / info@bit.nl
Lars Täuber wrote:
I got the task to connect a Windows client to our existing ceph cluster.
Tiger Bridge will extend your NTFS (or ReFS) file system into a Ceph cluster seamlessly. This is a software only gateway with an HSM tiering and synchronization engine that turns inactive files on the NTFS volume into zero-byte stub-files to free up space locally (it recalls data automatically when needed). Learn more about Tiger Bridge - https://www.tiger-technology.com/software/tiger-bridge/ NB. - Note that the trial version (3.7.x) has a known issue with Ceph targets. Contact me directly (bernard at tiger-technology.com) if you would like a trial version for Ceph.
On 13/2/20 6:33 pm, Lars Täuber wrote:
I got the task to connect a Windows client to our existing ceph cluster. I'm looking for experiences or suggestions from the community. There came two possibilities to my mind: 1. iSCSI Target on RBD exported to Windows 2. NFS-Ganesha on CephFS exported to Windows
Virtualise the Windows Client under KVM (which natively supports Ceph) and attach the RBD target as a virtual disk. -- Stuart Longland (aka Redhatter, VK4MSL) I haven't lost my mind... ...it's backed up on a tape somewhere.
participants (10)
-
bernard＠tiger-technology.com
-
Brian Topping
-
Janne Johansson
-
Lars Täuber
-
Lenz Grimmer
-
Marc Roos
-
Martin Verges
-
Paul Emmerich
-
Stefan Kooman
-
Stuart Longland