Hi, I am planning to create a new 3 node ceph storage cluster. I will be using Cephfs + with samba for max 10 clients for upload and download. Storage Node HW is Intel Xeon E5v2 8 core single Proc, 32GB RAM and 10Gb Nic 2 nos., 6TB SATA HDD 24 Nos. each node, OS separate SSD disk. Earlier I have tested orchestration using ceph-deploy in the test setup. now, is there any other alternative to ceph-deploy? Can I restrict folder access to the user using cephfs + vfs samba or should I use ceph client + samba? Ubuntu or Centos? Any block size consideration for object size, metadata when using cephfs? Idea or suggestion from existing users. I am also going to start to explore all the above. regards Amudhan
Hi. Unless there is plans for going to Petabyte scale with it - then I really dont see the benefits of getting CephFS involved over just an RBD image with a VM running standard samba on top. More performant and less complexity to handle - zero gains (by my book) Jesper
Hi,
I am planning to create a new 3 node ceph storage cluster.
I will be using Cephfs + with samba for max 10 clients for upload and download.
Storage Node HW is Intel Xeon E5v2 8 core single Proc, 32GB RAM and 10Gb Nic 2 nos., 6TB SATA HDD 24 Nos. each node, OS separate SSD disk.
Earlier I have tested orchestration using ceph-deploy in the test setup. now, is there any other alternative to ceph-deploy?
Can I restrict folder access to the user using cephfs + vfs samba or should I use ceph client + samba?
Ubuntu or Centos?
Any block size consideration for object size, metadata when using cephfs?
Idea or suggestion from existing users. I am also going to start to explore all the above.
regards Amudhan _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hi Jesper, can you state your suggestion more precisely? I have a similar setup and I’m also interested. If i understand you right, you suggest to create an RBD image for data that attachs to a VM with installed samba Server. But what would be the „best“ way to connect? Kernel module mapping or iSCSI targets. Another possibilty would be to create an RBD Image containing data and samba and use it with QEMU. Regards Marco Savoca Von: jesper@krogh.cc Gesendet: Samstag, 14. März 2020 09:15 An: Amudhan P Cc: ceph-users Betreff: [ceph-users] Re: New 3 node Ceph cluster Hi. Unless there is plans for going to Petabyte scale with it - then I really dont see the benefits of getting CephFS involved over just an RBD image with a VM running standard samba on top. More performant and less complexity to handle - zero gains (by my book) Jesper
Hi,
I am planning to create a new 3 node ceph storage cluster.
I will be using Cephfs + with samba for max 10 clients for upload and download.
Storage Node HW is Intel Xeon E5v2 8 core single Proc, 32GB RAM and 10Gb Nic 2 nos., 6TB SATA HDD 24 Nos. each node, OS separate SSD disk.
Earlier I have tested orchestration using ceph-deploy in the test setup. now, is there any other alternative to ceph-deploy?
Can I restrict folder access to the user using cephfs + vfs samba or should I use ceph client + samba?
Ubuntu or Centos?
Any block size consideration for object size, metadata when using cephfs?
Idea or suggestion from existing users. I am also going to start to explore all the above.
regards Amudhan _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Thank you, All for your suggestions and ideas. what is your view on using MON, MGR, MDS and cephfs client or samba-ceph vfs in a single machine (10 core xeon CPU with 16GB RAM and SSD disk)?. On Sun, Mar 15, 2020 at 3:58 PM Dr. Marco Savoca <quaternionma@gmail.com> wrote:
Hi Jesper,
can you state your suggestion more precisely? I have a similar setup and I’m also interested.
If i understand you right, you suggest to create an RBD image for data that attachs to a VM with installed samba Server.
But what would be the „best“ way to connect? Kernel module mapping or iSCSI targets.
Another possibilty would be to create an RBD Image containing data and samba and use it with QEMU.
Regards
Marco Savoca
*Von: *jesper@krogh.cc *Gesendet: *Samstag, 14. März 2020 09:15 *An: *Amudhan P <amudhan83@gmail.com> *Cc: *ceph-users <ceph-users@ceph.io> *Betreff: *[ceph-users] Re: New 3 node Ceph cluster
Hi.
Unless there is plans for going to Petabyte scale with it - then I really
dont see the benefits of getting CephFS involved over just an RBD image
with a VM running standard samba on top.
More performant and less complexity to handle - zero gains (by my book)
Jesper
Hi,
I am planning to create a new 3 node ceph storage cluster.
I will be using Cephfs + with samba for max 10 clients for upload and
download.
Storage Node HW is Intel Xeon E5v2 8 core single Proc, 32GB RAM and 10Gb
Nic 2 nos., 6TB SATA HDD 24 Nos. each node, OS separate SSD disk.
Earlier I have tested orchestration using ceph-deploy in the test setup.
now, is there any other alternative to ceph-deploy?
Can I restrict folder access to the user using cephfs + vfs samba or
should
I use ceph client + samba?
Ubuntu or Centos?
Any block size consideration for object size, metadata when using cephfs?
Idea or suggestion from existing users. I am also going to start to
explore
all the above.
regards
Amudhan
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-leave@ceph.io
This is too little memory. We have already seen MDS with well over 50 GB Ram requirements. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.verges@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: https://goo.gl/PGE1Bx Am So., 15. März 2020 um 14:34 Uhr schrieb Amudhan P <amudhan83@gmail.com>:
Thank you, All for your suggestions and ideas.
what is your view on using MON, MGR, MDS and cephfs client or samba-ceph vfs in a single machine (10 core xeon CPU with 16GB RAM and SSD disk)?.
What if I add another 16GB of RAM for a Planned capacity of not more than 150TB? On Sun 15 Mar, 2020, 7:26 PM Martin Verges, <martin.verges@croit.io> wrote:
This is too little memory. We have already seen MDS with well over 50 GB Ram requirements.
-- Martin Verges Managing director
Mobile: +49 174 9335695 E-Mail: martin.verges@croit.io Chat: https://t.me/MartinVerges
croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263
Web: https://croit.io YouTube: https://goo.gl/PGE1Bx
Am So., 15. März 2020 um 14:34 Uhr schrieb Amudhan P <amudhan83@gmail.com
:
Thank you, All for your suggestions and ideas.
what is your view on using MON, MGR, MDS and cephfs client or samba-ceph vfs in a single machine (10 core xeon CPU with 16GB RAM and SSD disk)?.
Hello， Martin， I notice that Croit advocate the use of ceph cluster without OS disks, but with PXE boot. Do you use a NFS server to serve the root file system for each node? such as hosting configuration files, user and password, log files, etc. My question is, will the NFS server be a single point of failure? If the NFS server goes down, the network experience any outage, ceph nodes may not be able to write to the local file systems, possibly leading to service outage. How do you deal with the above potential issues in production? I am a bit worried... best regards, samuel huxiaoyu@horebdata.cn
I would say you definitely need more RAM with that many disks. ---- On Sat, 14 Mar 2020 15:17:14 +0800 amudhan83@gmail.com wrote ---- Hi, I am planning to create a new 3 node ceph storage cluster. I will be using Cephfs + with samba for max 10 clients for upload and download. Storage Node HW is Intel Xeon E5v2 8 core single Proc, 32GB RAM and 10Gb Nic 2 nos., 6TB SATA HDD 24 Nos. each node, OS separate SSD disk. Earlier I have tested orchestration using ceph-deploy in the test setup. now, is there any other alternative to ceph-deploy? Can I restrict folder access to the user using cephfs + vfs samba or should I use ceph client + samba? Ubuntu or Centos? Any block size consideration for object size, metadata when using cephfs? Idea or suggestion from existing users. I am also going to start to explore all the above. regards Amudhan _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hello Amudhan, I will be using Cephfs + with samba for max 10 clients for upload and
download.
Please use samba vfs and not the kernel mount. Earlier I have tested orchestration using ceph-deploy in the test setup.
now, is there any other alternative to ceph-deploy?
Yes, try our deployment tool. It brings you Ceph the easy way including anything from Ceph RBD, S3, CephFS, NFS, ISCSI, SMB,.. hassle free. Storage Node HW is Intel Xeon E5v2 8 core single Proc, 32GB RAM and 10Gb
Nic 2 nos., 6TB SATA HDD 24 Nos. each node, OS separate SSD disk
You need at least 4 GB ram per HDD, using 24 disks per System is not suggested. With croit, you won't need an OS disk as the storage node gets live booted over the network using PXE. Depending on your requirements, CPU could be a bottleneck as well. Can I restrict folder access to the user using cephfs + vfs samba or should
I use ceph client + samba?
In croit you can attach the samba service to an active directory to make use of permissions. You can configure them by hand as well. Ubuntu or Centos?
Debian ;) it's the best. But Ubuntu is ok as well. Any block size consideration for object size, metadata when using cephfs?
Leave it by the defaults unless you know what special case you have. A lot of issues we see in the wild coming from bad configurations, copy pasted from a random page found on google. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.verges@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: https://goo.gl/PGE1Bx Am Sa., 14. März 2020 um 08:17 Uhr schrieb Amudhan P <amudhan83@gmail.com>:
Hi,
I am planning to create a new 3 node ceph storage cluster.
I will be using Cephfs + with samba for max 10 clients for upload and download.
Storage Node HW is Intel Xeon E5v2 8 core single Proc, 32GB RAM and 10Gb Nic 2 nos., 6TB SATA HDD 24 Nos. each node, OS separate SSD disk.
Earlier I have tested orchestration using ceph-deploy in the test setup. now, is there any other alternative to ceph-deploy?
Can I restrict folder access to the user using cephfs + vfs samba or should I use ceph client + samba?
Ubuntu or Centos?
Any block size consideration for object size, metadata when using cephfs?
Idea or suggestion from existing users. I am also going to start to explore all the above.
regards Amudhan _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (6)
-
Amudhan P
-
Ashley Merrick
-
Dr. Marco Savoca
-
huxiaoyu＠horebdata.cn
-
jesper＠krogh.cc
-
Martin Verges