Hi and thanks, Maybe I was not able to express myself correctly. I have 3 nodes, and I will be using 3 replicas for the data, which will be VMs disks. *Each node has** 04 disks* : - 03 nvme disks of 3.8Tb - and 01 nvme disk of 7.6Tb All three nodes are equivalent. As mentioned above, one pool will suffice me for my VMs, my question is : - Should I create two pools, the first one over the 3.8Tb disks (it will use 9 disks with replicas 3) and the second pool over the 7.6Tb disks (it will use 03 disks with replicas 3). - Or, should I create one big pool and use all the 12 disks, mixing them, despite the difference in size? Regards. <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> Sans virus.www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> Le mar. 4 juil. 2023 à 15:32, Anthony D'Atri <anthony.datri@gmail.com> a écrit :
There aren’t enough drives to split into multiple pools.
Deploy 1 OSD on each of the 3.8T devices and 2 OSDs on each of the 7.6s.
Or, alternately, 2 and 4.
On Jul 4, 2023, at 3:44 AM, Eneko Lacunza <elacunza@binovo.es> wrote:
Hi,
El 3/7/23 a las 17:27, wodel youchi escribió:
I will be deploying a Proxmox HCI cluster with 3 nodes. Each node has 3 nvme disks of 3.8Tb each and a 4th nvme disk of 7.6Tb. Technically I need one pool.
Is it good practice to use all disks to create the one pool I need, or is it better to create two pools, one on each group of disks?
If the former is good (use all disks and create one pool), should I take into account the difference in disk size?
What space use % do you expect? If you mix all disks in the same pool, if a 7.6TB disk fails that node's other disks will get full if use is near 60%, halting writes.
With 2 pools, that would be "near 66%" for the 3.8T pool and no limit for 7.6TB (but in that case you'll only have 2 replicas with a disk failure).
Another option would be 4 pools, in that case if a disk in any pool fails your VMs on that pool will continue working with only 2 replicas.
For the "near" calculus, you must factor in nearfull and full ratios for OSDs, and also that data may be unevenly distributed among OSDs...
The choice also will affect how well the aggregated IOPS will be spread between VMs<->disks.
Cheers
Eneko Lacunza Zuzendari teknikoa | Director técnico Binovo IT Human Project
Tel. +34 943 569 206 | https://www.binovo.es Astigarragako Bidea, 2 - 2º izda. Oficina 10-11, 20180 Oiartzun
https://www.youtube.com/user/CANALBINOVO https://www.linkedin.com/company/37269706/ _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io