stretch mode item not defined
hi there, need some help please. we are planning to replace our rbd-mirror setup and go to stretch mode. the goal is, to have the cluster in 2 fire compartment server rooms. start was a default proxmox/ceph setup. now, i followed the howto from: https://docs.ceph.com/en/latest/rados/operations/stretch-mode/ with the crushmap i ended in an error: in rule 'stretch_rule' item 'dc1' not defined (dc1,2,3 is like site1,2,3 in the docu). my osd tree looks like pve-test02-01:~# ceph osd tree ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 3.80951 root default -15 0.06349 host pve-test01-01 0 ssd 0.06349 osd.0 up 1.00000 1.00000 -19 0.06349 host pve-test01-02 1 ssd 0.06349 osd.1 up 1.00000 1.00000 -17 0.06349 host pve-test01-03 2 ssd 0.06349 osd.2 up 1.00000 1.00000 ... i think there is something missing. should i need adding the buckets manually? ... for disaster failover, any ideas are welcome. man thanks for help and kind regards, ronny
Yes, you will need to create datacenter buckets and move your host buckets under them.
On Mar 26, 2024, at 09:18, ronny.lippold <ceph@spark5.de> wrote:
hi there, need some help please.
we are planning to replace our rbd-mirror setup and go to stretch mode. the goal is, to have the cluster in 2 fire compartment server rooms.
start was a default proxmox/ceph setup. now, i followed the howto from: https://docs.ceph.com/en/latest/rados/operations/stretch-mode/
with the crushmap i ended in an error: in rule 'stretch_rule' item 'dc1' not defined (dc1,2,3 is like site1,2,3 in the docu).
my osd tree looks like pve-test02-01:~# ceph osd tree ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 3.80951 root default -15 0.06349 host pve-test01-01 0 ssd 0.06349 osd.0 up 1.00000 1.00000 -19 0.06349 host pve-test01-02 1 ssd 0.06349 osd.1 up 1.00000 1.00000 -17 0.06349 host pve-test01-03 2 ssd 0.06349 osd.2 up 1.00000 1.00000 ...
i think there is something missing. should i need adding the buckets manually? ...
for disaster failover, any ideas are welcome.
man thanks for help and kind regards, ronny _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
hi anthony ... many thanks for that. i did not understood, why the docu missed that part ... anyway i checked the login and the mail adress ceph@spark5.de should be right :/ one last question ... we have to server rooms. do you think, strecht mode is the right way? do you have any other ideas about disaster recovery? many thanks ... ronny Am 2024-03-26 15:14, schrieb Anthony D'Atri:
Yes, you will need to create datacenter buckets and move your host buckets under them.
On Mar 26, 2024, at 09:18, ronny.lippold <ceph@spark5.de> wrote:
hi there, need some help please.
we are planning to replace our rbd-mirror setup and go to stretch mode. the goal is, to have the cluster in 2 fire compartment server rooms.
start was a default proxmox/ceph setup. now, i followed the howto from: https://docs.ceph.com/en/latest/rados/operations/stretch-mode/
with the crushmap i ended in an error: in rule 'stretch_rule' item 'dc1' not defined (dc1,2,3 is like site1,2,3 in the docu).
my osd tree looks like pve-test02-01:~# ceph osd tree ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 3.80951 root default -15 0.06349 host pve-test01-01 0 ssd 0.06349 osd.0 up 1.00000 1.00000 -19 0.06349 host pve-test01-02 1 ssd 0.06349 osd.1 up 1.00000 1.00000 -17 0.06349 host pve-test01-03 2 ssd 0.06349 osd.2 up 1.00000 1.00000 ...
i think there is something missing. should i need adding the buckets manually? ...
for disaster failover, any ideas are welcome.
man thanks for help and kind regards, ronny _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (2)
-
Anthony D'Atri
-
ronny.lippold