Yes, I agree with Anthony. If your cluster is healthy and you don't *need* to bring them back in it's going to be less work and time to just deploy them as new. I usually set norebalance, purge the osds in ceph, remove the vg from the disks and re-deploy. Then unset norebalance at the end once everything is peered and happy. This is so that it doesn't start moving stuff around when you purge. Rich On Thu, 7 Sept 2023 at 02:21, Anthony D'Atri <anthony.datri@gmail.com> wrote:
Resurrection usually only makes sense if fate or a certain someone resulted in enough overlapping removed OSDs that you can't meet min_size. I've had to a couple of times :-/
If an OSD is down for more than a short while, backfilling a redeployed OSD will likely be faster than waiting for it to peer and do deltas -- if it can at all.
On Sep 6, 2023, at 10:16, Malte Stroem <malte.stroem@gmail.com> wrote:
Hi ceph-mail@rikdvk.mailer.me,
you could squeeze the OSDs back in but it does not make sense.
Just clean the disks with dd for example and add them as new disks to your cluster.
Best, Malte
Am 04.09.23 um 09:39 schrieb ceph-mail@rikdvk.mailer.me:
Hello, I have a ten node cluster with about 150 OSDs. One node went down a while back, several months. The OSDs on the node have been marked as down and out since. I am now in the position to return the node to the cluster, with all the OS and OSD disks. When I boot up the now working node, the OSDs do not start. Essentially , it seems to complain with "fail[ing]to load OSD map for [various epoch]s, got 0 bytes". I'm guessing the OSDs on disk maps are so old, they can't get back into the cluster? My questions are whether it's possible or worth it to try to squeeze these OSDs back in or to just replace them. And if I should just replace them, what's the best way? Manually remove [1] and recreate? Replace [2]? Purge in dashboard? [1] https://docs.ceph.com/en/quincy/rados/operations/add-or-rm-osds/#removing-os... [2] https://docs.ceph.com/en/quincy/rados/operations/add-or-rm-osds/#replacing-a... Many thanks! _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io