Hi Boris, Yeah, this is the reason: -1> 2021-03-15T16:21:35.307+0100 7f8b1fd8d700 5 prioritycache tune_memory target: 4294967296<tel:4294967296>mapped: 454098944<tel:454098944> unmapped: 8560640<tel:8560640> heap: 462659584<tel:462659584> old mem: 2845415832<tel:2845415832> new mem: 2845415832<tel:2845415832> 0> 2021-03-15T16:21:35.311+0100 7f8b11570700 -1 *** Caught signal (Aborted) ** in thread 7f8b11570700 thread_name:tp_osd_tp On 2021. Mar 14., at 15:10, Boris Behrens <bb@kervyn.de> wrote: Email received from outside the company. If in doubt don't click links nor open attachments! ________________________________ Hi, do you know why the OSDs are not starting? When I had the problem that a start does not work, I tried the 'ceph-volume lvm activate --all' on the host, which brought the OSDs back up. But I can't tell you if it is safe to remove the OSD. Cheers Boris Am So., 14. März 2021 um 02:38 Uhr schrieb Szabo, Istvan (Agoda) <Istvan.Szabo@agoda.com<mailto:Istvan.Szabo@agoda.com>>: Hi Gents, There is a cluster with 14 hosts in this state: https://i.ibb.co/HPF3Pdr/6-ACB2-C5-B-6-B54-476-B-835-D-227-E9-BFB1247.jpg There is a host based crush rule ec 3:1 and there are 3 hosts where are osds down. Unfortunately there are pools with 3 replicas also which is host based. 2 hosts have 2 osds down,1 host has 1 osd down, which means I guess if we don’t bring it back, 0.441% data loss is going to happen. Am I right? I hope I’m not right because there isn’t any missplaced objects, only degraded. The problem is that the osds are not starting so somehow these 5 osds should be removed, but I’m curious which is my statement is correct. Thank you in advance. ________________________________ This message is confidential and is for the sole use of the intended recipient(s). It may also be privileged or otherwise protected by copyright or other legal rules. If you have received it by mistake please let us know by reply email and delete it from your system. It is prohibited to copy this message or disclose its content to anyone. Any confidentiality or privilege is not waived or lost by any mistaken delivery or unauthorized disclosure of the message. All messages sent to and from Agoda may be monitored to ensure compliance with company policies, to protect the company's interests and to remove potential malware. Electronic messages may be intercepted, amended, lost or deleted, or contain viruses. _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io<mailto:ceph-users@ceph.io> To unsubscribe send an email to ceph-users-leave@ceph.io<mailto:ceph-users-leave@ceph.io> -- Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groüen Saal.