Hi, is your cluster managed by cephadm? Because you refer to the manual procedure in the docs, but they are probably referring to pre-cephadm times when you had to use ceph-volume directly. If your cluster is managed by cephadm I wouldn't intervene manually when the orchestrator can help with these tasks. See [2] for more details. [2] https://docs.ceph.com/en/reef/cephadm/services/osd/#remove-an-osd Zitat von duluxoz <duluxoz@gmail.com>:
Hi All,
I'm trying to replace an OSD in our cluster.
This is on Reef 18.2.2 on Rocky 9.4.
I performed the following steps (from this page of the Ceph Doco: https://docs.ceph.com/en/reef/rados/operations/add-or-rm-osds/):
1. Make sure that it is safe to destroy the OSD: `while!cephosdsafe-to-destroyosd.{id};dosleep10;done` 2. Destroy the OSD: `cephosddestroy0--yes-i-really-mean-it` 3. Replaced the HDD 4. Prepare the disk for replacement by using the ID of the OSD that was destroyed in previous steps: `ceph-volumelvmprepare--osd-id0--data/dev/sd3`
However, at this point I get the following errors:
~~~
Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring osd tree -f json stderr: 2024-08-02T13:52:58.812+1000 7ff26e904640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory stderr: 2024-08-02T13:52:58.812+1000 7ff26e904640 -1 AuthRegistry(0x7ff268063e88) no keyring found at /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx stderr: 2024-08-02T13:52:58.817+1000 7ff26e904640 -1 auth: unable to find a keyring on /var/lib/ceph/bootstrap-osd/ceph.keyring: (2) No such file or directory stderr: 2024-08-02T13:52:58.817+1000 7ff26e904640 -1 AuthRegistry(0x7ff268063e88) no keyring found at /var/lib/ceph/bootstrap-osd/ceph.keyring, disabling cephx stderr: 2024-08-02T13:52:58.819+1000 7ff26e904640 -1 auth: unable to find a keyring on /var/lib/ceph/bootstrap-osd/ceph.keyring: (2) No such file or directory stderr: 2024-08-02T13:52:58.819+1000 7ff26e904640 -1 AuthRegistry(0x7ff268065b00) no keyring found at /var/lib/ceph/bootstrap-osd/ceph.keyring, disabling cephx stderr: 2024-08-02T13:52:58.821+1000 7ff26e904640 -1 auth: unable to find a keyring on /var/lib/ceph/bootstrap-osd/ceph.keyring: (2) No such file or directory stderr: 2024-08-02T13:52:58.821+1000 7ff26e904640 -1 AuthRegistry(0x7ff26e9030c0) no keyring found at /var/lib/ceph/bootstrap-osd/ceph.keyring, disabling cephx stderr: [errno 2] RADOS object not found (error connecting to the cluster) --> RuntimeError: Unable check if OSD id exists: 0
~~~
I can see a `client.bootstap-osd` user in the Ceph Dashboard Ceph User List, so I'm not sure what's going on.
Any help is greatly appreciated - thanks. _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io