Hi Alex, Thank you very much, yes it was a time sync issue after fixing time sync OSD service started. regards, Amudhan On Sat, Nov 4, 2023 at 9:07 PM Alex Gorbachev <ag@iss-integration.com> wrote:
Hi Amudhan,
Have you checked the time sync? This could be an issue:
https://tracker.ceph.com/issues/17170 -- Alex Gorbachev Intelligent Systems Services Inc. http://www.iss-integration.com https://www.linkedin.com/in/alex-gorbachev-iss/
On Sat, Nov 4, 2023 at 11:22 AM Amudhan P <amudhan83@gmail.com> wrote:
Hi,
One of the server in Ceph cluster accidentally shutdown abruptly due to power failure. After restarting OSD's not coming up and in Ceph health check it shows osd down. When checking OSD status "osd.26 18865 unable to obtain rotating service keys; retrying" For every 30 seconds it's just putting a message and it's all the same in all OSD in the system.
Nov 04 20:03:05 strg-node-03 bash[34287]: debug 2023-11-04T14:33:05.089+0000 7f1f5693c080 -1 osd.26 18865 unable to obtain rotating service keys; retrying Nov 04 20:03:35 strg-node-03 bash[34287]: debug 2023-11-04T14:33:35.090+0000 7f1f5693c080 -1 osd.26 18865 unable to obtain rotating service keys; retrying
ceph version 16.2.7 (dd0603118f56ab514f133c8d2e3adfc983942503) pacific (stable) on Debian 11 bullseye and cephadm based installation.
Tried to search for errors and msg couldn't find anything useful.
How do I fix this issue ?
regards, Amudhan _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io