ceph mon failed to start
Hi, Our cluster got an unexpected power outage. Ceph mon cannot start after that. The log shows: Running command: '/usr/bin/ceph-mon -f -i 10.10.198.11 --public-addr 10.10.198.11:6789' Corruption: 15 missing files; e.g.: /var/lib/ceph/mon/ceph-10.10.198.11/store.db/2676107.sst Is there any way to fix this problem? Thank you very much! We are running ceph 10.2.10. Br, Xu Yun
Try this https://docs.ceph.com/docs/mimic/man/8/ceph-kvstore-tool/ and use the 'repair' operation 徐蕴 <yunxu@me.com> 于2019年10月22日周二 下午3:51写道：
Hi,
Our cluster got an unexpected power outage. Ceph mon cannot start after that. The log shows:
Running command: '/usr/bin/ceph-mon -f -i 10.10.198.11 --public-addr 10.10.198.11:6789' Corruption: 15 missing files; e.g.: /var/lib/ceph/mon/ceph-10.10.198.11/store.db/2676107.sst
Is there any way to fix this problem? Thank you very much!
We are running ceph 10.2.10.
Br, Xu Yun _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
It seems that ceph-kvstore-tool is not available in 10.2.10/Jewel.
2019年10月22日 下午5:28，huang jun <hjwsm1989@gmail.com> 写道：
Try this https://docs.ceph.com/docs/mimic/man/8/ceph-kvstore-tool/ and use the 'repair' operation
徐蕴 <yunxu@me.com> 于2019年10月22日周二 下午3:51写道：
Hi,
Our cluster got an unexpected power outage. Ceph mon cannot start after that. The log shows:
Running command: '/usr/bin/ceph-mon -f -i 10.10.198.11 --public-addr 10.10.198.11:6789' Corruption: 15 missing files; e.g.: /var/lib/ceph/mon/ceph-10.10.198.11/store.db/2676107.sst
Is there any way to fix this problem? Thank you very much!
We are running ceph 10.2.10.
Br, Xu Yun _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
I followed the instruction from https://docs.ceph.com/docs/jewel/rados/troubleshooting/troubleshooting-mon/#..., but mon can’t still go up. The log shows: 2019-10-22 19:20:17.096346 7f1e0e9de680 0 ceph version 10.2.10 (5dc1e4c05cb68dbf62ae6fce3f0700e4654fdbbe), process ceph-mon, pid 6 2019-10-22 19:20:17.096425 7f1e0e9de680 0 pidfile_write: ignore empty --pid-file 2019-10-22 19:20:17.137493 7f1e0e9de680 1 leveldb: Recovering log #29 2019-10-22 19:20:17.138536 7f1e0e9de680 1 leveldb: Delete type=0 #29 2019-10-22 19:20:17.138608 7f1e0e9de680 1 leveldb: Delete type=3 #28 2019-10-22 19:20:17.139452 7f1e0e9de680 -1 unable to read magic from mon data Any suggestion?
2019年10月22日 下午6:03，徐蕴 <yunxu@me.com> 写道：
It seems that ceph-kvstore-tool is not available in 10.2.10/Jewel.
2019年10月22日 下午5:28，huang jun <hjwsm1989@gmail.com> 写道：
Try this https://docs.ceph.com/docs/mimic/man/8/ceph-kvstore-tool/ and use the 'repair' operation
徐蕴 <yunxu@me.com> 于2019年10月22日周二 下午3:51写道：
Hi,
Our cluster got an unexpected power outage. Ceph mon cannot start after that. The log shows:
Running command: '/usr/bin/ceph-mon -f -i 10.10.198.11 --public-addr 10.10.198.11:6789' Corruption: 15 missing files; e.g.: /var/lib/ceph/mon/ceph-10.10.198.11/store.db/2676107.sst
Is there any way to fix this problem? Thank you very much!
We are running ceph 10.2.10.
Br, Xu Yun _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (2)
-
huang jun
-
徐蕴