OSD v15.2.5 daemon not starting on Centos7
Hello, does anyone tried to update 15.2.4 on Centos7 to 15.2.5? I did a full: yum -y update on my first OSD node and after this no OSD on this want to start anymore. No log will be written, so osd process stops immediately i think. Starting osd daemon in forground shows that no tmpfs will be mountet under /var/lib/ceph/osd/ No kyering will be found! [root@ceph1n011 ~]# ceph-osd --id 10 2020-09-23T15:20:47.380+0200 7f1e0a018bc0 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-09-23T15:20:47.380+0200 7f1e0a018bc0 -1 AuthRegistry(0x560ee2ab8938) no keyring found at /var/lib/ceph/osd/ceph-10/keyring, disabling cephx 2020-09-23T15:20:47.382+0200 7f1e0a018bc0 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-09-23T15:20:47.382+0200 7f1e0a018bc0 -1 AuthRegistry(0x7ffe06f76400) no keyring found at /var/lib/ceph/osd/ceph-10/keyring, disabling cephx failed to fetch mon config (--no-mon-config to skip) I checked all systemd realated files and found no differences so far. This is quite strange and i look for some time to find the reason ..!? Other OSD on other (untouched) node shows this on startup.... [root@ceph1n012 ~]# ceph-osd --id 24 2020-09-23T15:15:23.514+0200 7f55ae95abc0 -1 Falling back to public interface 2020-09-23T15:15:43.143+0200 7f55ae95abc0 -1 osd.24 2154072 log_to_monitors {default=true} [root@ceph1n012 ~]# After some seconds osd process fork itself to background and works fine.... Does anybody have a clever hint for me? Best regards, Christoph -- Christoph Ackermann | System Engineer INFOSERVE GmbH | Am Felsbrunnen 15 | D-66119 Saarbrücken Fon +49 (0)681 88008-59 | Fax +49 (0)681 88008-33 | mailto:C.Ackermann@infoserve.de | https://www.infoserve.de INFOSERVE Datenschutzhinweise: https://infoserve.de/datenschutz Handelsregister: Amtsgericht Saarbrücken, HRB 11001 | Erfüllungsort: Saarbrücken Geschäftsführer: Dr. Stefan Leinenbach | Ust-IdNr.: DE168970599
Hello, it seems that ceph-volume-systemd makes this confusion by missing python3.6 stuff here: [root@ceph1n011 system]# /usr/sbin/ceph-volume-systemd Traceback (most recent call last): File "/usr/sbin/ceph-volume-systemd", line 6, in <module> from pkg_resources import load_entry_point File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 3095, in <module> @_call_aside File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 3079, in _call_aside f(*args, **kwargs) File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 3108, in _initialize_master_working_set working_set = WorkingSet._build_master() File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 570, in _build_master ws.require(__requires__) File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 888, in require needed = self.resolve(parse_requirements(requirements)) File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 774, in resolve raise DistributionNotFound(req, requirers) pkg_resources.DistributionNotFound: The 'six' distribution was not found and is required by ceph [root@ceph1n011 system]# Solution: yum -y install python36-six.noarch python36-PyYAML.x86_64 After this and reboot you should able to use ceph-osd v15.2.5 under Centos7 Best regards, Christoph Am 23.09.20 um 15:47 schrieb Christoph Ackermann:
Hello,
does anyone tried to update 15.2.4 on Centos7 to 15.2.5?
I did a full: yum -y update on my first OSD node and after this no OSD on this want to start anymore. No log will be written, so osd process stops immediately i think.
Starting osd daemon in forground shows that no tmpfs will be mountet under /var/lib/ceph/osd/ No kyering will be found!
[root@ceph1n011 ~]# ceph-osd --id 10 2020-09-23T15:20:47.380+0200 7f1e0a018bc0 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-09-23T15:20:47.380+0200 7f1e0a018bc0 -1 AuthRegistry(0x560ee2ab8938) no keyring found at /var/lib/ceph/osd/ceph-10/keyring, disabling cephx 2020-09-23T15:20:47.382+0200 7f1e0a018bc0 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-09-23T15:20:47.382+0200 7f1e0a018bc0 -1 AuthRegistry(0x7ffe06f76400) no keyring found at /var/lib/ceph/osd/ceph-10/keyring, disabling cephx failed to fetch mon config (--no-mon-config to skip)
I checked all systemd realated files and found no differences so far. This is quite strange and i look for some time to find the reason ..!?
Other OSD on other (untouched) node shows this on startup....
[root@ceph1n012 ~]# ceph-osd --id 24 2020-09-23T15:15:23.514+0200 7f55ae95abc0 -1 Falling back to public interface 2020-09-23T15:15:43.143+0200 7f55ae95abc0 -1 osd.24 2154072 log_to_monitors {default=true} [root@ceph1n012 ~]#
After some seconds osd process fork itself to background and works fine....
Does anybody have a clever hint for me?
Best regards,
Christoph
-- Christoph Ackermann | System Engineer INFOSERVE GmbH | Am Felsbrunnen 15 | D-66119 Saarbrücken Fon +49 (0)681 88008-59 | Fax +49 (0)681 88008-33 | C.Ackermann@infoserve.de <mailto:C.Ackermann@infoserve.de> | _www.infoserve.de_ <https://www.infoserve.de/> INFOSERVE Datenschutzhinweise: _www.infoserve.de/datenschutz_ <https://www.infoserve.de/datenschutz> Handelsregister: Amtsgericht Saarbrücken, HRB 11001 | Erfüllungsort: Saarbrücken Geschäftsführer: Dr. Stefan Leinenbach | Ust-IdNr.: DE168970599 INFOSERVE GmbH | Homepage <https://www.infoserve.de/> Facebook <https://www.facebook.com/infoserve.de> Xing <https://www.xing.com/companies/infoservegmbh> YouTube <https://www.youtube.com/channel/UCUj8C3TGGhQZPVvxu4woXmQ%20> LinkedIn <https://www.linkedin.com/company-beta/10095540>
participants (1)
-
Christoph Ackermann