Small issue with perms
Hi everyone. After my upgrade from 17.2.7 to 18.2.2 I notice after each time I restart I got a issue with perm on /var/lib/ceph/FSID/crash after the restart the owner/group are on nobody and I got Error scraping /var/lib/ceph/crash: [Errno 13] Permission denied: '/var/lib/ceph/crash' I need to do a chown ceph:ceph on the directory. But on the next reboot the dir return to nobody. Anyway to fix (beside some cron + chown) this minor bug ? Regards -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 18 juil. 2024 09:53:40 CEST
Hi Albert, perhaps a conflict with the udev rules of locally installed packages. Try uninstalling ceph-* Le jeu. 18 juil. 2024 à 09:57, Albert Shih <Albert.Shih@obspm.fr> a écrit :
Hi everyone.
After my upgrade from 17.2.7 to 18.2.2 I notice after each time I restart I got a issue with perm on
/var/lib/ceph/FSID/crash
after the restart the owner/group are on nobody and I got
Error scraping /var/lib/ceph/crash: [Errno 13] Permission denied: '/var/lib/ceph/crash'
I need to do a chown ceph:ceph on the directory. But on the next reboot the dir return to nobody.
Anyway to fix (beside some cron + chown) this minor bug ?
Regards
-- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 18 juil. 2024 09:53:40 CEST _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Le 18/07/2024 à 10:27:09+0200, David C. a écrit Hi,
perhaps a conflict with the udev rules of locally installed packages.
Try uninstalling ceph-*
Sorry...not sure I understand....you want me to uninstall ceph ? Regards. JAS -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 18 juil. 2024 10:33:54 CEST
Your ceph processes are in containers. You don't need the ceph-* packages on the host hosting the containers ________________________________________________________ Cordialement, *David CASIER* *Ligne directe: +33(0) 9 72 61 98 29* ________________________________________________________ Le jeu. 18 juil. 2024 à 10:34, Albert Shih <Albert.Shih@obspm.fr> a écrit :
Le 18/07/2024 à 10:27:09+0200, David C. a écrit Hi,
perhaps a conflict with the udev rules of locally installed packages.
Try uninstalling ceph-*
Sorry...not sure I understand....you want me to uninstall ceph ?
Regards.
JAS -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 18 juil. 2024 10:33:54 CEST
Le 18/07/2024 à 10:56:33+0200, David C. a écrit Hi,
Your ceph processes are in containers.
Yes I know but in my install process I just install ceph-common ceph-base then cephadm from with the wget. I didn't install manually the other packages like : ii ceph-fuse 18.2.2-1~bpo12+1 amd64 FUSE-based client for the Ceph distributed file system ii ceph-mds 18.2.2-1~bpo12+1 amd64 metadata server for the ceph distributed file system ii ceph-mgr 18.2.2-1~bpo12+1 amd64 manager for the ceph distributed storage system ii ceph-mgr-cephadm 18.2.2-1~bpo12+1 all cephadm orchestrator module for ceph-mgr ii ceph-mgr-dashboard 18.2.2-1~bpo12+1 all dashboard module for ceph-mgr ii ceph-mgr-diskprediction-local 18.2.2-1~bpo12+1 all diskprediction-local module for ceph-mgr ii ceph-mgr-k8sevents 18.2.2-1~bpo12+1 all kubernetes events module for ceph-mgr ii ceph-mgr-modules-core 18.2.2-1~bpo12+1 all ceph manager modules which are always enabled ii ceph-mon 18.2.2-1~bpo12+1 amd64 monitor server for the ceph storage system ii ceph-osd 18.2.2-1~bpo12+1 amd64 OSD server for the ceph storage system ii ceph-volume 18.2.2-1~bpo12+1 all tool to facilidate OSD deploymentYou don't need the ceph-* packages on the host hosting the containers I've no idea how they end-up installed, you mean I can securely uninstall all of them on all my node ? Regards. -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 18 juil. 2024 10:58:30 CEST
Le 18/07/2024 à 11:00:56+0200, Albert Shih a écrit
Le 18/07/2024 à 10:56:33+0200, David C. a écrit
Hi,
Your ceph processes are in containers.
Yes I know but in my install process I just install
ceph-common ceph-base
then cephadm from with the wget.
I didn't install manually the other packages like :
ii ceph-fuse 18.2.2-1~bpo12+1 amd64 FUSE-based client for the Ceph distributed file system ii ceph-mds 18.2.2-1~bpo12+1 amd64 metadata server for the ceph distributed file system ii ceph-mgr 18.2.2-1~bpo12+1 amd64 manager for the ceph distributed storage system ii ceph-mgr-cephadm 18.2.2-1~bpo12+1 all cephadm orchestrator module for ceph-mgr ii ceph-mgr-dashboard 18.2.2-1~bpo12+1 all dashboard module for ceph-mgr ii ceph-mgr-diskprediction-local 18.2.2-1~bpo12+1 all diskprediction-local module for ceph-mgr ii ceph-mgr-k8sevents 18.2.2-1~bpo12+1 all kubernetes events module for ceph-mgr ii ceph-mgr-modules-core 18.2.2-1~bpo12+1 all ceph manager modules which are always enabled ii ceph-mon 18.2.2-1~bpo12+1 amd64 monitor server for the ceph storage system ii ceph-osd 18.2.2-1~bpo12+1 amd64 OSD server for the ceph storage system ii ceph-volume 18.2.2-1~bpo12+1 all tool to facilidate OSD deploymentYou don't need the ceph-* packages on the host hosting the containers
I've no idea how they end-up installed, you mean I can securely uninstall all of them on all my node ?
I also got a package called ceph should I also uninstalled it ? Regards. JAS -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 18 juil. 2024 11:08:07 CEST
you can test on a host and restart it, to validate that everything is fine (with ceph orch host maintenance enter <host> [or noout]). But yes, you should be able to do it without breaking anything. Le jeu. 18 juil. 2024 à 11:08, Albert Shih <Albert.Shih@obspm.fr> a écrit :
Le 18/07/2024 à 11:00:56+0200, Albert Shih a écrit
Le 18/07/2024 à 10:56:33+0200, David C. a écrit
Hi,
Your ceph processes are in containers.
Yes I know but in my install process I just install
ceph-common ceph-base
then cephadm from with the wget.
I didn't install manually the other packages like :
ii ceph-fuse 18.2.2-1~bpo12+1
amd64 FUSE-based client for the Ceph distributed file system
ii ceph-mds 18.2.2-1~bpo12+1 amd64 metadata server for the ceph distributed file system ii ceph-mgr 18.2.2-1~bpo12+1 amd64 manager for the ceph distributed storage system ii ceph-mgr-cephadm 18.2.2-1~bpo12+1 all cephadm orchestrator module for ceph-mgr ii ceph-mgr-dashboard 18.2.2-1~bpo12+1 all dashboard module for ceph-mgr ii ceph-mgr-diskprediction-local 18.2.2-1~bpo12+1 all diskprediction-local module for ceph-mgr ii ceph-mgr-k8sevents 18.2.2-1~bpo12+1 all kubernetes events module for ceph-mgr ii ceph-mgr-modules-core 18.2.2-1~bpo12+1 all ceph manager modules which are always enabled ii ceph-mon 18.2.2-1~bpo12+1 amd64 monitor server for the ceph storage system ii ceph-osd 18.2.2-1~bpo12+1 amd64 OSD server for the ceph storage system ii ceph-volume 18.2.2-1~bpo12+1 all tool to facilidate OSD deploymentYou don't need the ceph-* packages on the host hosting the containers
I've no idea how they end-up installed, you mean I can securely uninstall all of them on all my node ?
I also got a package called
ceph
should I also uninstalled it ?
Regards.
JAS -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 18 juil. 2024 11:08:07 CEST
Le 18/07/2024 à 11:33:35+0200, David C. a écrit
you can test on a host and restart it, to validate that everything is fine (with ceph orch host maintenance enter <host> [or noout]).
But yes, you should be able to do it without breaking anything.
So just for those who got the same question as me. Indeed everything work with just root@cthulhu1:~# dpkg -l|grep ceph ii ceph-base 18.2.2-1~bpo12+1 amd64 common ceph daemon libraries and management tools ii ceph-common 18.2.2-1~bpo12+1 amd64 common utilities to mount and interact with a ceph storage cluster ii libcephfs2 18.2.2-1~bpo12+1 amd64 Ceph distributed file system client library ii python3-ceph 18.2.2-1~bpo12+1 amd64 Meta-package for python libraries for the Ceph libraries ii python3-ceph-argparse 18.2.2-1~bpo12+1 all Python 3 utility libraries for Ceph CLI ii python3-ceph-common 18.2.2-1~bpo12+1 all Python 3 utility libraries for Ceph ii python3-cephfs 18.2.2-1~bpo12+1 amd64 Python 3 libraries for the Ceph libcephfs library root@cthulhu1:~# Thanks !!! Regards. -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 18 juil. 2024 19:23:24 CEST
On 18.07.24 9:56 AM, Albert Shih wrote:
Error scraping /var/lib/ceph/crash: [Errno 13] Permission denied: '/var/lib/ceph/crash' There is / was a bug with the permissions for ceph-crash, see
* https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/VACLBNVXTYNS... * https://tracker.ceph.com/issues/64548 * Reef backport (NOT merged yet): https://github.com/ceph/ceph/pull/58458 Maybe your issue is somewhat related? Regards Christian
Thanks Christian, I see the fix is on the postinst, so probably the reboot shouldn't put "nobody" back, right? Le jeu. 18 juil. 2024 à 11:44, Christian Rohmann < christian.rohmann@inovex.de> a écrit :
On 18.07.24 9:56 AM, Albert Shih wrote:
Error scraping /var/lib/ceph/crash: [Errno 13] Permission denied: '/var/lib/ceph/crash' There is / was a bug with the permissions for ceph-crash, see
*
https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/VACLBNVXTYNS... * https://tracker.ceph.com/issues/64548 * Reef backport (NOT merged yet): https://github.com/ceph/ceph/pull/58458
Maybe your issue is somewhat related?
Regards
Christian
participants (3)
-
Albert Shih
-
Christian Rohmann
-
David C.