Hi everyone. On my cluster I got spam by my cluster with message like Mar 25 13:10:13 cthulhu2 ceph-mgr[2843]: mgr finish mon failed to return metadata for mds.cephfs.cthulhu2.dqahyt: (2) No such file or directory Mar 25 13:10:13 cthulhu2 ceph-mgr[2843]: mgr finish mon failed to return metadata for mds.cephfs.cthulhu3.xvboir: (2) No such file or directory Mar 25 13:10:13 cthulhu2 ceph-mgr[2843]: mgr finish mon failed to return metadata for mds.cephfs.cthulhu5.kwmyyg: (2) No such file or directory I got 5 server for the service (cthulhu 1->5) and indeed when from cthulhu1 (or 2) I try : something: root@cthulhu2:/etc/ceph# ceph mds metadata cephfs.cthulhu2.dqahyt {} Error ENOENT: root@cthulhu2: but that works on 1 or 4 root@cthulhu2:/etc/ceph# ceph mds metadata cephfs.cthulhu1.sikvjf { "addr": "[v2:145.238.187.184:6800/1315478297,v1:145.238.187.184:6801/1315478297]", "arch": "x86_64", "ceph_release": "quincy", "ceph_version": "ceph version 17.2.7 (b12291d110049b2f35e32e0de30d70e9a4c060d2) quincy (stable)", "ceph_version_short": "17.2.7", "container_hostname": "cthulhu1", "container_image": "quay.io/ceph/ceph@sha256:62465e744a80832bde6a57120d3ba076613e8a19884b274f9cc82580e249f6e1", "cpu": "Intel(R) Xeon(R) Silver 4310 CPU @ 2.10GHz", "distro": "centos", "distro_description": "CentOS Stream 8", "distro_version": "8", "hostname": "cthulhu1", "kernel_description": "#1 SMP Debian 5.10.209-2 (2024-01-31)", "kernel_version": "5.10.0-28-amd64", "mem_swap_kb": "16777212", "mem_total_kb": "263803496", "os": "Linux" } root@cthulhu2:/etc/ceph# I check the caps and don't see anything special. I got also (I don't know if it's related) those message : Mar 25 13:18:38 cthulhu2 ceph-mgr[2843]: mgr.server handle_open ignoring open from mds.cephfs.cthulhu2.dqahyt v2:145.238.187.185:6800/2763465960; not ready for session (expect reconnect) Mar 25 13:18:38 cthulhu2 ceph-mgr[2843]: mgr.server handle_open ignoring open from mds.cephfs.cthulhu3.xvboir v2:145.238.187.186:6800/1297104944; not ready for session (expect reconnect) Mar 25 13:18:38 cthulhu2 ceph-mgr[2843]: mgr.server handle_open ignoring open from mds.cephfs.cthulhu5.kwmyyg v2:145.238.187.188:6800/449122091; not ready for session (expect reconnect) Mar 25 13:18:39 cthulhu2 ceph-mgr[2843]: mgr.server handle_open ignoring open from mds.cephfs.cthulhu3.xvboir v2:145.238.187.186:6800/1297104944; not ready for session (expect reconnect) Mar 25 13:18:39 cthulhu2 ceph-mgr[2843]: mgr.server handle_open ignoring open from mds.cephfs.cthulhu2.dqahyt v2:145.238.187.185:6800/2763465960; not ready for session (expect reconnect) Mar 25 13:18:39 cthulhu2 ceph-mgr[2843]: mgr.server handle_open ignoring open from mds.cephfs.cthulhu5.kwmyyg v2:145.238.187.188:6800/449122091; not ready for session (expect reconnect) Regards. -- Albert SHIH 🦫 🐸 France Heure locale/Local time: lun. 25 mars 2024 13:08:33 CET