Hi all, I have a Ceph Cluster using squid 19.2.2. I'm using CephFS storage with kernel mounts on clients and it works fine but for some older computers (still CentOS8 and one CentOS7 because it is running a commercial application) I need to use NFS so I've deployed Ganesha. But a few minutes after the first NFS client mount the volume (Just testing from the first client) and uses it, the Ceph NFS service falls in error on one node (not always the same node) and I have to reboot it. # ceph orch ps --daemon-type nfs NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID nfs.whitaker-nfs.0.2.whitaker04-ceph.itzyqf whitaker04-ceph *:12049 running (49m) 5m ago 3h 26.3M - 5.9 4892a7ef541b 42fd4ab7bba9 nfs.whitaker-nfs.1.0.whitaker05-ceph.vocxmr whitaker05-ceph *:12049 running (63m) 5m ago 23h 85.7M - 5.9 4892a7ef541b ab1c06be2ce7 nfs.whitaker-nfs.2.0.whitaker01-ceph.rhwuth whitaker01-ceph *:12049 running (33m) 5m ago 23h 24.6M - 5.9 4892a7ef541b eb93963f05cd nfs.whitaker-nfs.3.0.whitaker03-ceph.wqfnnq whitaker03-ceph *:12049 error 5m ago 23h - - <unknown> <unknown> <unknown> nfs.whitaker-nfs.4.0.whitaker02-ceph.wjynvn whitaker02-ceph *:12049 running (49m) 4m ago 3h 28.3M - 5.9 4892a7ef541b 5cb71f9d8b89 and the client freeze on the mount point. Any idea about this or how to track the problem ? Thanks Patrick ---------------------------------------------- Details of my NFS CEPH cluster, building commands and status: ---------------------------------------------- # *ceph nfs cluster create whitaker-nfs \ whitaker01-ceph,whitaker02-ceph,whitaker03-ceph,whitaker04-ceph,whitaker05-ceph \ --ingress --virtual_ip 172.30.1.102/24 --ingress-mode haproxy-protocol* *# ceph nfs cluster info whitaker-nfs* { "whitaker-nfs": { "backend": [ { "hostname": "whitaker01-ceph", "ip": "172.30.1.97", "port": 12049 }, { "hostname": "whitaker02-ceph", "ip": "172.30.1.98", "port": 12049 }, { "hostname": "whitaker03-ceph", "ip": "172.30.1.99", "port": 12049 }, { "hostname": "whitaker04-ceph", "ip": "172.30.1.100", "port": 12049 }, { "hostname": "whitaker05-ceph", "ip": "172.30.1.101", "port": 12049 } ], "monitor_port": 9049, "port": 2049, "virtual_ip": "172.30.1.102" } } *# ceph nfs export create cephfs \ --cluster-id whitaker-nfs \ --pseudo-path /data \ --fsname data \ --client_addr 172.30.1.0/24* *# ceph nfs export ls whitaker-nfs --detailed* [ { "access_type": "none", "clients": [ { "access_type": "rw", "addresses": [ "172.30.1.0/24" ], "squash": "none" } ], "cluster_id": "whitaker-nfs", "export_id": 1, "fsal": { "cmount_path": "/", "fs_name": "data", "name": "CEPH", "user_id": "nfs.whitaker-nfs.data.79da3503" }, "path": "/", "protocols": [ 4 ], "pseudo": "/data", "security_label": true, "squash": "none", "transports": [ "TCP" ] } ]