failed to authpin, subtree is being exported in 14.2.11
Hi all, We had a stuck mds ops this morning on a 14.2.11 cephfs cluster. I tried to ls the path from another client and that blocked. The ops were like this: # egrep 'desc|flag|age' ops.txt "description": "client_request(client.1212755100:37475 lookup #0x1003e229d38/analytics-logs 2020-09-03 04:30:45.607640 caller_uid=2004, caller_gid=2004{})", "age": 4975.7069706660004, "flag_point": "failed to authpin, subtree is being exported", "description": "client_request(client.1212755100:37477 lookup #0x1003e229d38/bundled-plugins 2020-09-03 04:31:01.064591 caller_uid=2004, caller_gid=2004{})", "age": 4960.2499044630003, "flag_point": "failed to authpin, subtree is being exported", ... The full list of stuck ops is at https://termbin.com/8itv We had only just yesterday enabled 2 active mds's on this cluster. I don't have much info about this client, other than that it has been running for several weeks successfully until we enabled the 2nd active mds. To clear out the slow ops we evicted client.1212755100, and then we reduced back to 1 active mds so it doesn't happen again. Any ideas what might have triggered this? Cheers, Dan
On 2020-09-03 09:21, Dan van der Ster wrote:
Any ideas what might have triggered this?
This looks like issue: https://tracker.ceph.com/issues/42338 Do you use snapshots on this fs? Gr. Stefan
On Thu, Sep 3, 2020 at 10:25 AM Stefan Kooman <stefan@bit.nl> wrote:
On 2020-09-03 09:21, Dan van der Ster wrote:
Any ideas what might have triggered this?
This looks like issue: https://tracker.ceph.com/issues/42338
Do you use snapshots on this fs?
We don't use snapshots, but *maybe* sometime long in the past... Do you know how to check if any single snapshot has ever been created? Thanks, Dan
Gr. Stefan
participants (2)
-
Dan van der Ster
-
Stefan Kooman