On 12/15/22 15:31, Stolte, Felix wrote:
Hi Patrick,
we used your script to repair the damaged objects on the weekend and it went smoothly. Thanks for your support.
We adjusted your script to scan for damaged files on a daily basis, runtime is about 6h. Until thursday last week, we had exactly the same 17 Files. On thursday at 13:05 a snapshot was created and our active mds crashed once at this time (snapshot was created):
Are you willing to share this script? I would like to use it to scan our CephFS before upgrading to 16.2.13. Do you run this script when the filesystem is online / active? Thanks, Gr. Stefan
On Mon, May 15, 2023 at 8:55 AM Stefan Kooman <stefan@bit.nl> wrote:
On 12/15/22 15:31, Stolte, Felix wrote:
Hi Patrick,
we used your script to repair the damaged objects on the weekend and it went smoothly. Thanks for your support.
We adjusted your script to scan for damaged files on a daily basis, runtime is about 6h. Until thursday last week, we had exactly the same 17 Files. On thursday at 13:05 a snapshot was created and our active mds crashed once at this time (snapshot was created):
Are you willing to share this script? I would like to use it to scan our CephFS before upgrading to 16.2.13. Do you run this script when the filesystem is online / active?
The original script is here: https://github.com/ceph/ceph/blob/main/src/tools/cephfs/first-damage.py -- Patrick Donnelly, Ph.D. He / Him / His Red Hat Partner Engineer IBM, Inc. GPG: 19F28A586F808C2402351B93C3301A3E258DD79D
On 5/22/23 20:24, Patrick Donnelly wrote:
The original script is here: https://github.com/ceph/ceph/blob/main/src/tools/cephfs/first-damage.py
"# Suggested recovery sequence (for single MDS cluster): # # 1) Unmount all clients." Is this a hard requirement? This might not be feasible for an MDS with > 1K sessions, where not all mounts are in control of the Ceph operator. Would it also suffice to blocklist these clients? Gr. Stefan
On Wed, May 24, 2023 at 4:26 AM Stefan Kooman <stefan@bit.nl> wrote:
On 5/22/23 20:24, Patrick Donnelly wrote:
The original script is here: https://github.com/ceph/ceph/blob/main/src/tools/cephfs/first-damage.py
"# Suggested recovery sequence (for single MDS cluster): # # 1) Unmount all clients."
Is this a hard requirement? This might not be feasible for an MDS with > 1K sessions, where not all mounts are in control of the Ceph operator. Would it also suffice to blocklist these clients?
Only for repair. You could run the script to just do a read-only scan. -- Patrick Donnelly, Ph.D. He / Him / His Red Hat Partner Engineer IBM, Inc. GPG: 19F28A586F808C2402351B93C3301A3E258DD79D
participants (2)
-
Patrick Donnelly
-
Stefan Kooman