squid 19.2.3 - cephfs missing path
Hi, I have a cephfs subvolume ( out of 4) with " mount path missing " issue I think a user deleted it as it look different than regular data to him/her I am mounting at the group level so all subgroups are available under same path How concerned should I be ? Is there a way to recreate path on a cephfs subvolume ? what are my options for fixing it ? Please find below details Mounting /volumes/projects /projects/cephfs Cephfs status ceph fs status project_ec_ssd project_ec_ssd - 139 clients ============== RANK STATE MDS ACTIVITY DNS INOS DIRS CAPS 0 active project_ec_ssd.ceph-host-5.henbit Reqs: 0 /s 6198k 6054k 1645k 107k 1 active project_ec_ssd.ceph-host-7.emayje Reqs: 0 /s 194 197 340 629 2 active project_ec_ssd.ceph-host-3.qebqlz Reqs: 0 /s 192 196 339 644 3 active project_ec_ssd.ceph-host-1.bwtdlt Reqs: 0 /s 196 199 338 729 4 active project_ec_ssd.ceph-host-4.xsoerf Reqs: 0 /s 196 200 339 93 POOL TYPE USED AVAIL metadata_fs_ssd metadata 18.0G 92.8T ssd_ec_project data 183T 241T ceph fs subvolumegroup ls project_ec_ssd [ { "name": "projects" } ] ceph fs subvolume ls project_ec_ssd --group_name projects [ { "name": "systems_archive" }, { "name": "arescore_moved" }, { "name": "alphacore_moved" }, { "name": "schematics" } ] ceph fs subvolume getpath project_ec_ssd alphacore_moved --group_name projects Error ENOENT: mount path missing for subvolume 'alphacore_moved' ceph fs subvolume getpath project_ec_ssd arescore_moved --group_name projects /volumes/projects/arescore_moved/ff576e35-2363-4e25-aa7a-e4a81693ab20 Many thanks Steven
Hi, could you add more details what exactly happened? I tried to reproduce by simply removing the entire directory within a subvolume group, but I still see the getpath output. Obviously, I'm doing something differently here. Thanks, Eugen Zitat von Steven Vacaroaia <stef97@gmail.com>:
Hi,
I have a cephfs subvolume ( out of 4) with " mount path missing " issue I think a user deleted it as it look different than regular data to him/her
I am mounting at the group level so all subgroups are available under same path
How concerned should I be ? Is there a way to recreate path on a cephfs subvolume ? what are my options for fixing it ?
Please find below details
Mounting /volumes/projects /projects/cephfs
Cephfs status ceph fs status project_ec_ssd project_ec_ssd - 139 clients ============== RANK STATE MDS ACTIVITY DNS INOS DIRS CAPS 0 active project_ec_ssd.ceph-host-5.henbit Reqs: 0 /s 6198k 6054k 1645k 107k 1 active project_ec_ssd.ceph-host-7.emayje Reqs: 0 /s 194 197 340 629 2 active project_ec_ssd.ceph-host-3.qebqlz Reqs: 0 /s 192 196 339 644 3 active project_ec_ssd.ceph-host-1.bwtdlt Reqs: 0 /s 196 199 338 729 4 active project_ec_ssd.ceph-host-4.xsoerf Reqs: 0 /s 196 200 339 93 POOL TYPE USED AVAIL metadata_fs_ssd metadata 18.0G 92.8T ssd_ec_project data 183T 241T
ceph fs subvolumegroup ls project_ec_ssd [ { "name": "projects" } ]
ceph fs subvolume ls project_ec_ssd --group_name projects [ { "name": "systems_archive" }, { "name": "arescore_moved" }, { "name": "alphacore_moved" }, { "name": "schematics" } ]
ceph fs subvolume getpath project_ec_ssd alphacore_moved --group_name projects Error ENOENT: mount path missing for subvolume 'alphacore_moved'
ceph fs subvolume getpath project_ec_ssd arescore_moved --group_name projects /volumes/projects/arescore_moved/ff576e35-2363-4e25-aa7a-e4a81693ab20
Many thanks Steven _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hi Eugen, On Wed, Oct 29, 2025 at 4:29 PM Eugen Block <eblock@nde.ag> wrote:
Hi,
could you add more details what exactly happened? I tried to reproduce by simply removing the entire directory within a subvolume group, but I still see the getpath output. Obviously, I'm doing something differently here.
The path is taken from the subvolume metadata file. If you remove that, you would see something similar (warning: don't do it on prod).
Thanks, Eugen
Zitat von Steven Vacaroaia <stef97@gmail.com>:
Hi,
I have a cephfs subvolume ( out of 4) with " mount path missing " issue I think a user deleted it as it look different than regular data to him/her
I am mounting at the group level so all subgroups are available under same path
How concerned should I be ? Is there a way to recreate path on a cephfs subvolume ? what are my options for fixing it ?
Please find below details
Mounting /volumes/projects /projects/cephfs
Cephfs status ceph fs status project_ec_ssd project_ec_ssd - 139 clients ============== RANK STATE MDS ACTIVITY DNS INOS DIRS CAPS 0 active project_ec_ssd.ceph-host-5.henbit Reqs: 0 /s 6198k 6054k 1645k 107k 1 active project_ec_ssd.ceph-host-7.emayje Reqs: 0 /s 194 197 340 629 2 active project_ec_ssd.ceph-host-3.qebqlz Reqs: 0 /s 192 196 339 644 3 active project_ec_ssd.ceph-host-1.bwtdlt Reqs: 0 /s 196 199 338 729 4 active project_ec_ssd.ceph-host-4.xsoerf Reqs: 0 /s 196 200 339 93 POOL TYPE USED AVAIL metadata_fs_ssd metadata 18.0G 92.8T ssd_ec_project data 183T 241T
ceph fs subvolumegroup ls project_ec_ssd [ { "name": "projects" } ]
ceph fs subvolume ls project_ec_ssd --group_name projects [ { "name": "systems_archive" }, { "name": "arescore_moved" }, { "name": "alphacore_moved" }, { "name": "schematics" } ]
ceph fs subvolume getpath project_ec_ssd alphacore_moved --group_name projects Error ENOENT: mount path missing for subvolume 'alphacore_moved'
ceph fs subvolume getpath project_ec_ssd arescore_moved --group_name projects /volumes/projects/arescore_moved/ff576e35-2363-4e25-aa7a-e4a81693ab20
Many thanks Steven _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Cheers, Venky
Hi All A picture worth a thousands words ...see attached "alphacore_moved" is the one complaining Someone deleted the metadata entry that looked like this "ff576e35-2363-4e25-aa7a-e4a81693ab20" I think one can replicate the issue by creating a volume with few subvolumes, mount at the volume level and then delete subvolume metadata file Is there anyway to recreate it ? Is there any other way to fix this without downtime ? Should I be worried and move data from the volume? [image: image.png] On Wed, 29 Oct 2025 at 08:56, Venky Shankar <vshankar@redhat.com> wrote:
Hi Eugen,
On Wed, Oct 29, 2025 at 4:29 PM Eugen Block <eblock@nde.ag> wrote:
Hi,
could you add more details what exactly happened? I tried to reproduce by simply removing the entire directory within a subvolume group, but I still see the getpath output. Obviously, I'm doing something differently here.
The path is taken from the subvolume metadata file. If you remove that, you would see something similar (warning: don't do it on prod).
Thanks, Eugen
Zitat von Steven Vacaroaia <stef97@gmail.com>:
Hi,
I have a cephfs subvolume ( out of 4) with " mount path missing "
issue
I think a user deleted it as it look different than regular data to him/her
I am mounting at the group level so all subgroups are available under same path
How concerned should I be ? Is there a way to recreate path on a cephfs subvolume ? what are my options for fixing it ?
Please find below details
Mounting /volumes/projects /projects/cephfs
Cephfs status ceph fs status project_ec_ssd project_ec_ssd - 139 clients ============== RANK STATE MDS ACTIVITY DNS INOS DIRS CAPS 0 active project_ec_ssd.ceph-host-5.henbit Reqs: 0 /s 6198k 6054k 1645k 107k 1 active project_ec_ssd.ceph-host-7.emayje Reqs: 0 /s 194 197 340 629 2 active project_ec_ssd.ceph-host-3.qebqlz Reqs: 0 /s 192 196 339 644 3 active project_ec_ssd.ceph-host-1.bwtdlt Reqs: 0 /s 196 199 338 729 4 active project_ec_ssd.ceph-host-4.xsoerf Reqs: 0 /s 196 200 339 93 POOL TYPE USED AVAIL metadata_fs_ssd metadata 18.0G 92.8T ssd_ec_project data 183T 241T
ceph fs subvolumegroup ls project_ec_ssd [ { "name": "projects" } ]
ceph fs subvolume ls project_ec_ssd --group_name projects [ { "name": "systems_archive" }, { "name": "arescore_moved" }, { "name": "alphacore_moved" }, { "name": "schematics" } ]
ceph fs subvolume getpath project_ec_ssd alphacore_moved --group_name projects Error ENOENT: mount path missing for subvolume 'alphacore_moved'
ceph fs subvolume getpath project_ec_ssd arescore_moved --group_name projects /volumes/projects/arescore_moved/ff576e35-2363-4e25-aa7a-e4a81693ab20
Many thanks Steven _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Cheers, Venky _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (3)
-
Eugen Block
-
Steven Vacaroaia
-
Venky Shankar