Comments inline.
On Thu, Feb 1, 2024 at 4:51 AM Matthew Melendy <mmelendy(a)cs.unm.edu> wrote:
In our department we're getting starting with Ceph
'reef', using Ceph FUSE
client for our Ubuntu workstations.
So far so good, except I can't quite figure out one aspect of subvolumes.
When I do the commands:
[root@ceph1 ~]# ceph fs subvolumegroup create cephfs csvg
[root@ceph1 ~]# ceph fs subvolume create cephfs staff csvg --size
2000000000000
I get these results:
- A subvolume group csvg is created on volume cephfs
- A subvolume called staff is created in csvg subvolume (like
/volumes/csvg/staff ) however there is no size limit set at this folder in
the Ceph dashboard view
- A folder with an random UUID name is created inside the subvolume staff
( like /volumes/csvg/staff/6a1b3de5-f6ab-4878-aea3-3c3c6f96ffcf ); this
folder does have a size set on it of 2TB
My questions are:
- what's the purpose of this UUID, and is it a requirement?
The UUID directory is essentially the data directory for the user to store
data.
The subvolume directory is used internally to store metadata related to
subvolume
to support all the subvolume operations.
For more detailed information, please go through the following comment in
the code.
https://github.com/ceph/ceph/blob/main/src/pybind/mgr/volumes/fs/operations…
<https://github.com/ceph/ceph/blob/main/src/pybind/mgr/volumes/fs/operations/versions/subvolume_v2.py#L19C1-L38C8>
- which directory should be mounted for my clients, staff/ or staff/{UUID},
for the size limit to take effect?
The quota (size passed during subvolume creation/or set after creation) is
enforced on the uuid directory not on subvolume
directory. So it should be staff/{uuid}. The idea is to use the 'subvolume
getpath' command and use the returned path to mount. That
should take care of all the things.
- is there any way to hide or disable this UUID for client mounts? (eg in
/etc/fstab)
I didn't quite get this ?
[root@ceph1 ~]# ceph fs subvolume getpath cephfs staff
csvg
/volumes/csvg/staff/6a1b3de5-f6ab-4878-aea3-3c3c6f96ffcf
[root@ceph1 ~]# ceph fs subvolume ls cephfs csvg
[
{
"name": "staff"
}
]
--
Sincerely,
Matthew Melendy
IT Services Specialist
CS System Services Group
FEC 3550, University of New Mexico
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io