Bucket usage per storage classes
Hello, I’m playing around with Storage classes in rgw and I’m looking for ways to see per bucket statistics for the diferent storage classes (for billing purposes etc.). I though that I would add another object to the bucket usage response like for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs. Is there some option to get this info? Ondrej Bucket usage I’m referring to "usage": { "rgw.main": { "size": 1333179575, "size_actual": 1333190656, "size_utilized": 1333179575, "size_kb": 1301934, "size_kb_actual": 1301944, "size_kb_utilized": 1301934, "num_objects": 4 }, "rgw.multimeta": { "size": 0, "size_actual": 0, "size_utilized": 0, "size_kb": 0, "size_kb_actual": 0, "size_kb_utilized": 0, "num_objects": 0 } }
A bucket may contain objects spread across multiple storage classes, and AIUI the head object is always in the default storage class, so I'm not sure *exactly* what you're after here.
On Apr 4, 2024, at 17:09, Ondřej Kukla <ondrej@kuuk.la> wrote:
Hello,
I’m playing around with Storage classes in rgw and I’m looking for ways to see per bucket statistics for the diferent storage classes (for billing purposes etc.).
I though that I would add another object to the bucket usage response like for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs.
Is there some option to get this info?
Ondrej
Bucket usage I’m referring to
"usage": { "rgw.main": { "size": 1333179575, "size_actual": 1333190656, "size_utilized": 1333179575, "size_kb": 1301934, "size_kb_actual": 1301944, "size_kb_utilized": 1301934, "num_objects": 4 }, "rgw.multimeta": { "size": 0, "size_actual": 0, "size_utilized": 0, "size_kb": 0, "size_kb_actual": 0, "size_kb_utilized": 0, "num_objects": 0 } } _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hello, There is no such usage collected today, see [1] and [2] – where [2] is a specification on how one community member wanted to implement the feature but nobody has put in the work yet that we know of. [1] https://tracker.ceph.com/issues/47342 [2] https://tracker.ceph.com/issues/54972 Best regards Tobias
On 4 Apr 2024, at 23:59, Ondřej Kukla <ondrej@kuuk.la> wrote:
Let's take for example a situation where I have a standart storage class backed by HDDs and a fast one on SSDs. The user will mix the classes in the bucket and I would like to know how much space Is he taking on the HDDs and how much on the SSDs so I can bill him.
In this scenario I don't care that the head object is on HDDs. I would just like to transparently know how much Is stored where.
I hope it makes sense.
Ondrej
On Apr 4, 2024 23:20, Anthony D'Atri <anthony.datri@gmail.com> wrote: A bucket may contain objects spread across multiple storage classes, and AIUI the head object is always in the default storage class, so I'm not sure *exactly* what you're after here.
On Apr 4, 2024, at 17:09, Ondřej Kukla <ondrej@kuuk.la> wrote:
Hello,
I’m playing around with Storage classes in rgw and I’m looking for ways to see per bucket statistics for the diferent storage classes (for billing purposes etc.).
I though that I would add another object to the bucket usage response like for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs.
Is there some option to get this info?
Ondrej
Bucket usage I’m referring to
"usage": { "rgw.main": { "size": 1333179575, "size_actual": 1333190656, "size_utilized": 1333179575, "size_kb": 1301934, "size_kb_actual": 1301944, "size_kb_utilized": 1301934, "num_objects": 4 }, "rgw.multimeta": { "size": 0, "size_actual": 0, "size_utilized": 0, "size_kb": 0, "size_kb_actual": 0, "size_kb_utilized": 0, "num_objects": 0 } } _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Does my example make sense or we are not on the same page still? Ondrej
On 4. 4. 2024, at 23:59, Ondřej Kukla <ondrej@kuuk.la> wrote:
Let's take for example a situation where I have a standart storage class backed by HDDs and a fast one on SSDs. The user will mix the classes in the bucket and I would like to know how much space Is he taking on the HDDs and how much on the SSDs so I can bill him.
In this scenario I don't care that the head object is on HDDs. I would just like to transparently know how much Is stored where.
I hope it makes sense.
Ondrej
On Apr 4, 2024 23:20, Anthony D'Atri <anthony.datri@gmail.com> wrote: A bucket may contain objects spread across multiple storage classes, and AIUI the head object is always in the default storage class, so I'm not sure *exactly* what you're after here.
On Apr 4, 2024, at 17:09, Ondřej Kukla <ondrej@kuuk.la> wrote:
Hello,
I’m playing around with Storage classes in rgw and I’m looking for ways to see per bucket statistics for the diferent storage classes (for billing purposes etc.).
I though that I would add another object to the bucket usage response like for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs.
Is there some option to get this info?
Ondrej
Bucket usage I’m referring to
"usage": { "rgw.main": { "size": 1333179575, "size_actual": 1333190656, "size_utilized": 1333179575, "size_kb": 1301934, "size_kb_actual": 1301944, "size_kb_utilized": 1301934, "num_objects": 4 }, "rgw.multimeta": { "size": 0, "size_actual": 0, "size_utilized": 0, "size_kb": 0, "size_kb_actual": 0, "size_kb_utilized": 0, "num_objects": 0 } } _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Sending again, to you directly as well, I’m unsure if my email was rejected on the mailing list. — Hello, There is no such usage collected today, see [1] and [2] – where [2] is a specification on how one community member wanted to implement the feature but nobody has put in the work yet that we know of. [1] https://tracker.ceph.com/issues/47342 [2] https://tracker.ceph.com/issues/54972 Best regards Tobias
On 8 Apr 2024, at 10:39, Ondřej Kukla <ondrej@kuuk.la> wrote:
Does my example make sense or we are not on the same page still?
Ondrej
On 4. 4. 2024, at 23:59, Ondřej Kukla <ondrej@kuuk.la> wrote:
Let's take for example a situation where I have a standart storage class backed by HDDs and a fast one on SSDs. The user will mix the classes in the bucket and I would like to know how much space Is he taking on the HDDs and how much on the SSDs so I can bill him.
In this scenario I don't care that the head object is on HDDs. I would just like to transparently know how much Is stored where.
I hope it makes sense.
Ondrej
On Apr 4, 2024 23:20, Anthony D'Atri <anthony.datri@gmail.com> wrote: A bucket may contain objects spread across multiple storage classes, and AIUI the head object is always in the default storage class, so I'm not sure *exactly* what you're after here.
On Apr 4, 2024, at 17:09, Ondřej Kukla <ondrej@kuuk.la> wrote:
Hello,
I’m playing around with Storage classes in rgw and I’m looking for ways to see per bucket statistics for the diferent storage classes (for billing purposes etc.).
I though that I would add another object to the bucket usage response like for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs.
Is there some option to get this info?
Ondrej
Bucket usage I’m referring to
"usage": { "rgw.main": { "size": 1333179575, "size_actual": 1333190656, "size_utilized": 1333179575, "size_kb": 1301934, "size_kb_actual": 1301944, "size_kb_utilized": 1301934, "num_objects": 4 }, "rgw.multimeta": { "size": 0, "size_actual": 0, "size_utilized": 0, "size_kb": 0, "size_kb_actual": 0, "size_kb_utilized": 0, "num_objects": 0 } } _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (3)
-
Anthony D'Atri
-
Ondřej Kukla
-
Tobias Urdin