radosgw-admin bucket stats doesn't show real num_objects and size
The radosgw-admin bucket stats show there are 209266 objects in this bucket, but it included failed multiparts, so that make the size parameter is also wrong. When I use boto3 to count objects, the bucket only has 209049 objects. The only solution I can find is to use lifecycle to clean these failed multiparts, but in production, the client will decide to use lifecycle or not? So are there any way to exclude the failed multiparts in bucket statistic? Does Ceph allow to set auto clean failed multiparts globally? Thanks! "usage": { "rgw.main": { "size": 593286801276, "size_actual": 593716080640, "size_utilized": 593286801276, "size_kb": 579381642, "size_kb_actual": 579800860, "size_kb_utilized": 579381642, "num_objects": 209266 }
I don't think you can exclude that. We've build a notification in the customer panel that there are incomplete multipart uploads which will be added as space to the bill. We also added a button to create a LC policy for these objects. Am Di., 11. Apr. 2023 um 19:07 Uhr schrieb <viplanghe6@gmail.com>:
The radosgw-admin bucket stats show there are 209266 objects in this bucket, but it included failed multiparts, so that make the size parameter is also wrong. When I use boto3 to count objects, the bucket only has 209049 objects.
The only solution I can find is to use lifecycle to clean these failed multiparts, but in production, the client will decide to use lifecycle or not? So are there any way to exclude the failed multiparts in bucket statistic? Does Ceph allow to set auto clean failed multiparts globally?
Thanks!
"usage": { "rgw.main": { "size": 593286801276, "size_actual": 593716080640, "size_utilized": 593286801276, "size_kb": 579381642, "size_kb_actual": 579800860, "size_kb_utilized": 579381642, "num_objects": 209266 } _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groüen Saal.
Yeah, thanks for your suggestion Vào Th 4, 12 thg 4, 2023 vào lúc 00:10 Boris Behrens <bb@kervyn.de> đã viết:
I don't think you can exclude that. We've build a notification in the customer panel that there are incomplete multipart uploads which will be added as space to the bill. We also added a button to create a LC policy for these objects.
Am Di., 11. Apr. 2023 um 19:07 Uhr schrieb <viplanghe6@gmail.com>:
The radosgw-admin bucket stats show there are 209266 objects in this bucket, but it included failed multiparts, so that make the size parameter is also wrong. When I use boto3 to count objects, the bucket only has 209049 objects.
The only solution I can find is to use lifecycle to clean these failed multiparts, but in production, the client will decide to use lifecycle or not? So are there any way to exclude the failed multiparts in bucket statistic? Does Ceph allow to set auto clean failed multiparts globally?
Thanks!
"usage": { "rgw.main": { "size": 593286801276, "size_actual": 593716080640, "size_utilized": 593286801276, "size_kb": 579381642, "size_kb_actual": 579800860, "size_kb_utilized": 579381642, "num_objects": 209266 } _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groüen Saal. _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (3)
-
Boris Behrens
-
huyv nguyễn
-
viplanghe6＠gmail.com