Re: Check allocated RGW bucket/object size after enabling Bluestore compression
Hi, What you mean, Bluestore compression? The rgw compression is a rados compression, not the compress by rgw itself. You can setup different storage classes and upload to same pool uncompressed, or compressed objects The compression ratio you can determine with exporter [1] [1] https://github.com/blemmenes/radosgw_usage_exporter k Sent from my iPhone
On 17 Aug 2023, at 17:58, yosr.kchaou96@gmail.com wrote: I see that if we enable RGW compression, we can see the actual (before compression) and utilized (after compression) size of the bucket. Is it possible to find the same information but with Bluestore compression ?
Hello Konstantin, Thanks for your reply. By the Bluestore compression I mean the compression enabled on the pool level. It is also called inline compression. https://docs.ceph.com/en/reef/rados/configuration/bluestore-config-ref/#inli... Do you see what I mean now ? Thanks Yosr
Hi,
On 17 Aug 2023, at 18:21, yosr.kchaou96@gmail.com wrote:
Thanks for your reply. By the Bluestore compression I mean the compression enabled on the pool level. It is also called inline compression. https://docs.ceph.com/en/reef/rados/configuration/bluestore-config-ref/#inli...
Do you see what I mean now ?
Yes, you can check metrics 'compress_bytes_used', 'compress_under_bytes', see [1] [1] https://github.com/ceph/ceph/pull/37289 k
Hello, Yes, I can see that there are metrics to check the size of the compressed data stored in a pool with ceph df detail (relevant columns are USED COMPR and UNDER COMPR) Also the size of compressed data can be checked on osd level using perf dump (relevant values "bluestore_compressed_allocated": and "bluestore_compressed_original") I would like to see the size of the compressed data per S3 bucket and not only per pool or osd. Is that even possible ? Thanks Yosr
On Thu, Aug 17, 2023 at 12:14 PM <yosr.kchaou96@gmail.com> wrote:
Hello,
Yes, I can see that there are metrics to check the size of the compressed data stored in a pool with ceph df detail (relevant columns are USED COMPR and UNDER COMPR)
Also the size of compressed data can be checked on osd level using perf dump (relevant values "bluestore_compressed_allocated": and "bluestore_compressed_original")
I would like to see the size of the compressed data per S3 bucket and not only per pool or osd.
Is that even possible ?
bluestore's compression is at a different layer than rgw's compression: https://docs.ceph.com/en/reef/radosgw/compression/ 'radosgw-admin bucket stats' can report on the latter (size vs. size_utilized), but i don't believe rgw has any visibility into bluestore's compression
Thanks Yosr _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (3)
-
Casey Bodley
-
Konstantin Shalygin
-
yosr.kchaou96＠gmail.com