radosgw's object striping does not repeat, so there is no concept of 'stripe width'. rgw_obj_stripe_size just controls the maximum size of each rados object, so the 'stripe count' is essentially just the total s3 object size divided by rgw_obj_stripe_size On Tue, Jun 13, 2023 at 10:22 AM Teja A <tejaseattle@gmail.com> wrote:
Hello
I am working on an application that uses rados gateway to store objects onto a ceph cluster. I am currently working on optimizing the latency for storing/retrieving objects from the cluster.
My goal to improve read/write latencies is to have RGW write/read multiple rados objects in parallel as described here <https://docs.ceph.com/en/latest/architecture/#data-striping> - "Significant write performance occurs when the client writes the stripe units to their corresponding objects in parallel.". Just like with RAID0, by having a large number of rados objects that each radosgw object gets mapped to, we can achieve lower latencies as we are not bound by the throughput of a single disk.
That documentation suggests that we can configure the stripe count as well as stripe width which would let us indirectly control how many rados objects each radosgw object gets mapped to. I want to be able to change these parameters and run benchmarks against my pools.
The key parameter I am therefore interested in controlling is the stripe count (i.e. the number of distinct objects each radosgw object is mapped to). More specifically, in the diagram <https://docs.ceph.com/en/latest/_images/ditaa-96a6fc80dad17fb53f161987ed64f0779930ffe1.png> attached to those docs, I see that the stripe_count is 4 (4 rados objects being written to for a single RGW object). I want to be able to experiment with varying numbers for that stripe_count.
I am having trouble figuring out what configuration parameters exist in radosgw that lets me control this. I see that there is a stripe_width <https://github.com/ceph/ceph/blob/714cdc4e8767a153f825e857efdc28bb481528a1/src/common/options/rgw.yaml.in#L1736> and a rgw_max_chunk_size <https://docs.ceph.com/en/latest/radosgw/config-ref/#confval-rgw_max_chunk_size> but did not find anything for stripe_count. Configuring the stripe_width alone is not sufficient as I would need to set the stripe_unit size as well to get the desired number for stripe_count, but I did not find either.
Am I understanding that correctly? If so, can someone please point me to where and how this configuration should be set?
I appreciate your help! _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io