20 Mar
2024
20 Mar
'24
2:19 a.m.
I am dealing with a cluster that is having terrible performance with partial reads from an
erasure coded pool. Warp tests and s3bench tests result in acceptable performance but when
the application hits the data, performance plummets. Can anyone clear this up for me, When
radosgw gets a partial read does it have to assemble all the rados objects that make up
the s3 object before returning the range? With a replicated poll i am seeing 6 to 7 GiB/s
of read performance and only 1GiB/s of read from the erasure coded pool which leads me to
believe that the replicated pool is returning just the rados objects for the partial s3
object and the erasure coded pool is not.
2 Apr
2 Apr
7:31 a.m.
I think it depends what you mean by rados objects and s3 objects here. If
you're talking about an object that was uploaded via MPU, and thus may
comprise many rados objects, I don't think there's a difference in read
behaviors based on pool type. If you're talking about reading a subset byte
range from a single rados object stored on an EC pool, yes, the whole
object is read from the pool in order to serve that subset read, something
that https://github.com/ceph/ceph/pull/55196 endeavours to address.
Josh
On Mon, Mar 25, 2024, 4:27 p.m. <E3GH75(a)gmail.com> wrote:
I am dealing with a cluster that is having terrible
performance with
partial reads from an erasure coded pool. Warp tests and s3bench tests
result in acceptable performance but when the application hits the data,
performance plummets. Can anyone clear this up for me, When radosgw gets a
partial read does it have to assemble all the rados objects that make up
the s3 object before returning the range? With a replicated poll i am
seeing 6 to 7 GiB/s of read performance and only 1GiB/s of read from the
erasure coded pool which leads me to believe that the replicated pool is
returning just the rados objects for the partial s3 object and the erasure
coded pool is not.
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
48
days inactive
62
days old
1 comments
2 participants
participants (2)
-
E3GH75＠gmail.com -
Joshua Baergen