This only works if you reshard on the primary zone. Like Yixin, we've tried resharding on the primary zone where data is held on a secondary zone and all that results in is a complete loss of all index data for the reshardd bucket on the secondary zone. The only way to use multisite resharding pre-reef that I know of where the data is going to sit in the secondary zone is to pre-reshard the bucket before any data is put in. ________________________________ From: Richard Bade <hitrich@gmail.com> Sent: 09 October 2023 01:05 To: Yixin Jin <yjin77@yahoo.ca> Cc: Ceph-users <ceph-users@ceph.io> Subject: [ceph-users] Re: Manual resharding with multisite CAUTION: This email originates from outside THG Hi Yixin, I am interested in the answers to your questions also but I think I can provide some useful information for you. We have a multisite setup also where we need to reshard sometimes as the bucket have grown. However we have bucket sync turned off for these buckets as they only reside on one gateway and not the other. For these buckets I have been able to manually reshard using this command: radosgw-admin bucket reshard --rgw-zone={zone_name} --bucket={bucket_name} --num-shards {new_shard_number} --yes-i-really-mean-it I have not seen any issues with this, but like I said I only have data on that one zone and not the other. This may not be useful for your situation but I thought I'd mention it anyway. I would really like to know what the correct procedure is for buckets that have more than 100k objects per shard in a multisite environment. Regards, Rich On Thu, 5 Oct 2023 at 06:51, Yixin Jin <yjin77@yahoo.ca> wrote:
Hi folks,
I am aware that dynamic resharding isn't supported before Reef with multisite. However, does manual resharding work? It doesn't seem to be so, either. First of all, running "bucket reshard" has to be in the master zone. But if the objects of that bucket isn't in the master zone, resharding in the master zone seems to render those objects inaccessible in the zone that actually has them. So, what is recommended practice of resharding with multiste? No resharding at all?
Thanks, Yixin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io