A while ago I moved from a replicated pool to a EC pool using this procedure (a down of the service during the data migration was acceptable in my case): # Stop rgw on all instances systemctl stop ceph-radosgw.target # Create the new EC pool for rgw data ceph osd pool create cloudprod.rgw.buckets.data.new 32 32 erasure profile-4-2 # copy data from old pool to the new one rados cppool cloudprod.rgw.buckets.data cloudprod.rgw.buckets.data.new # Rename the pools ceph osd pool rename cloudprod.rgw.buckets.data cloudprod.rgw.buckets.data.old ceph osd pool rename cloudprod.rgw.buckets.data.new cloudprod.rgw.buckets.data # Application setting ceph osd pool application enable cloudprod.rgw.buckets.data rgw # Delete old pool ceph tell mon.\* injectargs '--mon-allow-pool-delete=true' ceph osd pool delete cloudprod.rgw.buckets.data.old cloudprod.rgw.buckets.data.old --yes-i-really-really-mean-it ceph tell mon.\* injectargs '--mon-allow-pool-delete=false' # Restart all rgw instances systemctl start ceph-radosgw.target Cheers, Massimo On Tue, Jan 2, 2024 at 6:02 PM Jan Kasprzak <kas@fi.muni.cz> wrote:

Hello, Ceph users,

what is the best way how to change the storage layout of all buckets in radosgw?

I have default.rgw.buckets.data pool as replicated, and I want to use an erasure-coded layout instead. One way is to use cache tiering as described here:

https://cephnotes.ksperis.com/blog/2015/04/15/ceph-pool-migration/

Could this be done under the running radosgw? If I read this correctly, it should be done, because radosgw is just another RADOS client.

Another possible approach would be to create a new erasure-coded pool, a new zone placement, and set it as default. But how can I migrate the existing data? If I understand it correctly, the default placement applies only to new buckets.

Something like this:

ceph osd erasure-code-profile set k5m2 k=5 m=2 ceph osd pool create default.rgw.buckets.ecdata erasure k5m2 ceph osd pool application enable default.rgw.buckets.ecdata radosgw

radosgw-admin zonegroup placement add --rgw-zonegroup default --placement-id ecdata-placement radosgw-admin zone placement add --rgw-zone default --placement-id ecdata-placement --data-pool default.rgw.buckets.ecdata --index-pool default.rgw.buckets.index --data-extra-pool default.rgw.buckets.non-ec radosgw-admin zonegroup placement default --rgw-zonegroup default --placement-id ecdata-placement

How to continue from this point?

And a secondary question: what purpose does the data-extra-pool serve?

Thanks!

-Yenya

-- | Jan "Yenya" Kasprzak <kas at {fi.muni.cz - work | yenya.net - private}> | | https://www.fi.muni.cz/~kas/ GPG: 4096R/A45477D5 | We all agree on the necessity of compromise. We just can't agree on when it's necessary to compromise. --Larry Wall _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io