2 Jan
2024
2 Jan
'24
5:29 p.m.
A while ago I moved from a replicated pool to a EC pool using this
procedure (a down of the service during the data migration was acceptable
in my case):
# Stop rgw on all instances
systemctl stop ceph-radosgw.target
# Create the new EC pool for rgw data
ceph osd pool create cloudprod.rgw.buckets.data.new 32 32 erasure
profile-4-2
# copy data from old pool to the new one
rados cppool cloudprod.rgw.buckets.data cloudprod.rgw.buckets.data.new
# Rename the pools
ceph osd pool rename cloudprod.rgw.buckets.data
cloudprod.rgw.buckets.data.old
ceph osd pool rename cloudprod.rgw.buckets.data.new
cloudprod.rgw.buckets.data
# Application setting
ceph osd pool application enable cloudprod.rgw.buckets.data rgw
# Delete old pool
ceph tell mon.\* injectargs '--mon-allow-pool-delete=true'
ceph osd pool delete cloudprod.rgw.buckets.data.old
cloudprod.rgw.buckets.data.old --yes-i-really-really-mean-it
ceph tell mon.\* injectargs '--mon-allow-pool-delete=false'
# Restart all rgw instances
systemctl start ceph-radosgw.target
Cheers, Massimo
On Tue, Jan 2, 2024 at 6:02 PM Jan Kasprzak <kas(a)fi.muni.cz> wrote:
Hello, Ceph users,
what is the best way how to change the storage layout of all buckets
in radosgw?
I have default.rgw.buckets.data pool as replicated, and I want to use
an erasure-coded layout instead. One way is to use cache tiering
as described here:
https://cephnotes.ksperis.com/blog/2015/04/15/ceph-pool-migration/
Could this be done under the running radosgw? If I read this correctly,
it should be done, because radosgw is just another RADOS client.
Another possible approach would be to create a new erasure-coded pool,
a new zone placement, and set it as default. But how can I migrate
the existing data? If I understand it correctly, the default placement
applies only to new buckets.
Something like this:
ceph osd erasure-code-profile set k5m2 k=5 m=2
ceph osd pool create default.rgw.buckets.ecdata erasure k5m2
ceph osd pool application enable default.rgw.buckets.ecdata radosgw
radosgw-admin zonegroup placement add --rgw-zonegroup default
--placement-id ecdata-placement
radosgw-admin zone placement add --rgw-zone default --placement-id
ecdata-placement --data-pool default.rgw.buckets.ecdata --index-pool
default.rgw.buckets.index --data-extra-pool default.rgw.buckets.non-ec
radosgw-admin zonegroup placement default --rgw-zonegroup default
--placement-id ecdata-placement
How to continue from this point?
And a secondary question: what purpose does the data-extra-pool serve?
Thanks!
-Yenya
--
| Jan "Yenya" Kasprzak <kas at {fi.muni.cz - work | yenya.net -
private}>
|
| https://www.fi.muni.cz/~kas/ GPG: 4096R/A45477D5
|
We all agree on the necessity of compromise. We just can't agree on
when it's necessary to compromise. --Larry Wall
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io