yeah, but you don't want to have those reference objects in an EC pool, that's iiuc been explicitly disallowed in newer versions, as it's a performance suck. so leaving them in the replicated pool is good :) On Mon, Apr 5, 2021 at 2:55 PM Oliver Freyermuth < freyermuth@physik.uni-bonn.de> wrote:
Hi,
that really looks like a useful tool, thanks for mentioning this on the list :-).
However, I'd also love to learn about a different way — as documentation states: "You may notice that object counts in your primary data pool (the one passed to fs new) continue to increase, even if files are being created in the pool you added." https://docs.ceph.com/en/latest/cephfs/file-layouts/ So I think while this will migrate the bulk of the data, it will never be a full migration the way CephFS seems to be implemented. Especially for growing EC clusters, it would be helpful to be able to migrate to a different, more space-efficient EC profile as the number of hosts increases.
We're not at this point yet, but one day we'll surely be. Right now, the only "complete migration" approach seems to be to create a new FS, and migrate things over... Am I right?
Cheers, Oliver
Am 05.04.21 um 19:22 schrieb Peter Woodman:
hi, i made a tool to do this. it’s rough around the edges and has some known bugs with symlinks as parent paths but it checks all file layouts to see if they match the directory layout they’re in, and if not, makes them so by copying and replacing. so to ‘migrate’ set your directory layouts and then run this tool to move everything to the right places.
i’m unaware of another way of doing this so if there is someone tell me!
https://git.sr.ht/~pjjw/cephfs-layout-tool
On Sun, Apr 4, 2021 at 5:43 PM <ceph@fionera.de> wrote:
Hello everyone,
I currently have a CephFS running with about 60TB of Data. I created it with a replicated pool as default pool, an erasure coded one as additional data pool like it is described in the docs. Now I want to migrate the data from the replicated pool, to the new erasure coded one. I couldn't find any docs and was wondering if its even possible currently.
Thank you very much, Fionera _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io