Le jeudi 11 avril 2024, 23:29:30 CEST Casey Bodley a écrit :
unfortunately, this cloud sync module only exports
data from ceph to a
remote s3 endpoint, not the other way around:
"This module syncs zone data to a remote cloud service. The sync is
unidirectional; data is not synced back from the remote zone."
i believe that rclone supports copying from one s3 endpoint to
another. does anyone have experience with that?
Hello,
Yes, rclone can do that, and seems too have good performances (I didn't try
something else).
You can (should) parallelize (--transfers), use many options, like rsync...
use checksums, launch several time (sync not just copy).
Of course, the machine where you launch the copy/sync, should be well
connected (good bandwidth) with either the source and the destination.
You can also launch several rclone, for specific buckets, from different
machines, in parallel...