Le jeudi 11 avril 2024, 23:29:30 CEST Casey Bodley a écrit :
unfortunately, this cloud sync module only exports data from ceph to a remote s3 endpoint, not the other way around:
"This module syncs zone data to a remote cloud service. The sync is unidirectional; data is not synced back from the remote zone."
i believe that rclone supports copying from one s3 endpoint to another. does anyone have experience with that?
Hello, Yes, rclone can do that, and seems too have good performances (I didn't try something else). You can (should) parallelize (--transfers), use many options, like rsync... use checksums, launch several time (sync not just copy). Of course, the machine where you launch the copy/sync, should be well connected (good bandwidth) with either the source and the destination. You can also launch several rclone, for specific buckets, from different machines, in parallel...