12 Apr
2024
12 Apr
'24
2:22 a.m.
Le jeudi 11 avril 2024, 23:44:05 CEST Gilles Mocellin a écrit :
Le jeudi 11 avril 2024, 23:29:30 CEST Casey Bodley a
écrit :
something else).
unfortunately, this cloud sync module only
exports data from ceph to a
remote s3 endpoint, not the other way around:
"This module syncs zone data to a remote cloud service. The sync is
unidirectional; data is not synced back from the remote zone."
i believe that rclone supports copying from one s3 endpoint to
another. does anyone have experience with that?
Hello,
Yes, rclone can do that, and seems too have good performances (I didn't try
You can (should) parallelize (--transfers), use many
options, like rsync...
use checksums, launch several time (sync not just copy).
Of course, the machine where you launch the copy/sync, should be well
connected (good bandwidth) with either the source and the destination.
You can also launch several rclone, for specific buckets, from different
machines, in parallel...
Ah, and of course, if you use versioning, lifecycle rules, bucket policies, or
all other "metadata" other than objects in buckets,
rclone will NOT copy them. You should re-create (or something like export /
import) with awscli or s3cmd.