Hi, I contact you for some question about quota. Situation is following below. 1. I set the user quota 10M 2. Using s3 browser, upload one 12M file 3. The upload failed as i wish, but some object remains in the pool(almost 10M) and s3brower doesn't show failed file. I expected nothing to be left in Ceph. My question is "can user or admin remove the remaining objects?"
Hi, This is incomplete multiparts I guess, you should remove it first. Don't know how S3 Browser works with this entities k Sent from my iPhone
On 6 Jul 2023, at 07:57, sejun21.kim@samsung.com wrote:
Hi, I contact you for some question about quota.
Situation is following below.
1. I set the user quota 10M 2. Using s3 browser, upload one 12M file 3. The upload failed as i wish, but some object remains in the pool(almost 10M) and s3brower doesn't show failed file.
I expected nothing to be left in Ceph.
My question is "can user or admin remove the remaining objects?"
Hi, yes, this is incomplete multiparts problem. Then, how do admin delete the incomplete multipart object? I mean 1. can admin find incomplete job and incomplete multipart object? 2. If first question is possible, then can admin delete all the job or object at once?
On Mon, Jul 10, 2023 at 10:40 AM <sejun21.kim@samsung.com> wrote:
Hi,
yes, this is incomplete multiparts problem.
Then, how do admin delete the incomplete multipart object? I mean 1. can admin find incomplete job and incomplete multipart object? 2. If first question is possible, then can admin delete all the job or object at once?
you don't need to be an admin to do these things, they're part of the S3 API. this cleanup can be automated using a bucket lifecycle policy [1]. for manual cleanup with aws cli, for example, you can use 'aws s3api list-multipart-uploads' [2] to discover all of the incomplete uploads in a given bucket, and 'aws s3api abort-multipart-upload' [3] to abort each of them. in addition to specifying the AWS_ACCESS_KEY_ID/AWS_SECRET_ACCESS_KEY environment variables, you'll also need to point --endpoint-url at a running radosgw [1] https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpu-abort-incomplete-m... [2] https://docs.aws.amazon.com/cli/latest/reference/s3api/list-multipart-upload... [3] https://docs.aws.amazon.com/cli/latest/reference/s3api/abort-multipart-uploa...
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (3)
-
Casey Bodley
-
Konstantin Shalygin
-
sejun21.kim＠samsung.com