Hi Robin, Thanks for the reply. I'm currently testing this on a bucket with a single object, on a Ceph cluster with a very tiny amount of data. I've done what you suggested and run the `radosgw-admin lc process` command and turned up the RGW logs - but I saw nothing. [qs-admin@portala0 ceph]$ ceph --admin-daemon /var/run/ceph/ceph-client.rgw.portala0.rgw0.49.94758071386744.asok config set debug_rgw 5/5 { "success": "" } [qs-admin@portala0 ceph]$ ceph --admin-daemon /var/run/ceph/ceph-client.rgw.portala0.rgw0.49.94758071386744.asok config get debug_rgw { "debug_rgw": "5/5" } [qs-admin@portala0 ceph]$ radosgw-admin lc process [qs-admin@portala0 ceph]$ No mention of life cycle in the logs at all - I am surprised here as I was expecting to see a flurry of activity with the logs turned all the way up? Am I doing something daft here? Also for info: [qs-admin@portala0 ceph]$ radosgw-admin lc list [ { "bucket": ":ahk-test:22bef6b9-67c8-41e6-9e51-17eaddf906fb.1444202.1", "status": "UNINITIAL" } } Thanks, Alex -----Original Message----- From: Robin H. Johnson <robbat2@gentoo.org> Sent: 29 July 2020 06:44 To: Alex Hussein-Kershaw <Alex.Hussein-Kershaw@metaswitch.com> Cc: ceph-users@ceph.io Subject: [EXTERNAL] Re: [ceph-users] S3 bucket lifecycle not deleting old objects On Tue, Jul 28, 2020 at 01:28:14PM +0000, Alex Hussein-Kershaw wrote:
Hello,
I have a problem that old versions of S3 objects are not being deleted. Can anyone advise as to why? I'm using Ceph 14.2.9. How many objects are in the bucket? If it's a lot, then you may run into RGW's lifecycle performance limitations: listing each bucket is a very slow operation for lifecycle prior to improvements make in later versions (Octopus with maybe a backport to Nautilius?)
If the bucket doesn't have a lot of operations, you could try running the 'radosgw-admin lc process' directly, with debug logging, and see where it gets bogged down. -- Robin Hugh Johnson Gentoo Linux: Dev, Infra Lead, Foundation Treasurer E-Mail : robbat2@gentoo.org GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136