Hi, I'm having issue with lifecycle jobs for 18.2.4 cluster with versioning enabled bucket. /# radosgw-admin lc list [ { "bucket": ":mongobackup-prod:c3e0a369-71df-40f5-a5c0-51e859efe0e0.96754.1", "shard": "lc.0", "started": "Thu, 01 Jan 1970 00:00:00 GMT", "status": "COMPLETE" } ] During RGW startup : 2024-09-17T16:51:06.148+0000 7f944d02d640 2 garbage collection: garbage collection: start 2024-09-17T16:51:06.152+0000 7f944501d640 2 lifecycle: life cycle: start 2024-09-17T16:51:06.152+0000 7f944501d640 5 lifecycle: RGWLC::process(): ENTER: index: 26 worker ix: 0 2024-09-17T16:51:06.152+0000 7f943f812640 2 lifecycle: life cycle: start 2024-09-17T16:51:06.152+0000 7f943f812640 5 lifecycle: RGWLC::process(): ENTER: index: 18 worker ix: 1 2024-09-17T16:51:06.152+0000 7f944501d640 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.26 head.marker= head.shard_rollover_date=0 2024-09-17T16:51:06.152+0000 7f944501d640 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-09-17T16:51:06.152+0000 7f943a007640 2 lifecycle: life cycle: start 2024-09-17T16:51:06.152+0000 7f943a007640 5 lifecycle: RGWLC::process(): ENTER: index: 17 worker ix: 2 2024-09-17T16:51:06.156+0000 7f943f812640 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.18 head.marker= head.shard_rollover_date=0 2024-09-17T16:51:06.156+0000 7f943f812640 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-09-17T16:51:06.156+0000 7f944501d640 5 lifecycle: RGWLC::process(): ENTER: index: 9 worker ix: 0 [...] 2024-09-17T16:51:06.568+0000 7f94137ba640 2 lifecycle: life cycle: stop 2024-09-17T16:51:06.572+0000 7f94137ba640 5 lifecycle: schedule life cycle next start time: Wed Sep 18 01:00:00 2024 Scheduled job ends with: 2024-09-17T00:00:01.379+0000 7fd17f843700 0 lifecycle: RGWLC::process() head.marker !empty() at START for shard==lc.31 head last stored at Mon Sep 16 06:34:39 2024 2024-09-17T00:00:01.379+0000 7fd17f843700 0 lifecycle: RGWLC::process() sal_lc->get_entry(lc_shard, head.marker, entry) returned error ret==-2 Anyone can explain the logic behind that? Thanks. -- Łukasz Borek lukasz@borek.org.pl