5 May
2020
5 May
'20
9:51 p.m.
Hi,
We’ve recently installed a new Ceph cluster running Octopus 15.2.1, and we’re using RGW
with an erasure coded backed pool.
I started to get a suspicion that deleted objects were not getting cleaned up properly,
and I wanted to verify this by checking the garbage collector.
That’s when I discovered that when I run “radosgw-admin gc list”, I get the following
error:
"ERROR: failed to list objs: (22) Invalid argument”
When running the command with the debug-rgw=20 flag, I see a bit more information:
2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=0
2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=1
2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=2
2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=3
2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=4
2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=5
2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=6
2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=7
2020-05-05T18:39:19.455+0000 7f3312d82080 2 all 8 watchers are set, enabling cache
2020-05-05T18:39:19.455+0000 7f3312d82080 20 check_secure_mon_conn(): auth registy
supported: methods=[2,1] modes=[2,1]
2020-05-05T18:39:19.455+0000 7f3312d82080 20 check_secure_mon_conn(): method 1 is
insecure
2020-05-05T18:39:19.455+0000 7f32d4fd9700 2 RGWDataChangesLog::ChangesRenewThread: start
2020-05-05T18:39:19.519+0000 7f3246ffd700 20 reqs_thread_entry: start
2020-05-05T18:39:19.519+0000 7f3312d82080 20 init_complete bucket index max shards: 11
2020-05-05T18:39:19.519+0000 7f3244ff9700 20 reqs_thread_entry: start
2020-05-05T18:39:19.519+0000 7f323affd700 20 reqs_thread_entry: start
ERROR: failed to list objs: (22) Invalid argument
2020-05-05T18:39:19.523+0000 7f32d4fd9700 2 RGWDataChangesLog::ChangesRenewThread: start
2020-05-05T18:39:19.523+0000 7f3312d82080 20 remove_watcher() i=0
2020-05-05T18:39:19.523+0000 7f3312d82080 2 removed watcher, disabling cache
2020-05-05T18:39:19.523+0000 7f3312d82080 20 remove_watcher() i=1
2020-05-05T18:39:19.523+0000 7f3312d82080 20 remove_watcher() i=2
2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() i=3
2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() i=4
2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() i=5
2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() i=6
2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() I=7
I find very little information regarding this error, so I wondered if someone here could
help me troubleshoot the issue?
Thanks,
James.