Hi Eugen, Thanks for your reply. The problem is all rbd images were removed from pool rbd days ago. i.e. both below commands also return empty: $ rbd ls rbd $ rados -p rbd listomapkeys rbd_directory But below rados df still located 430K objects. Any other methods can I dig out those ghost objects? $ rados -p rbd df POOL_NAME USED OBJECTS CLONES COPIES MISSING_ON_PRIMARY UNFOUND DEGRADED RD_OPS RD WR_OPS WR USED COMPR UNDER COMPR rbd 18 MiB 430107 0 1290321 0 0 0 141454780 6.9 TiB 42395431 11 TiB 0 B 0 B $ rados -p rbd ls | while read obj; do echo "- "$obj; rados -p rbd stat $obj; rados -p rbd listomapkeys $obj; echo ; done - gateway.conf rbd/gateway.conf mtime 2020-05-18 11:15:30.000000, size 8869 - rbd_directory rbd/rbd_directory mtime 2020-05-18 10:59:50.000000, size 0 - rbd_info rbd/rbd_info mtime 2020-04-16 15:07:42.000000, size 19 - rbd_trash rbd/rbd_trash mtime 2020-05-18 11:15:30.000000, size 0 Regs, Icy On Tue, 19 May 2020 at 14:57, Eugen Block <eblock@nde.ag> wrote:
That's not wrong, those are expected objects that contain information about your rbd images. If you take a look into the rbd_directory (while you have images in there) you'll find something like this:
host:~ $ rados -p pool listomapkeys rbd_directory
id_fe976bcfb968bf id_ffc37728edbdab name_01673d5d-4b12-4a44-8793-403581f7d808_disk name_01673d5d-4b12-4a44-8793-403581f7d808_disk.config name_volume-8a1a0825-1163-44bc-abe2-1a711daea07b
The rbd ls command uses the rbd_directory object to read from, an excerpt from rbd man page:
---snip--- ls [-l | –long] [pool-name]
Will list all rbd images listed in the rbd_directory object. ---snip---
The gateway.conf is your iSCSI gateway configuration stored in the cluster.
Zitat von icy chan <icy.kf.chan@gmail.com>:
Hi,
The numbers of object counts from "rados df" and "rados ls" are different in my testing environment. I think it maybe some zero bytes or unclean objects since I removed all rbd images on top of it few days ago. How can I make it right / found out where are those ghost objects? Or i should ignore it since the numbers was not that high.
$ rados -p rbd df POOL_NAME USED OBJECTS CLONES COPIES MISSING_ON_PRIMARY UNFOUND DEGRADED RD_OPS RD WR_OPS WR USED COMPR UNDER COMPR rbd 18 MiB 430107 0 1290321 0 0 0 141243877 6.9 TiB 42395431 11 TiB 0 B 0 B
$ rados -p rbd ls | wc -l 4
$ rados -p rbd ls gateway.conf rbd_directory rbd_info rbd_trash
Regs, Icy _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io