Hi, I got two pool one replica 3 and another with EC 4+2 for rbd. During my test to access from a KVM hyperviseur I create a image with meta data in the replica 3 pool and the data in the EC 4+2. After I end the test (where everything works) I can't see anything in erasure42 pool. rbd list --pool erasure42 return a empty list. But root@alopod:~# ceph df --- RAW STORAGE --- CLASS SIZE AVAIL USED RAW USED %RAW USED ssd 147 TiB 146 TiB 564 GiB 564 GiB 0.38 TOTAL 147 TiB 146 TiB 564 GiB 564 GiB 0.38 --- POOLS --- POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL .mgr 1 1 23 MiB 7 68 MiB 0 46 TiB erasure42 14 32 336 GiB 86.46k 504 GiB 0.36 92 TiB it still use 336GiB. How can I find where those 336Gib are and delete the image or whatever. Regards -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: lun. 17 mars 2025 08:24:32 CET
Hi,
rbd list --pool erasure42 return a empty list.
that's because the rbd metadata is stored in a replicated pool. You need to look into your replicated pool to delete the test image. If you don't find it with: rbd list --pool <replicated_pool> you can inspect the rbd_data prefix of the EC chunks and then find the corresponding rbd image: # retrieve the rbd_data prefix: rados -p openstack-ec ls | head -1 rbd_data.2.c142ac217af172.0000000000000120 # myrbdprefix="c142ac217af172"; for i in $(rbd -p images ls); do if [ $(rbd info --format json images/$i | jq -r '.block_name_prefix' | grep -c "$myrbdprefix") -eq 1 ]; then echo "your image is: " $(rbd info --format json images/$i | jq -r '.name'); break; fi; done your image is: volume-6cc34ae0-910f-475e-a097-7f374f4a8d57 To remove the image, you would need to issue that command for the replicated pool, not the EC pool: rbd rm <replicated_pool>/<image> Then check your EC object list again. Regards, Eugen Zitat von Albert Shih <Albert.Shih@obspm.fr>:
Hi,
I got two pool one replica 3 and another with EC 4+2 for rbd.
During my test to access from a KVM hyperviseur I create a image with meta data in the replica 3 pool and the data in the EC 4+2.
After I end the test (where everything works) I can't see anything in erasure42 pool.
rbd list --pool erasure42
return a empty list. But
root@alopod:~# ceph df --- RAW STORAGE --- CLASS SIZE AVAIL USED RAW USED %RAW USED ssd 147 TiB 146 TiB 564 GiB 564 GiB 0.38 TOTAL 147 TiB 146 TiB 564 GiB 564 GiB 0.38
--- POOLS --- POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL .mgr 1 1 23 MiB 7 68 MiB 0 46 TiB erasure42 14 32 336 GiB 86.46k 504 GiB 0.36 92 TiB
it still use 336GiB.
How can I find where those 336Gib are and delete the image or whatever.
Regards -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: lun. 17 mars 2025 08:24:32 CET _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Le 17/03/2025 à 13:46:58+0000, Eugen Block a écrit Hi,
that's because the rbd metadata is stored in a replicated pool. You need to look into your replicated pool to delete the test image. If you don't find it with:
Ok. I know that. But I didn't know I should remove the image metadata from the replica pool. So I already deleted the replicated pool....;-)
rbd list --pool <replicated_pool>
you can inspect the rbd_data prefix of the EC chunks and then find the corresponding rbd image:
# retrieve the rbd_data prefix: rados -p openstack-ec ls | head -1 rbd_data.2.c142ac217af172.0000000000000120
# myrbdprefix="c142ac217af172"; for i in $(rbd -p images ls); do if [ $(rbd info --format json images/$i | jq -r '.block_name_prefix' | grep -c "$myrbdprefix") -eq 1 ]; then echo "your image is: " $(rbd info --format json images/$i | jq -r '.name'); break; fi; done your image is: volume-6cc34ae0-910f-475e-a097-7f374f4a8d57
To remove the image, you would need to issue that command for the replicated pool, not the EC pool:
rbd rm <replicated_pool>/<image>
Ok big thanks. I would (try to) keep that in my little brain Now I will just remove the erasure pool also ;-) Regards. JAS -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: lun. 17 mars 2025 16:11:41 CET
participants (2)
-
Albert Shih
-
Eugen Block