On Tue, Aug 6, 2024 at 11:55 AM Torkil Svensgaard <torkil@drcmr.dk> wrote:
Hi
[ceph: root@ceph-flash1 /]# rbd info rbd_ec/projects rbd image 'projects': size 750 TiB in 196608000 objects order 22 (4 MiB objects) snapshot_count: 0 id: 15a979db61dda7 data_pool: rbd_ec_data block_name_prefix: rbd_data.10.15a979db61dda7 format: 2 features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, data-pool op_features: flags: create_timestamp: Thu Jul 7 10:57:13 2022 access_timestamp: Thu Jul 7 10:57:13 2022 modify_timestamp: Thu Jul 7 10:57:13 2022
We wanted to resize it to 1PB but that failed:
[ceph: root@ceph-flash1 /]# rbd resize rbd_ec/projects --size 1024T Resizing image: 0% complete...failed. rbd: shrinking an image is only allowed with the --allow-shrink flag 2024-08-06T08:42:01.053+0000 7fc996492580 -1 librbd::Operations: New size not compatible with object map
We can do 800T though:
[ceph: root@ceph-flash1 /]# rbd resize rbd_ec/projects --size 800T Resizing image: 100% complete...done.
A problem with the --1024T notation? Or we hitting some sort of size limit for RBD?
Hi Torkil, The latter -- the object-map feature is limited to 256000000 objects, which with 4M objects works out to be ~976T. For anything larger, the object-map feature can be disabled with "rbd feature disable" command (would need to temporarily unmap the image if it's mapped). Thanks, Ilya