Current min_alloc_size of OSD?
Hi, Ceph 16 Pacific introduced a new smaller default min_alloc_size of 4096 bytes for HDD and SSD OSDs. How can I get the current min_allloc_size of OSDs that were created with older Ceph versions? Is there a command that shows this info from the on disk format of a bluestore OSD? Regards -- Robert Sander Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin https://www.heinlein-support.de Tel: 030 / 405051-43 Fax: 030 / 405051-19 Amtsgericht Berlin-Charlottenburg - HRB 93818 B Geschäftsführer: Peer Heinlein - Sitz: Berlin
It’s printed in the OSD log at startup. I don’t immediately see it in `ceph osd metadata` ; arguably it should be there. `config show` on the admin socket I suspect does not show the existing value.
Hi,
Ceph 16 Pacific introduced a new smaller default min_alloc_size of 4096 bytes for HDD and SSD OSDs.
How can I get the current min_allloc_size of OSDs that were created with older Ceph versions? Is there a command that shows this info from the on disk format of a bluestore OSD?
Regards -- Robert Sander Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin
https://www.heinlein-support.de
Tel: 030 / 405051-43 Fax: 030 / 405051-19
Amtsgericht Berlin-Charlottenburg - HRB 93818 B Geschäftsführer: Peer Heinlein - Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
On 11.01.23 23:47, Anthony D'Atri wrote:
It’s printed in the OSD log at startup.
But which info is it exactly? This line looks like reporting the block_size of the device: bdev(0x55b50a2e5800 /var/lib/ceph/osd/ceph-0/block) open size 107369988096 (0x18ffc00000, 100 GiB) block_size 4096 (4 KiB) non-rotational discard supported Is it this line? bluefs _init_alloc shared, id 1, capacity 0x18ffc00000, block size 0x10000 0x10000 equals 65536 aka 64K in decimal. Is it this line? bluestore(/var/lib/ceph/osd/ceph-0) _open_super_meta min_alloc_size 0x1000 Or this one? bluestore(/var/lib/ceph/osd/ceph-0) _init_alloc loaded 100 GiB in 1 extents, allocator type hybrid, capacity 0x18ffc00000, block size 0x1000, free 0x18ffbfd000, fragmentation 0
I don’t immediately see it in `ceph osd metadata` ; arguably it should be there.
An entry in ceph osd metadata would be great to have.
`config show` on the admin socket I suspect does not show the existing value.
This show the value currently set in the configuration. Regards -- Robert Sander Heinlein Consulting GmbH Schwedter Str. 8/9b, 10119 Berlin https://www.heinlein-support.de Tel: 030 / 405051-43 Fax: 030 / 405051-19 Amtsgericht Berlin-Charlottenburg - HRB 220009 B Geschäftsführer: Peer Heinlein - Sitz: Berlin
Hi, On 12/01/2023 10.26, Robert Sander wrote:
Is it this line?
bluestore(/var/lib/ceph/osd/ceph-0) _open_super_meta min_alloc_size 0x1000
That seems to be it: https://github.com/ceph/ceph/blob/v15.2.17/src/os/bluestore/BlueStore.cc#L11... A few lines later it should state the same, but with function name "_set_alloc_sizes": https://github.com/ceph/ceph/blob/v15.2.17/src/os/bluestore/BlueStore.cc#L52..., althoug "dout(10)" probably means it only outputs this in a higher debug level. Best regards, Gerdriaan Mulder
Hi, On 12.01.23 11:11, Gerdriaan Mulder wrote:
On 12/01/2023 10.26, Robert Sander wrote:
Is it this line?
bluestore(/var/lib/ceph/osd/ceph-0) _open_super_meta min_alloc_size 0x1000
That seems to be it: https://github.com/ceph/ceph/blob/v15.2.17/src/os/bluestore/BlueStore.cc#L11...
Thanks for the confirmation. So one can grep for "min_alloc_size" in the OSD's log output. Regards -- Robert Sander Heinlein Consulting GmbH Schwedter Str. 8/9b, 10119 Berlin https://www.heinlein-support.de Tel: 030 / 405051-43 Fax: 030 / 405051-19 Amtsgericht Berlin-Charlottenburg - HRB 220009 B Geschäftsführer: Peer Heinlein - Sitz: Berlin
Hi,
On 12 Jan 2023, at 04:35, Robert Sander <r.sander@heinlein-support.de> wrote:
How can I get the current min_allloc_size of OSDs that were created with older Ceph versions? Is there a command that shows this info from the on disk format of a bluestore OSD?
You can see this via kvstore-tool: ceph-kvstore-tool bluestore-kv /var/lib/ceph/osd/ceph-0/ get S min_alloc_size 4096: 00000000 00 10 00 00 00 00 00 00 |........| 00000008 65536: 00000000 00 00 01 00 00 00 00 00 |........| 00000008 Cheers, k
Hi, Am 13.01.23 um 14:35 schrieb Konstantin Shalygin:
ceph-kvstore-tool bluestore-kv /var/lib/ceph/osd/ceph-0/ get S min_alloc_size
This only works when the OSD is not running. Regards -- Robert Sander Heinlein Consulting GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-43 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 220009 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin
I think this would be valuable to have easily accessible during runtime, perhaps submit a report (and patch if possible)? David On Fri, Jan 13, 2023, at 08:14, Robert Sander wrote:
Hi,
Am 13.01.23 um 14:35 schrieb Konstantin Shalygin:
ceph-kvstore-tool bluestore-kv /var/lib/ceph/osd/ceph-0/ get S min_alloc_size
This only works when the OSD is not running.
Regards -- Robert Sander Heinlein Consulting GmbH Schwedter Str. 8/9b, 10119 Berlin
http://www.heinlein-support.de
Tel: 030 / 405051-43 Fax: 030 / 405051-19
Zwangsangaben lt. §35a GmbHG: HRB 220009 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (5)
-
Anthony D'Atri
-
David Orman
-
Gerdriaan Mulder
-
Konstantin Shalygin
-
Robert Sander