Re: CephFS performance issue with a certain application
Anthony,
Am 01.01.2026 um 03:01 schrieb Anthony D'Atri via ceph-users <ceph-users@ceph.io>:
Forgive me if already asked, but:
* Is the CephFS metadata pool on enterprise-class NVMe SSDs? Which model, and how many? Firmware up to date?
all pools are within the same NVMes within the same RADOS cluster. There are also no separate devices for BlueStore WAL or any other metadata.
* Are those shared with other uses? Boot, OSD, etc?
No. Ceph-OSDs are in exclusive use by RADOS:
* How many PGs in the metadata pool, across how many OSDs?
Cluster has roughly 8200 PGs out of which the large majority is for the data and metadata pools. I will go find the exact numbers. Cluster is 12x16 15.56TB NVMes.
* Is the first CephFS data pool on SSDs, with setfattr layouts used to attach subdirectories to additional data pools?
Everything is on NVMes, but ttbomk, no setfattr was used in any of these.
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Best regards Martin -- Martin Gerhard Loschwitz Geschäftsführer / CEO, True West IT Services GmbH Phone: +49 2433 5253130 Mobile: +49 176 61832178 Address: Schmiedegasse 24a, 41836 Hückelhoven, Germany Legal: HRB 21985, Amtsgericht Mönchengladbach VAT: DE363893844 True West IT Services GmbH is compliant with the GDPR regulation on data protection and privacy in the European Union and the European Economic Area. You can request the information on how we collect and process your private data according to the law by contacting the email sender.
On Jan 1, 2026, at 8:15 AM, Martin Gerhard Loschwitz <martin.loschwitz@true-west.com> wrote:
Anthony,
Am 01.01.2026 um 03:01 schrieb Anthony D'Atri via ceph-users <ceph-users@ceph.io>:
Forgive me if already asked, but:
* Is the CephFS metadata pool on enterprise-class NVMe SSDs? Which model, and how many? Firmware up to date?
all pools are within the same NVMes within the same RADOS cluster. There are also no separate devices for BlueStore WAL or any other metadata.
* Are those shared with other uses? Boot, OSD, etc?
No. Ceph-OSDs are in exclusive use by RADOS:
* How many PGs in the metadata pool, across how many OSDs?
Cluster has roughly 8200 PGs out of which the large majority is for the data and metadata pools. I will go find the exact numbers. Cluster is 12x16 15.56TB NVMes.
Mainstream TOC enterprise SSDs? How many PG replicas per OSD? The PGS column of `ceph osd df` ?
* Is the first CephFS data pool on SSDs, with setfattr layouts used to attach subdirectories to additional data pools?
Everything is on NVMes, but ttbomk, no setfattr was used in any of these.
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Best regards Martin
-- Martin Gerhard Loschwitz Geschäftsführer / CEO, True West IT Services GmbH Phone: +49 2433 5253130 Mobile: +49 176 61832178 Address: Schmiedegasse 24a, 41836 Hückelhoven, Germany Legal: HRB 21985, Amtsgericht Mönchengladbach VAT: DE363893844
True West IT Services GmbH is compliant with the GDPR regulation on data protection and privacy in the European Union and the European Economic Area. You can request the information on how we collect and process your private data according to the law by contacting the email sender.
participants (2)
-
Anthony D'Atri
-
Martin Gerhard Loschwitz