newbie CRUSH rules / rbd pool
Hi everybody, I'm new to ceph. I'm testing 4 proxmox ceph nodes. I researched a lot on CRUSH rules and I build a rbd pool for use with my test-vms. I'm reading a lot in the official docs under docs.ceph.com. But I still have a lot of white space on my personal knowledge map. Are there any other recommendations for getting a full / deeper understanding of ceph? books? Best regards, Alexander Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | www.concat.de alexander.leutz@concat.de | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356 Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB 25326)
There are some published books out there written by community members that can be useful. Some talks on youtube as well that can be useful for understanding core concepts. What kind of things are you confused about and maybe we can help here directly. Usually the out of the box CRUSH rule is default to host so there is that. On Wed, Oct 22, 2025 at 6:20 AM Alexander Leutz <alexander.leutz@concat.de> wrote:
Hi everybody,
I'm new to ceph. I'm testing 4 proxmox ceph nodes.
I researched a lot on CRUSH rules and I build a rbd pool for use with my test-vms.
I'm reading a lot in the official docs under docs.ceph.com. But I still have a lot of white space on my personal knowledge map.
Are there any other recommendations for getting a full / deeper understanding of ceph? books?
Best regards, Alexander
<https://www.linkedin.com/company/concat-ag/> <https://www.facebook.com/ConcatAG> <https://www.xing.com/companies/concatag>
Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | <http://www.concat.de/>www.concat.de alexander.leutz@concat.de | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356
Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB 25326)
<https://www.concat.de/concat-loesungen/> _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
I'm partial to this one https://www.amazon.com/s?k=learning+ceph+second+edition&crid=1NILUH0R7APSL <https://www.amazon.com/s?k=learning+ceph+second+edition&crid=1NILUH0R7APSL&> The basics, like what are the components, what are OSDs and PGs, rough ideas of sizing, etc. are still quite valid, but a lot has changed since it came out. Like widespread adoption of the PG autoscaler and cephadm, automatic stepping of pgp_num. I *think* it covers the balancer but it's evolved since then for sure. There's a new user workshop @ Cephalocon next week. If you aren't yet attending, that would be a really good way to dive in, and you'd find scores of us who love talking Ceph all day and all night. -- aad
On Oct 22, 2025, at 8:59 PM, Kirby Haze <kirbyhaze01@gmail.com> wrote:
There are some published books out there written by community members that can be useful. Some talks on youtube as well that can be useful for understanding core concepts.
What kind of things are you confused about and maybe we can help here directly. Usually the out of the box CRUSH rule is default to host so there is that.
On Wed, Oct 22, 2025 at 6:20 AM Alexander Leutz <alexander.leutz@concat.de <mailto:alexander.leutz@concat.de>> wrote:
Hi everybody,
I'm new to ceph. I'm testing 4 proxmox ceph nodes.
I researched a lot on CRUSH rules and I build a rbd pool for use with my test-vms.
I'm reading a lot in the official docs under docs.ceph.com <http://docs.ceph.com/>. But I still have a lot of white space on my personal knowledge map.
Are there any other recommendations for getting a full / deeper understanding of ceph? books?
Best regards, Alexander <noname.png>
<noname.png> <https://www.linkedin.com/company/concat-ag/> <noname.png> <https://www.facebook.com/ConcatAG> <noname.png> <https://www.xing.com/companies/concatag> Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | <http://www.concat.de/>www.concat.de <http://www.concat.de/> alexander.leutz@concat.de <mailto:alexander.leutz@concat.de> | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356
Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB 25326)
<noname.png> <https://www.concat.de/concat-loesungen/>_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io <mailto:ceph-users@ceph.io> To unsubscribe send an email to ceph-users-leave@ceph.io <mailto:ceph-users-leave@ceph.io>
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Or join ceph days: Next in Germany in November https://ceph.io/en/community/events/2025/ceph-days-berlin/ Joachim www.clyso.com Hohenzollernstr. 27, 80801 Munich Utting a. A. | HR: Augsburg | HRB: 25866 | USt. ID-Nr.: DE2754306 Anthony D'Atri <anthony.datri@gmail.com> schrieb am Do., 23. Okt. 2025, 03:34:
I'm partial to this one
https://www.amazon.com/s?k=learning+ceph+second+edition&crid=1NILUH0R7APSL < https://www.amazon.com/s?k=learning+ceph+second+edition&crid=1NILUH0R7APSL&
The basics, like what are the components, what are OSDs and PGs, rough ideas of sizing, etc. are still quite valid, but a lot has changed since it came out. Like widespread adoption of the PG autoscaler and cephadm, automatic stepping of pgp_num. I *think* it covers the balancer but it's evolved since then for sure.
There's a new user workshop @ Cephalocon next week. If you aren't yet attending, that would be a really good way to dive in, and you'd find scores of us who love talking Ceph all day and all night.
-- aad
<noname.png> <https://www.concat.de/concat-loesungen/
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io <mailto: ceph-users@ceph.io> To unsubscribe send an email to ceph-users-leave@ceph.io <mailto: ceph-users-leave@ceph.io>
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
On Oct 22, 2025, at 8:59 PM, Kirby Haze <kirbyhaze01@gmail.com> wrote:
There are some published books out there written by community members that can be useful. Some talks on youtube as well that can be useful for understanding core concepts.
What kind of things are you confused about and maybe we can help here directly. Usually the out of the box CRUSH rule is default to host so there is that.
Hi everybody,
I'm new to ceph. I'm testing 4 proxmox ceph nodes.
I researched a lot on CRUSH rules and I build a rbd pool for use with my test-vms.
I'm reading a lot in the official docs under docs.ceph.com < http://docs.ceph.com/>. But I still have a lot of white space on my
On Wed, Oct 22, 2025 at 6:20 AM Alexander Leutz < alexander.leutz@concat.de <mailto:alexander.leutz@concat.de>> wrote: personal knowledge map.
Are there any other recommendations for getting a full / deeper
understanding of ceph? books?
Best regards, Alexander <noname.png>
<noname.png> <https://www.linkedin.com/company/concat-ag/>
<noname.png> <https://www.facebook.com/ConcatAG> <noname.png> < https://www.xing.com/companies/concatag>
Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | < http://www.concat.de/>www.concat.de <http://www.concat.de/> alexander.leutz@concat.de <mailto:alexander.leutz@concat.de> | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356
Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hallo Joachim, Thank your for the information about the ceph days - too late for me to schedule this - this year 🙂 Best regards, Beste Grüße, Alex Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | www.concat.de alexander.leutz@concat.de | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356 Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB 25326) ________________________________ Von: Joachim Kraftmayer <joachim.kraftmayer@clyso.com> Gesendet: Donnerstag, 23. Oktober 2025 07:08 An: Anthony D'Atri <anthony.datri@gmail.com> Cc: Kirby Haze <kirbyhaze01@gmail.com>; Alexander Leutz <alexander.leutz@concat.de>; ceph-users <ceph-users@ceph.io> Betreff: Re: [ceph-users] Re: newbie CRUSH rules / rbd pool ACHTUNG: Diese E-Mail stammt von außerhalb der Concat AG. Alle Aufforderungen, auf Links oder Anhänge zu klicken, sollten sorgfältig geprüft werden. Bei verdächtigen Nachrichten ist die Echtheit mit dem Absender über eine bekannte Telefonnummer zu bestätigen. Or join ceph days: Next in Germany in November Protected link to ceph.io<https://nsp.concat.de/link?id=BAgAAAD9JtMDTfNEoZUAAAB8TuCTXc95MxQEteq_r2HwfeBti_9JcnbPx2sjrsLpegbGlYxcFW3XANvIUn8UxSYE8WHMnq3_O32ElcKgEqEleJOE1zCQA_CjlB29ogiowxxtiO1WhTAcQLLQtWOFgPN8_7E_oI_Ek2lU6McFyC1XOLVF2x1SmoFFAzQx02_0HWl5ZMiwTb620u2ot_yIjd4gYZx4_Q2> Joachim Protected link to clyso.com<https://nsp.concat.de/link?id=BAgAAAD9JtMDTfNEoXAAAADkqMg_udWDd9Pajk4lcRNlTl-Nl4h20er5EFiELiCRig6reRhGQFfFXhluS6E7ppHOwM_a2fJM8LSTGi2y-9ksabEI53hZt7p0_7osrQwO33mVZ66-su2EP3eNX1xzt67ts_zwEc9yvtIoSc758yPZ0> Hohenzollernstr. 27, 80801 Munich Utting a. A. | HR: Augsburg | HRB: 25866 | USt. ID-Nr.: DE2754306 Anthony D'Atri <anthony.datri@gmail.com<mailto:anthony.datri@gmail.com>> schrieb am Do., 23. Okt. 2025, 03:34: I'm partial to this one https://www.amazon.com/s?k=learning+ceph+second+edition&crid=1NILUH0R7APSL <https://www.amazon.com/s?k=learning+ceph+second+edition&crid=1NILUH0R7APSL&> The basics, like what are the components, what are OSDs and PGs, rough ideas of sizing, etc. are still quite valid, but a lot has changed since it came out. Like widespread adoption of the PG autoscaler and cephadm, automatic stepping of pgp_num. I *think* it covers the balancer but it's evolved since then for sure. There's a new user workshop @ Cephalocon next week. If you aren't yet attending, that would be a really good way to dive in, and you'd find scores of us who love talking Ceph all day and all night. -- aad
On Oct 22, 2025, at 8:59 PM, Kirby Haze <kirbyhaze01@gmail.com<mailto:kirbyhaze01@gmail.com>> wrote:
There are some published books out there written by community members that can be useful. Some talks on youtube as well that can be useful for understanding core concepts.
What kind of things are you confused about and maybe we can help here directly. Usually the out of the box CRUSH rule is default to host so there is that.
On Wed, Oct 22, 2025 at 6:20 AM Alexander Leutz <alexander.leutz@concat.de<mailto:alexander.leutz@concat.de> <mailto:alexander.leutz@concat.de<mailto:alexander.leutz@concat.de>>> wrote:
Hi everybody,
I'm new to ceph. I'm testing 4 proxmox ceph nodes.
I researched a lot on CRUSH rules and I build a rbd pool for use with my test-vms.
I'm reading a lot in the official docs under docs.ceph.com (Protected link to ceph.com)<https://nsp.concat.de/link?id=BAgAAAD9JtMDTfNEoXAAAABHcTOrfp6yoH5pTMcV5sGQGlBZ8a_6LJ_halUJSt_AHJSH2smzyAoLpS_mW-LALZLSiXFszl0ZzG9FEmEvx6LnWcXGJVuKw_Qe1WcuOL7LsZzCgU06aH3P-masQ3D8aHeoew9f3spBz7Lb3u073DbK0> <Protected link to ceph.com<https://nsp.concat.de/link?id=BAgAAAD9JtMDTfNEoXAAAACN4ehqsNr-mP4xV1wP9L7Kzj4A2Mh0zwOa3ltVwh4wrlluNVNEOGL3vLLXbtTCpnQM0Rm5nXONzV0xl5rh9v9qzF-DQLMRktpdvO1NPp5VeZAPa0gdvVvqjHg4SbOi57uzyDiGjo9WwY6U0qly7IWv0>>. But I still have a lot of white space on my personal knowledge map.
Are there any other recommendations for getting a full / deeper understanding of ceph? books?
Best regards, Alexander <noname.png>
<noname.png> <https://www.linkedin.com/company/concat-ag/> <noname.png> <https://www.facebook.com/ConcatAG> <noname.png> <https://www.xing.com/companies/concatag> Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | <http://www.concat.de/>www.concat.de<http://www.concat.de> <http://www.concat.de/> alexander.leutz@concat.de<mailto:alexander.leutz@concat.de> <mailto:alexander.leutz@concat.de<mailto:alexander.leutz@concat.de>> | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356
Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB 25326)
<noname.png> <https://www.concat.de/concat-loesungen/>_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io<mailto:ceph-users@ceph.io> <mailto:ceph-users@ceph.io<mailto:ceph-users@ceph.io>> To unsubscribe send an email to ceph-users-leave@ceph.io<mailto:ceph-users-leave@ceph.io> <mailto:ceph-users-leave@ceph.io<mailto:ceph-users-leave@ceph.io>>
ceph-users mailing list -- ceph-users@ceph.io<mailto:ceph-users@ceph.io> To unsubscribe send an email to ceph-users-leave@ceph.io<mailto:ceph-users-leave@ceph.io>
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io<mailto:ceph-users@ceph.io> To unsubscribe send an email to ceph-users-leave@ceph.io<mailto:ceph-users-leave@ceph.io>
Hi there, Thank you for your feedback. This is too far to travel for me 🙂 The book looks good, maybe it's a little outdated. I got the point, that it is good to come around with clear questions to you all, here on the list. Best regards, Alexander Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | www.concat.de alexander.leutz@concat.de | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356 Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB 25326) ________________________________ Von: Anthony D'Atri <anthony.datri@gmail.com> Gesendet: Donnerstag, 23. Oktober 2025 03:34 An: Kirby Haze <kirbyhaze01@gmail.com> Cc: Alexander Leutz <alexander.leutz@concat.de>; ceph-users@ceph.io <ceph-users@ceph.io> Betreff: Re: [ceph-users] newbie CRUSH rules / rbd pool ACHTUNG: Diese E-Mail stammt von außerhalb der Concat AG. Alle Aufforderungen, auf Links oder Anhänge zu klicken, sollten sorgfältig geprüft werden. Bei verdächtigen Nachrichten ist die Echtheit mit dem Absender über eine bekannte Telefonnummer zu bestätigen. I'm partial to this one https://www.amazon.com/s?k=learning+ceph+second+edition&crid=1NILUH0R7APSL<https://www.amazon.com/s?k=learning+ceph+second+edition&crid=1NILUH0R7APSL&> The basics, like what are the components, what are OSDs and PGs, rough ideas of sizing, etc. are still quite valid, but a lot has changed since it came out. Like widespread adoption of the PG autoscaler and cephadm, automatic stepping of pgp_num. I *think* it covers the balancer but it's evolved since then for sure. There's a new user workshop @ Cephalocon next week. If you aren't yet attending, that would be a really good way to dive in, and you'd find scores of us who love talking Ceph all day and all night. -- aad On Oct 22, 2025, at 8:59 PM, Kirby Haze <kirbyhaze01@gmail.com> wrote: There are some published books out there written by community members that can be useful. Some talks on youtube as well that can be useful for understanding core concepts. What kind of things are you confused about and maybe we can help here directly. Usually the out of the box CRUSH rule is default to host so there is that. On Wed, Oct 22, 2025 at 6:20 AM Alexander Leutz <alexander.leutz@concat.de<mailto:alexander.leutz@concat.de>> wrote: Hi everybody, I'm new to ceph. I'm testing 4 proxmox ceph nodes. I researched a lot on CRUSH rules and I build a rbd pool for use with my test-vms. I'm reading a lot in the official docs under docs.ceph.com (Protected link to ceph.com)<https://nsp.concat.de/link?id=BAgAAABmKw7dAby_VnAAAAAGo3TWDS2u_dKin5ew_FvClsDPnyItMFFVV2yzGUuI6p3A51hcGH73-H2lb-ylcmze4EYH8a_uskkVcBa8KNoA6uOB9hDyW6KgFLAi9HwKMMmKSa0aU9AR6HOso1Aa0_hxQJEzs4oDHB6qJXUIZ24o0>. But I still have a lot of white space on my personal knowledge map. Are there any other recommendations for getting a full / deeper understanding of ceph? books? Best regards, Alexander <noname.png> <noname.png><https://www.linkedin.com/company/concat-ag/> <noname.png><https://www.facebook.com/ConcatAG> <noname.png><https://www.xing.com/companies/concatag> Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | <http://www.concat.de/> www.concat.de<http://www.concat.de/> alexander.leutz@concat.de<mailto:alexander.leutz@concat.de> | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356 Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB 25326) <noname.png><https://www.concat.de/concat-loesungen/> _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io<mailto:ceph-users@ceph.io> To unsubscribe send an email to ceph-users-leave@ceph.io<mailto:ceph-users-leave@ceph.io> _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Thank you Kirby, I need to get deeper in the meaning of the CRUSH rules in the focus of design and implementation of different kind of clusters. Currently I'm involved in the planning of new Proxmox Ceph Clusters for customers who want to have a new approach of a HCI solution. And the moment I'm testing a design of a 4 node cluster. Splitted between two rooms. Now I want to figure out what is the highest level of data replication that is possible / useful here. And I learned for the use of normal vm disks, I need a rbd pool on my Ceph. I need to understand all the parameters for rbd pools, CRUSH rules and replication settings. all the best, Alex Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | www.concat.de alexander.leutz@concat.de | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356 Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB 25326) ________________________________ Von: Kirby Haze <kirbyhaze01@gmail.com> Gesendet: Donnerstag, 23. Oktober 2025 02:59 An: Alexander Leutz <alexander.leutz@concat.de> Cc: ceph-users@ceph.io <ceph-users@ceph.io> Betreff: Re: [ceph-users] newbie CRUSH rules / rbd pool ACHTUNG: Diese E-Mail stammt von außerhalb der Concat AG. Alle Aufforderungen, auf Links oder Anhänge zu klicken, sollten sorgfältig geprüft werden. Bei verdächtigen Nachrichten ist die Echtheit mit dem Absender über eine bekannte Telefonnummer zu bestätigen. There are some published books out there written by community members that can be useful. Some talks on youtube as well that can be useful for understanding core concepts. What kind of things are you confused about and maybe we can help here directly. Usually the out of the box CRUSH rule is default to host so there is that. On Wed, Oct 22, 2025 at 6:20 AM Alexander Leutz <alexander.leutz@concat.de<mailto:alexander.leutz@concat.de>> wrote: Hi everybody, I'm new to ceph. I'm testing 4 proxmox ceph nodes. I researched a lot on CRUSH rules and I build a rbd pool for use with my test-vms. I'm reading a lot in the official docs under docs.ceph.com (Protected link to ceph.com)<https://nsp.concat.de/link?id=BAgAAACHgJQL-x_mhXAAAAAjE1VK6Flnv3W84cWKlDTl0mqRUSV8XFsZF2_zN8U9H0odJkTsvEQlj4GaZUSVfziwLo0MmR28JjofFoktlJKIMxOij3b9PeZTjZnFjb3vL-QcPixVmAKNLz1WJBESf9QHty1ePn_O_t4608uQxox30>. But I still have a lot of white space on my personal knowledge map. Are there any other recommendations for getting a full / deeper understanding of ceph? books? Best regards, Alexander [cid:ii_19a0e9146eac204bfcc1] [cid:ii_19a0e9146eac204bfcc2] <https://www.linkedin.com/company/concat-ag/> [cid:ii_19a0e9146eac204bfcc3] <https://www.facebook.com/ConcatAG> [cid:ii_19a0e9146eac204bfcc4] <https://www.xing.com/companies/concatag> Concat AG IT Solutions | Berliner Ring 127 - 129 | 64625 Bensheim | <http://www.concat.de/> www.concat.de<http://www.concat.de> alexander.leutz@concat.de<mailto:alexander.leutz@concat.de> | Tel.: +49 6251 7026-143 | Mobil: +49 151 18856009 | Fax: +49 6251 7026-356 Hauptsitz Bensheim a. d. Bergstraße | Vorstand Olaf von Heyer Aufsichtsratsvorsitzender Tim Patronik | Amtsgericht Darmstadt (HRB 25326) [cid:ii_19a0e9146eac204bfcc5]<https://www.concat.de/concat-loesungen/> _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io<mailto:ceph-users@ceph.io> To unsubscribe send an email to ceph-users-leave@ceph.io<mailto:ceph-users-leave@ceph.io>
participants (4)
-
Alexander Leutz
-
Anthony D'Atri
-
Joachim Kraftmayer
-
Kirby Haze