For 750 osd 5 monitor in redhat doc
Hi, I went through some Redhat doc and saw this sentence which I didn't see in Ceph docs: "The storage cluster can run with only one Ceph Monitor; however, to ensure high availability in a production storage cluster, Red Hat will only support deployments with at least three Ceph Monitor nodes. Red Hat recommends deploying a total of 5 Ceph Monitors for storage clusters exceeding 750 Ceph OSDs." here: https://docs.redhat.com/en/documentation/red_hat_ceph_storage/4/html/install... We will reach this number so wonder do we really need 5 mon? Currently we have 3 collocated mgr/mon on baremetal server with some multiste gw traffic, if needed I'd plan to simply add some mon on vm only. Thank you ________________________________ This message is confidential and is for the sole use of the intended recipient(s). It may also be privileged or otherwise protected by copyright or other legal rules. If you have received it by mistake please let us know by reply email and delete it from your system. It is prohibited to copy this message or disclose its content to anyone. Any confidentiality or privilege is not waived or lost by any mistaken delivery or unauthorized disclosure of the message. All messages sent to and from Agoda may be monitored to ensure compliance with company policies, to protect the company's interests and to remove potential malware. Electronic messages may be intercepted, amended, lost or deleted, or contain viruses.
Hi, On 9/18/24 10:00, Szabo, Istvan (Agoda) wrote:
We will reach this number so wonder do we really need 5 mon? Currently we have 3 collocated mgr/mon on baremetal server with some multiste gw traffic, if needed I'd plan to simply add some mon on vm only.
The current recommended number of MONs is 5. A new cluster deployed with cephadm wants to start 5 MONs. When you have 3 MONs and 1 is down there is no room for any failure any more. A second MON going down takes your cluster offline. With 5 MONs you can lose 2 and the remaining 3 MONs still have quorum. Regards -- Robert Sander Heinlein Consulting GmbH Schwedter Str. 8/9b, 10119 Berlin https://www.heinlein-support.de Tel: 030 / 405051-43 Fax: 030 / 405051-19 Amtsgericht Berlin-Charlottenburg - HRB 220009 B Geschäftsführer: Peer Heinlein - Sitz: Berlin
Hi, you need to consider your resiliency requirements. With 3 MONs, you'll lose quorum if you have one MON in maintenance and another one fails during that window. You're safer with 5 MONs in such a case. We have been running our own cluster with 3 MONs for years without any issues, so it really depends. Zitat von "Szabo, Istvan (Agoda)" <Istvan.Szabo@agoda.com>:
Hi,
I went through some Redhat doc and saw this sentence which I didn't see in Ceph docs:
"The storage cluster can run with only one Ceph Monitor; however, to ensure high availability in a production storage cluster, Red Hat will only support deployments with at least three Ceph Monitor nodes. Red Hat recommends deploying a total of 5 Ceph Monitors for storage clusters exceeding 750 Ceph OSDs."
here: https://docs.redhat.com/en/documentation/red_hat_ceph_storage/4/html/install...
We will reach this number so wonder do we really need 5 mon? Currently we have 3 collocated mgr/mon on baremetal server with some multiste gw traffic, if needed I'd plan to simply add some mon on vm only.
Thank you
________________________________ This message is confidential and is for the sole use of the intended recipient(s). It may also be privileged or otherwise protected by copyright or other legal rules. If you have received it by mistake please let us know by reply email and delete it from your system. It is prohibited to copy this message or disclose its content to anyone. Any confidentiality or privilege is not waived or lost by any mistaken delivery or unauthorized disclosure of the message. All messages sent to and from Agoda may be monitored to ensure compliance with company policies, to protect the company's interests and to remove potential malware. Electronic messages may be intercepted, amended, lost or deleted, or contain viruses. _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (3)
-
Eugen Block
-
Robert Sander
-
Szabo, Istvan (Agoda)