I am new to Ceph so I hope this is not a question of me not reading the documentation well enough. I have setup a small cluster to learn with three physical hosts each with two nics. The cluster is upp and running but I have not figured out how to tie the OSD:s to my second interface for a separate cluster network, as it is now all communication goes thru the public network. Is it possible to define the cluster network with cephadm in some way? /Jimmy
This should give you the answer to your question https://docs.ceph.com/docs/master/rados/configuration/network-config-ref/ Regards, Suresh On Sun, Jun 7, 2020, 5:10 AM <jimmy.spets@waochurch.com> wrote:
I am new to Ceph so I hope this is not a question of me not reading the documentation well enough.
I have setup a small cluster to learn with three physical hosts each with two nics.
The cluster is upp and running but I have not figured out how to tie the OSD:s to my second interface for a separate cluster network, as it is now all communication goes thru the public network.
Is it possible to define the cluster network with cephadm in some way?
/Jimmy _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hi, you can specify a customized ceph.conf before the 'cephadm bootstrap' command [1] to add a dedicated cluster network (if you really need that, it has been discussed extensively on the list): ---snip--- octo1:~ # cat <<EOF > /root/ceph.conf
[global] public network = 192.168.124.0/24 cluster network = 192.168.127.0/24 EOF
octo1:~ # cephadm bootstrap -c /root/ceph.conf --mon-ip 192.168.124.5 [...] ---snip--- After you deployed the OSDs they should be attached to the cluster network: ---snip--- octo1:~ # ceph osd metadata 0 | grep addr "back_addr": "[v2:192.168.127.11:6800/4272275002,v1:192.168.127.11:6801/4272275002]", "front_addr": "[v2:192.168.124.5:6802/4272275002,v1:192.168.124.5:6803/4272275002]", "hb_back_addr": "[v2:192.168.127.11:6802/4272275002,v1:192.168.127.11:6803/4272275002]", "hb_front_addr": "[v2:192.168.124.5:6804/4272275002,v1:192.168.124.5:6805/4272275002]", ---snip--- You should see the replication traffic on the respective interfaces. Regards, Eugen [1] https://docs.ceph.com/docs/octopus/cephadm/operations/#etc-ceph-ceph-conf Zitat von Suresh Rama <sstkadu@gmail.com>:
This should give you the answer to your question https://docs.ceph.com/docs/master/rados/configuration/network-config-ref/
Regards, Suresh
On Sun, Jun 7, 2020, 5:10 AM <jimmy.spets@waochurch.com> wrote:
I am new to Ceph so I hope this is not a question of me not reading the documentation well enough.
I have setup a small cluster to learn with three physical hosts each with two nics.
The cluster is upp and running but I have not figured out how to tie the OSD:s to my second interface for a separate cluster network, as it is now all communication goes thru the public network.
Is it possible to define the cluster network with cephadm in some way?
/Jimmy _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (3)
-
Eugen Block
-
jimmy.spets@waochurch.com
-
Suresh Rama