OSD network Issue -- Not using cluster Network
Hello All Found some network issue on OSD’s, why they are not using cluster network? Only using public network? My mons are on public network… How can I resolve it? Changing this network will lead any issue like need to stop all osd’s or restart cluster or rolling restart osd’s & how, please help? # ceph config get mon cluster_network 10.102.5.0/24 root@pl-host01n:/cephfs/bin# ceph config get mon public_network 10.102.1.0/24 root@pl-host01n:/cephfs/bin# ceph osd find osd.8 { "osd": 8, "addrs": { "addrvec": [ { "type": "v2", "addr": "10.102.1.122:6806", "nonce": 4172377551 }, { "type": "v1", "addr": "10.102.1.122:6807", "nonce": 4172377551 } ] }, "osd_fsid": "1b167c95-a873-4c02-aafc-24067246e65d", "host": "pl-host02n.ld6.example.”com, "crush_location": { "host": "pl-host02n", "root": "default" } } Regards Dev
What's the output of ceph config dump | grep cluster_network and ceph config get osd cluster_network Is it only some OSDs or all not using cluster_network? It's not entirely clear from your question. OSDs automatically use the public_network as a fallback, so if all of them use the public_network, it's probably not a big deal. But the fix is to set the cluster_network globally: ceph config set global cluster_network 10.102.5.0/24 and then do a rolling restart of all OSDs: ceph orch restart osd If only a few OSDs are affected, you should restart only those. You can inspect the output of 'ceph osd dump' to see which OSDs are using public only and which use both. Zitat von Devender Singh <devender@netskrt.io>:
Hello All
Found some network issue on OSD’s, why they are not using cluster network? Only using public network? My mons are on public network… How can I resolve it? Changing this network will lead any issue like need to stop all osd’s or restart cluster or rolling restart osd’s & how, please help?
# ceph config get mon cluster_network 10.102.5.0/24 root@pl-host01n:/cephfs/bin# ceph config get mon public_network 10.102.1.0/24 root@pl-host01n:/cephfs/bin# ceph osd find osd.8 { "osd": 8, "addrs": { "addrvec": [ { "type": "v2", "addr": "10.102.1.122:6806", "nonce": 4172377551 }, { "type": "v1", "addr": "10.102.1.122:6807", "nonce": 4172377551 } ] }, "osd_fsid": "1b167c95-a873-4c02-aafc-24067246e65d", "host": "pl-host02n.ld6.example.”com, "crush_location": { "host": "pl-host02n", "root": "default" } }
Regards Dev
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (2)
-
Devender Singh
-
Eugen Block