I kind of doubt this will provide much of an advantage, I think recovery is the only time you might have some chance of speedup, but i'm not sure network throughput is always the bottleneck. There was some discussion a while back about this, client IO is still going to be impacted by recovery. On Wed, Sep 25, 2019 at 6:36 AM Adrien Georget <adrien.georget@cc.in2p3.fr> wrote:

Hi,

I need your advice about the following setup. Currently, we have a Ceph nautilus cluster used by Openstack Cinder with single NIC in 10Gbps on OSD hosts. We will upgrade the cluster by adding 7 new hosts dedicated to Nova/Glance and we would like to add a cluster network to isolate replication and recovery traffic. For now, it's not possible to add a second NIC and FC so we are thinking about enabling DELL NPAR [1] which allows splitting a single physical NIC in 2 logical NICs (1 for public network and 1 for Cluster network). We can set max and min bandwidth and implement dynamic bandwidth balancing for NPAR to get the appropriate bandwidth when Ceph need it (default alloc is 66% for cluster network and 34% for public network). Any experiences with this kind of configuration? Do you see any disadvantages doing this?

And one question, if we put this in production, adding cluster network value in ceph.conf and restarting each OSD is enough for Ceph?

Best,

Adrien

[1]

https://www.dell.com/support/article/fr/fr/frbsdt1/how12596/how-npar-works?l... _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io