Would you consider increasing the pgs on your larger pool(s)?  You might find things balance better.  Then you could look at weighting to favor NVMe if needed.

Hello All

I need to understand what below graph expalining and which disk utilisation it is? 

I have 8 NVME and 16 SSD and their weight is 1 with 20% disk utilised as per osd df.

If keeping the weight of NVME and reweight SSD to some .8 and .9 will worth anything to lower this graph utilisation? 

Below is the graph under each host performance on CEPH dashboard.

Regards

Dev