How to change default osd reweight from 1.0 to 0.5
Hello~ Our ceph cluster uses 260 osds. The most highest osd usage is 87% But, The most lowest is under 40%. We consider lowering the highest osd's reweight and rising the lowest osd's reweight. We solved this problem following this workload. This is our workload. 1. Set All osd's reweight to 0.5 2. Rising the lowest osd's reweight to 0.6 3. Lowering the highest osd's reweight to 0.4 ** What I'm really curious about is this. ** I want to set the default osd reweight to 0.5 for the new osd that will be added to the cluster.
Our ceph cluster uses 260 osds. The most highest osd usage is 87% But, The most lowest is under 40%. We consider lowering the highest osd's reweight and rising the lowest osd's reweight.
How many Placement Groups do you have per OSD? We had uneven balanced OSDs in the past as well and were able to reduce the imbalance by increasing the placement groups. Best Regards Jan
Are the weights correctly set? So 1.6 for a 1.6TB disk and 1.0 for 1TB disks and so on.
Op 19 jun 2024 om 08:32 heeft Jan Marquardt <jm@artfiles.de> het volgende geschreven:
Our ceph cluster uses 260 osds. The most highest osd usage is 87% But, The most lowest is under 40%. We consider lowering the highest osd's reweight and rising the lowest osd's reweight.
How many Placement Groups do you have per OSD?
We had uneven balanced OSDs in the past as well and were able to reduce the imbalance by increasing the placement groups.
Best Regards
Jan _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
I’ve thought about this strategy in the past. I think you might enter a cron job to reset any OSDs at 1.0 to 0.5, but really the balancer module or JJ balancer is a better idea than old-style reweight.
On Jun 19, 2024, at 2:22 AM, 서민우 <smw940219@gmail.com> wrote:
Hello~
Our ceph cluster uses 260 osds. The most highest osd usage is 87% But, The most lowest is under 40%. We consider lowering the highest osd's reweight and rising the lowest osd's reweight.
We solved this problem following this workload. This is our workload. 1. Set All osd's reweight to 0.5 2. Rising the lowest osd's reweight to 0.6 3. Lowering the highest osd's reweight to 0.4
** What I'm really curious about is this. ** I want to set the default osd reweight to 0.5 for the new osd that will be added to the cluster. _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (4)
-
Anthony D'Atri
-
Jan Marquardt
-
Sinan Polat
-
서민우