Hi Matt, On 9/22/20 5:44 AM, Matt Larson wrote:
I tried this:
`sudo ceph tell 'osd.*' injectargs '--osd-max-backfills 4'`
Which has increased to having 10 simultaneous backfills and a higher 10X higher rate of data movements. It looks like I could increase this further by increasing the number of simultaneous recovery operations, but changing that parameter to 20 didn't cause a change. The command warned that OSDs may need to be restarted before this takes effect:
sudo ceph tell 'osd.*' injectargs '--osd-recovery-max-active 20'
I'll let it run overnight with a higher backfill rate and see if that is sufficient to let the cluster catch up.
The commands are from (http://lists.ceph.com/pipermail/ceph-users-ceph.com/2018-January/023844.html)
Alternatively, you could have used the Dashboard's OSD Recovery Priority Feature (see screen shot) ;) Lenz -- SUSE Software Solutions Germany GmbH - Maxfeldstr. 5 - 90409 Nuernberg GF: Felix Imendörffer, HRB 36809 (AG Nürnberg)