On 30/04/2025 00:08, Laimis Juzeliūnas wrote:
Hi Torkil,
Hi
We noticed that any backfilling pgs are super slow on erasure coded pools that run on HDDs. Is there any visible progress on the movement itself without pgremapper reductions?
Not entirely sure if this is what you mean but there is slight progress yes, it's not stalled. It's just odd being throttled to 6 ongoing backfills with almost 9000 misplaced PGs in a EC 4+2 pool with 400+ OSDs when the misplaced PGs were born from a pg_num doubling that should include all OSDs. Just ran the pgremapper reduction again and now getting this, which is more in line with what I would expect: 81 active+remapped+backfilling recovery: 3.0 GiB/s, 1.02k objects/s
You can try using https://github.com/TheJJ/ceph-balancer with ’showremapped’ to get a full status of what’s going on with the backfills.
Not sure what I am missing but that doesn't seem to be a thing, even though it is also mentioned in the README: [root@lazy ceph-balancer]# ./placementoptimizer.py showremapped usage: placementoptimizer.py [-h] [-v] [-q] [--profile] [--unsafe-gather] {gather,show,remap,balance,poolosddiff,repairstats,test,osdmap} ... placementoptimizer.py: error: argument mode: invalid choice: 'showremapped' (choose from 'gather', 'show', 'remap', 'balance', 'poolosddiff', 'repairstats', 'test', 'osdmap') Mvh. Torkil
Best, Laimis J.
On 30 Apr 2025, at 00:54, Torkil Svensgaard <torkil@drcmr.dk> wrote:
pool 11 'rbd_ec_data' erasure profile DRCMR_k4m2 size 6 min_size 5 crush_rule 0 object_hash rjenkins pg_num 16384 pgp_num 16384 autoscale_mode off last_change 2832704 lfor 0/1291190/2832700 flags hashpspool,ec_overwrites,selfmanaged_snaps,bulk stripe_width 16384 fast_read 1 compression_algorithm snappy compression_mode aggressive application rbd
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Torkil Svensgaard Sysadmin MR-Forskningssektionen, afs. 714 DRCMR, Danish Research Centre for Magnetic Resonance Hvidovre Hospital Kettegård Allé 30 DK-2650 Hvidovre Denmark Tel: +45 386 22828 E-mail: torkil@drcmr.dk