I think you
found the answer!
When adding 100 new OSDs to the cluster, I increased both pg and pgp
from 4096 to 16,384
Too much for your cluster, 4096 seems sufficient for a pool of size 10.
You can still reduce it relatively cheaply while it hasn't been fully
actuated yet
Assuming he has just the one pool and assuming from the name an 8,2 EC profile, that makes
his new PG ratio ~298. Which would not be entirely unreasonable for SSDs, probably too
much for HDDs in which case 8192 would arguably be okay. 4096 would make the ratio just
74.
— aad