I think your issue is you also have the PG scaler trying to change to 1PG. Due to the size of the OSD/no data it thinks you only need 1PG, I would suggest disabling the PG Auto Scaler on small test clusters. Thanks On 16 Mar 2021, 10:50 +0800, duluxoz <duluxoz@gmail.com>, wrote:
Hi Guys,
Is the below "ceph -s" normal?
This is a brand new cluster with (at the moment) a single Monitor and 7 OSDs (each 6 GiB) that has no data in it (yet), and yet its taking almost a day to "heal itself" from adding in the 2nd OSD.
~~~
cluster: id: [REDACTED] health: HEALTH_WARN Reduced data availability: 256 pgs inactive, 256 pgs incomplete Degraded data redundancy: 12 pgs undersized
services: mon: 1 daemons, quorum [REDACTED] (age 22h) mgr: [REDACTED](active, since 22h) osd: 7 osds: 7 up (since 21h), 7 in (since 21h); 32 remapped pgs
data: pools: 5 pools, 288 pgs objects: 7 objects, 0 B usage: 7.1 GiB used, 38 TiB / 38 TiB avail pgs: 88.889% pgs not active 6/21 objects misplaced (28.571%) 256 creating+incomplete 18 active+clean 12 active+undersized+remapped 2 active+clean+remapped
progress: Rebalancing after osd.1 marked in (22h) [............................] PG autoscaler decreasing pool 1 PGs from 32 to 1 (19h) [............................]
~~~
Thanks in advance
Matthew J
-- Peregrine IT Signature
*Matthew J BLACK* M.Inf.Tech.(Data Comms) MBA B.Sc. MACS (Snr), CP, IP3P
When you want it done /right/ ‒ the first time!
Phone: +61 4 0411 0089 Email: matthew@peregrineit.net <mailto:matthew@peregrineit.net> Web: www.peregrineit.net <http://www.peregrineit.net>
View Matthew J BLACK's profile on LinkedIn <http://au.linkedin.com/in/mjblack>
This Email is intended only for the addressee. Its use is limited to that intended by the author at the time and it is not to be distributed without the author’s consent. You must not use or disclose the contents of this Email, or add the sender’s Email address to any database, list or mailing list unless you are expressly authorised to do so. Unless otherwise stated, Peregrine I.T. Pty Ltd accepts no liability for the contents of this Email except where subsequently confirmed in writing. The opinions expressed in this Email are those of the author and do not necessarily represent the views of Peregrine I.T. Pty Ltd. This Email is confidential and may be subject to a claim of legal privilege.
If you have received this Email in error, please notify the author and delete this message immediately.
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io