Hello, I have a new created ceph cluster, I had some issues with disks, and now I have this 'ceph -s' list: health: HEALTH_WARN Degraded data redundancy: 103798/888 objects degraded (11688.964%), 188 pgs degraded, 192 pgs undersized 24 daemons have recently crashed services: mon: 3 daemons, quorum ceph0,ceph1,ceph2 (age 22m) mgr: ceph1.xzkgcv(active, since 40m), standbys: ceph0.qseeqr mds: 1/1 daemons up, 1 standby osd: 64 osds: 64 up (since 22m), 64 in (since 22m); 198 remapped pgs data: volumes: 1/1 healthy pools: 3 pools, 2065 pgs objects: 296 objects, 965 MiB usage: 63 GiB used, 1.4 PiB / 1.4 PiB avail pgs: 103798/888 objects degraded (11688.964%) 3770/888 objects misplaced (424.550%) 1865 active+clean 188 active+recovery_wait+undersized+degraded+remapped 7 active+recovery_wait+remapped 4 active+recovering+undersized+remapped 1 active+remapped+backfill_wait io: client: 11 KiB/s wr, 0 op/s rd, 2 op/s wr recovery: 0 B/s, 198 objects/s Please, pay attention to percentage. It seems, that there is swapped numerator and denominator of fraction, isn't it? Sincerely Jan Marek --. Ing. Jan Marek University of South Bohemia Academic Computer Centre Phone: +420389032080 http://www.gnu.org/philosophy/no-word-attachments.cs.html
Hello, the same cluster after a while: health: HEALTH_WARN Degraded data redundancy: 53658/297288 objects degraded (18.049%), 97 pgs degraded, 100 pgs undersized 24 daemons have recently crashed services: mon: 3 daemons, quorum ceph0,ceph1,ceph2 (age 30m) mgr: ceph1.xzkgcv(active, since 48m), standbys: ceph0.qseeqr mds: 1/1 daemons up, 1 standby osd: 64 osds: 64 up (since 30m), 64 in (since 30m); 105 remapped pgs data: volumes: 1/1 healthy pools: 3 pools, 2065 pgs objects: 99.10k objects, 47 GiB usage: 203 GiB used, 1.4 PiB / 1.4 PiB avail pgs: 53658/297288 objects degraded (18.049%) 2684/297288 objects misplaced (0.903%) 1960 active+clean 97 active+recovery_wait+undersized+degraded+remapped 5 active+recovery_wait+remapped 3 active+recovering+undersized+remapped This statistics are OK? Sincerely Jan Marek Dne čt, úno 27, 2025 at 10:46:55 CET napsal(a) Jan Marek:
Hello,
I have a new created ceph cluster, I had some issues with disks, and now I have this 'ceph -s' list:
health: HEALTH_WARN Degraded data redundancy: 103798/888 objects degraded (11688.964%), 188 pgs degraded, 192 pgs undersized 24 daemons have recently crashed
services: mon: 3 daemons, quorum ceph0,ceph1,ceph2 (age 22m) mgr: ceph1.xzkgcv(active, since 40m), standbys: ceph0.qseeqr mds: 1/1 daemons up, 1 standby osd: 64 osds: 64 up (since 22m), 64 in (since 22m); 198 remapped pgs
data: volumes: 1/1 healthy pools: 3 pools, 2065 pgs objects: 296 objects, 965 MiB usage: 63 GiB used, 1.4 PiB / 1.4 PiB avail pgs: 103798/888 objects degraded (11688.964%) 3770/888 objects misplaced (424.550%) 1865 active+clean 188 active+recovery_wait+undersized+degraded+remapped 7 active+recovery_wait+remapped 4 active+recovering+undersized+remapped 1 active+remapped+backfill_wait
io: client: 11 KiB/s wr, 0 op/s rd, 2 op/s wr recovery: 0 B/s, 198 objects/s
Please, pay attention to percentage. It seems, that there is swapped numerator and denominator of fraction, isn't it?
Sincerely Jan Marek --. Ing. Jan Marek University of South Bohemia Academic Computer Centre Phone: +420389032080 http://www.gnu.org/philosophy/no-word-attachments.cs.html
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Ing. Jan Marek University of South Bohemia Academic Computer Centre Phone: +420389032080 http://www.gnu.org/philosophy/no-word-attachments.cs.html
Am 2/27/25 um 10:51 schrieb Jan Marek:
pools: 3 pools, 2065 pgs objects: 99.10k objects, 47 GiB usage: 203 GiB used, 1.4 PiB / 1.4 PiB avail pgs: 53658/297288 objects degraded (18.049%)
pools: 3 pools, 2065 pgs objects: 296 objects, 965 MiB usage: 63 GiB used, 1.4 PiB / 1.4 PiB avail pgs: 103798/888 objects degraded (11688.964%)
It looks like the total number of objects was not correct. 888 is 3x 296, 297288 is 3x 99096 (or 99.10k). The number of PGs did not change. Mysterious. Regards -- Robert Sander Linux Consultant Heinlein Consulting GmbH Schwedter Str. 8/9b, 10119 Berlin https://www.heinlein-support.de Tel: +49 30 405051 - 0 Fax: +49 30 405051 - 19 Amtsgericht Berlin-Charlottenburg - HRB 220009 B Geschäftsführer: Peer Heinlein - Sitz: Berlin
participants (2)
-
Jan Marek
-
Robert Sander