Ceph cluster not recover after OSD down
Hi, I have a Nautilus cluster version 14.2.6 , and I have noted that when some OSD go down the cluster doesn't start recover. I have checked that the option noout is unset. What could be the reason for this behavior? -- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Can you share more information? The output of 'ceph status' when the osd is down would help, also 'ceph health detail' could be useful. On 05/05 10:48, Andres Rojas Guerrero wrote:
Hi, I have a Nautilus cluster version 14.2.6 , and I have noted that when some OSD go down the cluster doesn't start recover. I have checked that the option noout is unset.
What could be the reason for this behavior?
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- David Caro SRE - Cloud Services Wikimedia Foundation <https://wikimediafoundation.org/> PGP Signature: 7180 83A2 AC8B 314F B4CE 1171 4071 C7E1 D262 69C3 "Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment."
Yes, the principal problem is the MDS start to report slowly and the information is no longer accessible, and the cluster never recover. # ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 2 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests 2 MDSs behind on trimming Reduced data availability: 238 pgs inactive, 8 pgs down, 230 pgs incomplete Degraded data redundancy: 1400453/220552172 objects degraded (0.635%), 461 pgs degraded, 464 pgs undersized 241 slow ops, oldest one blocked for 638 sec, daemons [osd.101,osd.127,osd.155,osd.166,osd.172,osd.189,osd.200,osd.210,osd.214,osd.233]... have slow ops. services: mon: 3 daemons, quorum ceph2mon01,ceph2mon02,ceph2mon03 (age 25h) mgr: ceph2mon02(active, since 6d), standbys: ceph2mon01, ceph2mon03 mds: nxtclfs:2 {0=ceph2mon01=up:active,1=ceph2mon02=up:active} 1 up:standby osd: 768 osds: 736 up (since 11m), 736 in (since 95s); 416 remapped pgs data: pools: 2 pools, 16384 pgs objects: 33.40M objects, 39 TiB usage: 63 TiB used, 2.6 PiB / 2.6 PiB avail pgs: 1.489% pgs not active 1400453/220552172 objects degraded (0.635%) 15676 active+clean 285 active+undersized+degraded+remapped+backfill_wait 230 incomplete 176 active+undersized+degraded+remapped+backfilling 8 down 6 peering 3 active+undersized+remapped El 5/5/21 a las 10:54, David Caro escribió:
Can you share more information?
The output of 'ceph status' when the osd is down would help, also 'ceph health detail' could be useful.
On 05/05 10:48, Andres Rojas Guerrero wrote:
Hi, I have a Nautilus cluster version 14.2.6 , and I have noted that when some OSD go down the cluster doesn't start recover. I have checked that the option noout is unset.
What could be the reason for this behavior?
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Sorry, I have not understood the problem well, the problem I see is that once the OSD fails, the cluster recovers but the MDS remains faulty: # ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 3 clients failing to respond to capability release 2 MDSs report slow metadata IOs 2 MDSs report slow requests 2 MDSs behind on trimming Reduced data availability: 256 pgs inactive, 18 pgs down, 238 pgs incomplete 22 slow ops, oldest one blocked for 26719 sec, daemons [osd.134,osd.210,osd.244,osd.251,osd.301,osd.514,osd.520,osd.528,osd.642,osd.713]... have slow ops. services: mon: 3 daemons, quorum ceph2mon01,ceph2mon02,ceph2mon03 (age 23h) mgr: ceph2mon02(active, since 6d), standbys: ceph2mon01, ceph2mon03 mds: nxtclfs:2 {0=ceph2mon01=up:active,1=ceph2mon02=up:active} 1 up:standby osd: 768 osds: 736 up (since 7h), 736 in (since 7h) data: pools: 2 pools, 16384 pgs objects: 33.39M objects, 39 TiB usage: 64 TiB used, 2.6 PiB / 2.6 PiB avail pgs: 1.562% pgs not active 16128 active+clean 238 incomplete 18 down El 5/5/21 a las 11:00, Andres Rojas Guerrero escribió:
Yes, the principal problem is the MDS start to report slowly and the information is no longer accessible, and the cluster never recover.
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 2 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests 2 MDSs behind on trimming Reduced data availability: 238 pgs inactive, 8 pgs down, 230 pgs incomplete Degraded data redundancy: 1400453/220552172 objects degraded (0.635%), 461 pgs degraded, 464 pgs undersized 241 slow ops, oldest one blocked for 638 sec, daemons [osd.101,osd.127,osd.155,osd.166,osd.172,osd.189,osd.200,osd.210,osd.214,osd.233]... have slow ops.
services: mon: 3 daemons, quorum ceph2mon01,ceph2mon02,ceph2mon03 (age 25h) mgr: ceph2mon02(active, since 6d), standbys: ceph2mon01, ceph2mon03 mds: nxtclfs:2 {0=ceph2mon01=up:active,1=ceph2mon02=up:active} 1 up:standby osd: 768 osds: 736 up (since 11m), 736 in (since 95s); 416 remapped pgs
data: pools: 2 pools, 16384 pgs objects: 33.40M objects, 39 TiB usage: 63 TiB used, 2.6 PiB / 2.6 PiB avail pgs: 1.489% pgs not active 1400453/220552172 objects degraded (0.635%) 15676 active+clean 285 active+undersized+degraded+remapped+backfill_wait 230 incomplete 176 active+undersized+degraded+remapped+backfilling 8 down 6 peering 3 active+undersized+remapped
El 5/5/21 a las 10:54, David Caro escribió:
Can you share more information?
The output of 'ceph status' when the osd is down would help, also 'ceph health detail' could be useful.
On 05/05 10:48, Andres Rojas Guerrero wrote:
Hi, I have a Nautilus cluster version 14.2.6 , and I have noted that when some OSD go down the cluster doesn't start recover. I have checked that the option noout is unset.
What could be the reason for this behavior?
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
I see that problem, when the osds fail the mds fail, with errors with type "slow metadata, slow requests" but do not recover once the cluster has recovered ... Why? El 5/5/21 a las 11:07, Andres Rojas Guerrero escribió:
Sorry, I have not understood the problem well, the problem I see is that once the OSD fails, the cluster recovers but the MDS remains faulty:
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 3 clients failing to respond to capability release 2 MDSs report slow metadata IOs 2 MDSs report slow requests 2 MDSs behind on trimming Reduced data availability: 256 pgs inactive, 18 pgs down, 238 pgs incomplete 22 slow ops, oldest one blocked for 26719 sec, daemons [osd.134,osd.210,osd.244,osd.251,osd.301,osd.514,osd.520,osd.528,osd.642,osd.713]... have slow ops.
services: mon: 3 daemons, quorum ceph2mon01,ceph2mon02,ceph2mon03 (age 23h) mgr: ceph2mon02(active, since 6d), standbys: ceph2mon01, ceph2mon03 mds: nxtclfs:2 {0=ceph2mon01=up:active,1=ceph2mon02=up:active} 1 up:standby osd: 768 osds: 736 up (since 7h), 736 in (since 7h)
data: pools: 2 pools, 16384 pgs objects: 33.39M objects, 39 TiB usage: 64 TiB used, 2.6 PiB / 2.6 PiB avail pgs: 1.562% pgs not active 16128 active+clean 238 incomplete 18 down
El 5/5/21 a las 11:00, Andres Rojas Guerrero escribió:
Yes, the principal problem is the MDS start to report slowly and the information is no longer accessible, and the cluster never recover.
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 2 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests 2 MDSs behind on trimming Reduced data availability: 238 pgs inactive, 8 pgs down, 230 pgs incomplete Degraded data redundancy: 1400453/220552172 objects degraded (0.635%), 461 pgs degraded, 464 pgs undersized 241 slow ops, oldest one blocked for 638 sec, daemons [osd.101,osd.127,osd.155,osd.166,osd.172,osd.189,osd.200,osd.210,osd.214,osd.233]... have slow ops.
services: mon: 3 daemons, quorum ceph2mon01,ceph2mon02,ceph2mon03 (age 25h) mgr: ceph2mon02(active, since 6d), standbys: ceph2mon01, ceph2mon03 mds: nxtclfs:2 {0=ceph2mon01=up:active,1=ceph2mon02=up:active} 1 up:standby osd: 768 osds: 736 up (since 11m), 736 in (since 95s); 416 remapped pgs
data: pools: 2 pools, 16384 pgs objects: 33.40M objects, 39 TiB usage: 63 TiB used, 2.6 PiB / 2.6 PiB avail pgs: 1.489% pgs not active 1400453/220552172 objects degraded (0.635%) 15676 active+clean 285 active+undersized+degraded+remapped+backfill_wait 230 incomplete 176 active+undersized+degraded+remapped+backfilling 8 down 6 peering 3 active+undersized+remapped
El 5/5/21 a las 10:54, David Caro escribió:
Can you share more information?
The output of 'ceph status' when the osd is down would help, also 'ceph health detail' could be useful.
On 05/05 10:48, Andres Rojas Guerrero wrote:
Hi, I have a Nautilus cluster version 14.2.6 , and I have noted that when some OSD go down the cluster doesn't start recover. I have checked that the option noout is unset.
What could be the reason for this behavior?
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Hi, On 05.05.21 11:07, Andres Rojas Guerrero wrote:
Sorry, I have not understood the problem well, the problem I see is that once the OSD fails, the cluster recovers but the MDS remains faulty:
*snipsnap*
pgs: 1.562% pgs not active 16128 active+clean 238 incomplete 18 down
The PGs in down and incomplete state will not allow any I/O, and this leads to the slow ops and the unavailability of the services. 32 OSDs are currently down; if PG replicates are spread over these OSDs only there will be no automatic recover. You will have to bring the OSDs back online to allow recovery. Are those located on a single node or are multiple hosts involved? Regards, Burkhard
They are located on a single node ... El 5/5/21 a las 11:17, Burkhard Linke escribió:
Hi,
On 05.05.21 11:07, Andres Rojas Guerrero wrote:
Sorry, I have not understood the problem well, the problem I see is that once the OSD fails, the cluster recovers but the MDS remains faulty:
*snipsnap*
pgs: 1.562% pgs not active 16128 active+clean 238 incomplete 18 down
The PGs in down and incomplete state will not allow any I/O, and this leads to the slow ops and the unavailability of the services. 32 OSDs are currently down; if PG replicates are spread over these OSDs only there will be no automatic recover.
You will have to bring the OSDs back online to allow recovery. Are those located on a single node or are multiple hosts involved?
Regards,
Burkhard
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
I have in the cluster 768 OSD, it is enough that 32 (~ 4%) of them (in the same node) fall and the information becomes inaccessible. Is it possible to improve this behavior? # ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 1 clients failing to respond to capability release 1 MDSs report slow metadata IOs 1 MDSs report slow requests 32 osds down 1 host (32 osds) down Reduced data availability: 238 pgs inactive, 8 pgs down, 230 pgs incomplete Degraded data redundancy: 7384199/222506256 objects degraded (3.319%), 2925 pgs degraded, 2925 pgs undersized El 5/5/21 a las 11:20, Andres Rojas Guerrero escribió:
They are located on a single node ...
El 5/5/21 a las 11:17, Burkhard Linke escribió:
Hi,
On 05.05.21 11:07, Andres Rojas Guerrero wrote:
Sorry, I have not understood the problem well, the problem I see is that once the OSD fails, the cluster recovers but the MDS remains faulty:
*snipsnap*
pgs: 1.562% pgs not active 16128 active+clean 238 incomplete 18 down
The PGs in down and incomplete state will not allow any I/O, and this leads to the slow ops and the unavailability of the services. 32 OSDs are currently down; if PG replicates are spread over these OSDs only there will be no automatic recover.
You will have to bring the OSDs back online to allow recovery. Are those located on a single node or are multiple hosts involved?
Regards,
Burkhard
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Hi, Am 05.05.21 um 11:44 schrieb Andres Rojas Guerrero:
I have in the cluster 768 OSD, it is enough that 32 (~ 4%) of them (in the same node) fall and the information becomes inaccessible. Is it possible to improve this behavior?
You need to spread your failure zone in the crush map. It looks like the OSD is the failure zone, and not the host. If it woould be the host the failure of any number of OSDs in a single host would not bring PGs down. For the default redundancy rule and pool size 3 you need three separate hosts. Regards -- Robert Sander Heinlein Consulting GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-43 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin
Thanks for the answer.
For the default redundancy rule and pool size 3 you need three separate hosts.
I have 24 separate server nodes with with 32 osd in everyone in total 768 osd, my question is why the mds suffer when only 4% of the osd goes down (in the same node). I need to modify the crush map? El 5/5/21 a las 11:55, Robert Sander escribió:
Hi,
Am 05.05.21 um 11:44 schrieb Andres Rojas Guerrero:
I have in the cluster 768 OSD, it is enough that 32 (~ 4%) of them (in the same node) fall and the information becomes inaccessible. Is it possible to improve this behavior?
You need to spread your failure zone in the crush map. It looks like the OSD is the failure zone, and not the host. If it woould be the host the failure of any number of OSDs in a single host would not bring PGs down.
For the default redundancy rule and pool size 3 you need three separate hosts.
Regards
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Am 05.05.21 um 12:34 schrieb Andres Rojas Guerrero:
Thanks for the answer.
For the default redundancy rule and pool size 3 you need three separate hosts.
I have 24 separate server nodes with with 32 osd in everyone in total 768 osd, my question is why the mds suffer when only 4% of the osd goes down (in the same node). I need to modify the crush map?
With an unmodified crush map and the default placement rule this should not happen. Can you please show the output of "ceph osd crush rule dump"? Regards -- Robert Sander Heinlein Consulting GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-43 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin
# ceph osd crush rule dump [ { "rule_id": 0, "rule_name": "replicated_rule", "ruleset": 0, "type": 1, "min_size": 1, "max_size": 10, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "chooseleaf_firstn", "num": 0, "type": "host" }, { "op": "emit" } ] }, { "rule_id": 1, "rule_name": "nxtcloudAF", "ruleset": 1, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "osd" }, { "op": "emit" } ] } ] El 5/5/21 a las 12:58, Robert Sander escribió:
ceph osd crush rule dump
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Hi Andres, the crush rule with ID 1 distributes your EC chunks over the osds without considering the ceph host. As Robert already suspected. Greetings, Joachim ___________________________________ Clyso GmbH Homepage: https://www.clyso.com Am 05.05.2021 um 13:16 schrieb Andres Rojas Guerrero:
# ceph osd crush rule dump [ { "rule_id": 0, "rule_name": "replicated_rule", "ruleset": 0, "type": 1, "min_size": 1, "max_size": 10, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "chooseleaf_firstn", "num": 0, "type": "host" }, { "op": "emit" } ] }, { "rule_id": 1, "rule_name": "nxtcloudAF", "ruleset": 1, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "osd" }, { "op": "emit" } ] } ]
El 5/5/21 a las 12:58, Robert Sander escribió:
ceph osd crush rule dump
Hi, Am 05.05.21 um 13:39 schrieb Joachim Kraftmayer:
the crush rule with ID 1 distributes your EC chunks over the osds without considering the ceph host. As Robert already suspected.
Yes, the "nxtcloudAF" rule is not fault tolerant enough. Having the OSD as failure zone will lead to data loss or at least intermediate unavailability. The situation is now that all copies (resp. EC chunks) for a PG are stored on OSDs of the same host. These PGs will be unavailable if the host is down. Regards -- Robert Sander Heinlein Consulting GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-43 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin
Nice observation, how can avoid this problem? El 5/5/21 a las 14:54, Robert Sander escribió:
Hi,
Am 05.05.21 um 13:39 schrieb Joachim Kraftmayer:
the crush rule with ID 1 distributes your EC chunks over the osds without considering the ceph host. As Robert already suspected.
Yes, the "nxtcloudAF" rule is not fault tolerant enough. Having the OSD as failure zone will lead to data loss or at least intermediate unavailability.
The situation is now that all copies (resp. EC chunks) for a PG are stored on OSDs of the same host. These PGs will be unavailable if the host is down.
Regards
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Create a new crush rule with the correct failure domain, test it properly and assign it to the pool(s). -- Beste Grüße, Joachim Kraftmayer ___________________________________ Clyso GmbH Am 05.05.2021 um 15:11 schrieb Andres Rojas Guerrero:
Nice observation, how can avoid this problem?
El 5/5/21 a las 14:54, Robert Sander escribió:
Hi,
Am 05.05.21 um 13:39 schrieb Joachim Kraftmayer:
the crush rule with ID 1 distributes your EC chunks over the osds without considering the ceph host. As Robert already suspected.
Yes, the "nxtcloudAF" rule is not fault tolerant enough. Having the OSD as failure zone will lead to data loss or at least intermediate unavailability.
The situation is now that all copies (resp. EC chunks) for a PG are stored on OSDs of the same host. These PGs will be unavailable if the host is down.
Regards
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Thanks, I will test it. El 5/5/21 a las 16:37, Joachim Kraftmayer escribió:
Create a new crush rule with the correct failure domain, test it properly and assign it to the pool(s).
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Hi, I try to make a new crush rule (Nautilus) in order take the new correct_failure_domain to hosts: "rule_id": 2, "rule_name": "nxtcloudAFhost", "ruleset": 2, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "host" }, { "op": "emit" And I have changed the pool to this new crush rule: # ceph osd pool set nxtcloudAF crush_rule nxtcloudAFhost But suddenly the cephfs it's unavailable: # ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 11 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests And clients failing to respond: HEALTH_WARN 11 clients failing to respond to capability release; 2 MDSs report slow metadata IOs; 1 MDSs report slow requests MDS_CLIENT_LATE_RELEASE 11 clients failing to respond to capability release mdsceph2mon03(mds.1): Client nxtcl3: failing to respond to capability release client_id: 1524269 mdsceph2mon01(mds.0): Client nxtcl5:nxtclproAF failing to respond to I reversed the change, returning to the original crush rule, and all it's Ok. My question if it's possible to change on fly the crush rule of a EC pool. Thanks El 5/5/21 a las 18:14, Andres Rojas Guerrero escribió:
Thanks, I will test it.
El 5/5/21 a las 16:37, Joachim Kraftmayer escribió:
Create a new crush rule with the correct failure domain, test it properly and assign it to the pool(s).
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Yes it is possible, but you should validate it with crushtool before injecting it to make sure the PGs land where they belong. crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-mappings crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-bad-mappings If you don't get bad mappings and the 'show-mappings' confirms the PG distribution by host you can inject it. But be aware of a lot of data movement, that could explain the (temporarily) unavailable PGs. But to make your cluster resilient against host failure you'll have to go through that at some point. https://docs.ceph.com/en/latest/rados/operations/crush-map-edits/ Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
Hi, I try to make a new crush rule (Nautilus) in order take the new correct_failure_domain to hosts:
"rule_id": 2, "rule_name": "nxtcloudAFhost", "ruleset": 2, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "host" }, { "op": "emit"
And I have changed the pool to this new crush rule:
# ceph osd pool set nxtcloudAF crush_rule nxtcloudAFhost
But suddenly the cephfs it's unavailable:
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 11 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests
And clients failing to respond:
HEALTH_WARN 11 clients failing to respond to capability release; 2 MDSs report slow metadata IOs; 1 MDSs report slow requests MDS_CLIENT_LATE_RELEASE 11 clients failing to respond to capability release mdsceph2mon03(mds.1): Client nxtcl3: failing to respond to capability release client_id: 1524269 mdsceph2mon01(mds.0): Client nxtcl5:nxtclproAF failing to respond to
I reversed the change, returning to the original crush rule, and all it's Ok. My question if it's possible to change on fly the crush rule of a EC pool.
Thanks El 5/5/21 a las 18:14, Andres Rojas Guerrero escribió:
Thanks, I will test it.
El 5/5/21 a las 16:37, Joachim Kraftmayer escribió:
Create a new crush rule with the correct failure domain, test it properly and assign it to the pool(s).
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Ok, thank you very much for the answer. El 6/5/21 a las 13:47, Eugen Block escribió:
Yes it is possible, but you should validate it with crushtool before injecting it to make sure the PGs land where they belong.
crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-mappings crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-bad-mappings
If you don't get bad mappings and the 'show-mappings' confirms the PG distribution by host you can inject it. But be aware of a lot of data movement, that could explain the (temporarily) unavailable PGs. But to make your cluster resilient against host failure you'll have to go through that at some point.
https://docs.ceph.com/en/latest/rados/operations/crush-map-edits/
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
Hi, I try to make a new crush rule (Nautilus) in order take the new correct_failure_domain to hosts:
"rule_id": 2, "rule_name": "nxtcloudAFhost", "ruleset": 2, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "host" }, { "op": "emit"
And I have changed the pool to this new crush rule:
# ceph osd pool set nxtcloudAF crush_rule nxtcloudAFhost
But suddenly the cephfs it's unavailable:
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 11 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests
And clients failing to respond:
HEALTH_WARN 11 clients failing to respond to capability release; 2 MDSs report slow metadata IOs; 1 MDSs report slow requests MDS_CLIENT_LATE_RELEASE 11 clients failing to respond to capability release mdsceph2mon03(mds.1): Client nxtcl3: failing to respond to capability release client_id: 1524269 mdsceph2mon01(mds.0): Client nxtcl5:nxtclproAF failing to respond to
I reversed the change, returning to the original crush rule, and all it's Ok. My question if it's possible to change on fly the crush rule of a EC pool.
Thanks El 5/5/21 a las 18:14, Andres Rojas Guerrero escribió:
Thanks, I will test it.
El 5/5/21 a las 16:37, Joachim Kraftmayer escribió:
Create a new crush rule with the correct failure domain, test it properly and assign it to the pool(s).
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
I have this error when try to show mappings with crushtool: # crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f7f7a0ccb40 thread_name:crushtool El 6/5/21 a las 13:47, Eugen Block escribió:
Yes it is possible, but you should validate it with crushtool before injecting it to make sure the PGs land where they belong.
crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-mappings crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-bad-mappings
If you don't get bad mappings and the 'show-mappings' confirms the PG distribution by host you can inject it. But be aware of a lot of data movement, that could explain the (temporarily) unavailable PGs. But to make your cluster resilient against host failure you'll have to go through that at some point.
https://docs.ceph.com/en/latest/rados/operations/crush-map-edits/
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
Hi, I try to make a new crush rule (Nautilus) in order take the new correct_failure_domain to hosts:
"rule_id": 2, "rule_name": "nxtcloudAFhost", "ruleset": 2, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "host" }, { "op": "emit"
And I have changed the pool to this new crush rule:
# ceph osd pool set nxtcloudAF crush_rule nxtcloudAFhost
But suddenly the cephfs it's unavailable:
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 11 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests
And clients failing to respond:
HEALTH_WARN 11 clients failing to respond to capability release; 2 MDSs report slow metadata IOs; 1 MDSs report slow requests MDS_CLIENT_LATE_RELEASE 11 clients failing to respond to capability release mdsceph2mon03(mds.1): Client nxtcl3: failing to respond to capability release client_id: 1524269 mdsceph2mon01(mds.0): Client nxtcl5:nxtclproAF failing to respond to
I reversed the change, returning to the original crush rule, and all it's Ok. My question if it's possible to change on fly the crush rule of a EC pool.
Thanks El 5/5/21 a las 18:14, Andres Rojas Guerrero escribió:
Thanks, I will test it.
El 5/5/21 a las 16:37, Joachim Kraftmayer escribió:
Create a new crush rule with the correct failure domain, test it properly and assign it to the pool(s).
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Interesting, I haven't had that yet with crushtool. Your ceph version is Nautilus, right? And you did decompile the binary crushmap with crushtool, correct? I don't know how to reproduce that. Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
I have this error when try to show mappings with crushtool:
# crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f7f7a0ccb40 thread_name:crushtool
El 6/5/21 a las 13:47, Eugen Block escribió:
Yes it is possible, but you should validate it with crushtool before injecting it to make sure the PGs land where they belong.
crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-mappings crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-bad-mappings
If you don't get bad mappings and the 'show-mappings' confirms the PG distribution by host you can inject it. But be aware of a lot of data movement, that could explain the (temporarily) unavailable PGs. But to make your cluster resilient against host failure you'll have to go through that at some point.
https://docs.ceph.com/en/latest/rados/operations/crush-map-edits/
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
Hi, I try to make a new crush rule (Nautilus) in order take the new correct_failure_domain to hosts:
"rule_id": 2, "rule_name": "nxtcloudAFhost", "ruleset": 2, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "host" }, { "op": "emit"
And I have changed the pool to this new crush rule:
# ceph osd pool set nxtcloudAF crush_rule nxtcloudAFhost
But suddenly the cephfs it's unavailable:
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 11 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests
And clients failing to respond:
HEALTH_WARN 11 clients failing to respond to capability release; 2 MDSs report slow metadata IOs; 1 MDSs report slow requests MDS_CLIENT_LATE_RELEASE 11 clients failing to respond to capability release mdsceph2mon03(mds.1): Client nxtcl3: failing to respond to capability release client_id: 1524269 mdsceph2mon01(mds.0): Client nxtcl5:nxtclproAF failing to respond to
I reversed the change, returning to the original crush rule, and all it's Ok. My question if it's possible to change on fly the crush rule of a EC pool.
Thanks El 5/5/21 a las 18:14, Andres Rojas Guerrero escribió:
Thanks, I will test it.
El 5/5/21 a las 16:37, Joachim Kraftmayer escribió:
Create a new crush rule with the correct failure domain, test it properly and assign it to the pool(s).
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Yes, my ceph version is Nautilus: # ceph -v ceph version 14.2.6 (f0aa067ac7a02ee46ea48aa26c6e298b5ea272e9) nautilus (stable) First dump the crush map: # ceph osd getcrushmap -o crush_map Then, decompile the crush map: # crushtool -d crush_map -o crush_map_d Now, edit the crush rule and compile: # crushtool -c crush_map_d -o crush_map_new An finally test the mappings: # crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f2d717acb40 thread_name:crushtool El 6/5/21 a las 14:13, Eugen Block escribió:
Interesting, I haven't had that yet with crushtool. Your ceph version is Nautilus, right? And you did decompile the binary crushmap with crushtool, correct? I don't know how to reproduce that.
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
I have this error when try to show mappings with crushtool:
# crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f7f7a0ccb40 thread_name:crushtool
El 6/5/21 a las 13:47, Eugen Block escribió:
Yes it is possible, but you should validate it with crushtool before injecting it to make sure the PGs land where they belong.
crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-mappings crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-bad-mappings
If you don't get bad mappings and the 'show-mappings' confirms the PG distribution by host you can inject it. But be aware of a lot of data movement, that could explain the (temporarily) unavailable PGs. But to make your cluster resilient against host failure you'll have to go through that at some point.
https://docs.ceph.com/en/latest/rados/operations/crush-map-edits/
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
Hi, I try to make a new crush rule (Nautilus) in order take the new correct_failure_domain to hosts:
"rule_id": 2, "rule_name": "nxtcloudAFhost", "ruleset": 2, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "host" }, { "op": "emit"
And I have changed the pool to this new crush rule:
# ceph osd pool set nxtcloudAF crush_rule nxtcloudAFhost
But suddenly the cephfs it's unavailable:
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 11 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests
And clients failing to respond:
HEALTH_WARN 11 clients failing to respond to capability release; 2 MDSs report slow metadata IOs; 1 MDSs report slow requests MDS_CLIENT_LATE_RELEASE 11 clients failing to respond to capability release mdsceph2mon03(mds.1): Client nxtcl3: failing to respond to capability release client_id: 1524269 mdsceph2mon01(mds.0): Client nxtcl5:nxtclproAF failing to respond to
I reversed the change, returning to the original crush rule, and all it's Ok. My question if it's possible to change on fly the crush rule of a EC pool.
Thanks El 5/5/21 a las 18:14, Andres Rojas Guerrero escribió:
Thanks, I will test it.
El 5/5/21 a las 16:37, Joachim Kraftmayer escribió:
Create a new crush rule with the correct failure domain, test it properly and assign it to the pool(s).
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
Hi Andres, does the commando work with the original rule/crushmap? ___________________________________ Clyso GmbH - Ceph Foundation Member support@clyso.com https://www.clyso.com Am 06.05.2021 um 15:21 schrieb Andres Rojas Guerrero:
Yes, my ceph version is Nautilus:
# ceph -v ceph version 14.2.6 (f0aa067ac7a02ee46ea48aa26c6e298b5ea272e9) nautilus (stable)
First dump the crush map:
# ceph osd getcrushmap -o crush_map
Then, decompile the crush map:
# crushtool -d crush_map -o crush_map_d
Now, edit the crush rule and compile:
# crushtool -c crush_map_d -o crush_map_new
An finally test the mappings:
# crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f2d717acb40 thread_name:crushtool
El 6/5/21 a las 14:13, Eugen Block escribió:
Interesting, I haven't had that yet with crushtool. Your ceph version is Nautilus, right? And you did decompile the binary crushmap with crushtool, correct? I don't know how to reproduce that.
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
I have this error when try to show mappings with crushtool:
# crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f7f7a0ccb40 thread_name:crushtool
El 6/5/21 a las 13:47, Eugen Block escribió:
Yes it is possible, but you should validate it with crushtool before injecting it to make sure the PGs land where they belong.
crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-mappings crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-bad-mappings
If you don't get bad mappings and the 'show-mappings' confirms the PG distribution by host you can inject it. But be aware of a lot of data movement, that could explain the (temporarily) unavailable PGs. But to make your cluster resilient against host failure you'll have to go through that at some point.
https://docs.ceph.com/en/latest/rados/operations/crush-map-edits/
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
Hi, I try to make a new crush rule (Nautilus) in order take the new correct_failure_domain to hosts:
"rule_id": 2, "rule_name": "nxtcloudAFhost", "ruleset": 2, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "host" }, { "op": "emit"
And I have changed the pool to this new crush rule:
# ceph osd pool set nxtcloudAF crush_rule nxtcloudAFhost
But suddenly the cephfs it's unavailable:
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 11 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests
And clients failing to respond:
HEALTH_WARN 11 clients failing to respond to capability release; 2 MDSs report slow metadata IOs; 1 MDSs report slow requests MDS_CLIENT_LATE_RELEASE 11 clients failing to respond to capability release mdsceph2mon03(mds.1): Client nxtcl3: failing to respond to capability release client_id: 1524269 mdsceph2mon01(mds.0): Client nxtcl5:nxtclproAF failing to respond to
I reversed the change, returning to the original crush rule, and all it's Ok. My question if it's possible to change on fly the crush rule of a EC pool.
Thanks El 5/5/21 a las 18:14, Andres Rojas Guerrero escribió:
Thanks, I will test it.
El 5/5/21 a las 16:37, Joachim Kraftmayer escribió: > Create a new crush rule with the correct failure domain, test it > properly and assign it to the pool(s). >
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
No, it doesn't work with an unedit crush map file. El 6/5/21 a las 18:28, Clyso GmbH - Ceph Foundation Member escribió:
Hi Andres,
does the commando work with the original rule/crushmap?
___________________________________ Clyso GmbH - Ceph Foundation Member support@clyso.com https://www.clyso.com
Am 06.05.2021 um 15:21 schrieb Andres Rojas Guerrero:
Yes, my ceph version is Nautilus:
# ceph -v ceph version 14.2.6 (f0aa067ac7a02ee46ea48aa26c6e298b5ea272e9) nautilus (stable)
First dump the crush map:
# ceph osd getcrushmap -o crush_map
Then, decompile the crush map:
# crushtool -d crush_map -o crush_map_d
Now, edit the crush rule and compile:
# crushtool -c crush_map_d -o crush_map_new
An finally test the mappings:
# crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f2d717acb40 thread_name:crushtool
El 6/5/21 a las 14:13, Eugen Block escribió:
Interesting, I haven't had that yet with crushtool. Your ceph version is Nautilus, right? And you did decompile the binary crushmap with crushtool, correct? I don't know how to reproduce that.
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
I have this error when try to show mappings with crushtool:
# crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f7f7a0ccb40 thread_name:crushtool
El 6/5/21 a las 13:47, Eugen Block escribió:
Yes it is possible, but you should validate it with crushtool before injecting it to make sure the PGs land where they belong.
crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-mappings crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-bad-mappings
If you don't get bad mappings and the 'show-mappings' confirms the PG distribution by host you can inject it. But be aware of a lot of data movement, that could explain the (temporarily) unavailable PGs. But to make your cluster resilient against host failure you'll have to go through that at some point.
https://docs.ceph.com/en/latest/rados/operations/crush-map-edits/
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
Hi, I try to make a new crush rule (Nautilus) in order take the new correct_failure_domain to hosts:
"rule_id": 2, "rule_name": "nxtcloudAFhost", "ruleset": 2, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "host" }, { "op": "emit"
And I have changed the pool to this new crush rule:
# ceph osd pool set nxtcloudAF crush_rule nxtcloudAFhost
But suddenly the cephfs it's unavailable:
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 11 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests
And clients failing to respond:
HEALTH_WARN 11 clients failing to respond to capability release; 2 MDSs report slow metadata IOs; 1 MDSs report slow requests MDS_CLIENT_LATE_RELEASE 11 clients failing to respond to capability release mdsceph2mon03(mds.1): Client nxtcl3: failing to respond to capability release client_id: 1524269 mdsceph2mon01(mds.0): Client nxtcl5:nxtclproAF failing to respond to
I reversed the change, returning to the original crush rule, and all it's Ok. My question if it's possible to change on fly the crush rule of a EC pool.
Thanks El 5/5/21 a las 18:14, Andres Rojas Guerrero escribió: > Thanks, I will test it. > > El 5/5/21 a las 16:37, Joachim Kraftmayer escribió: >> Create a new crush rule with the correct failure domain, test it >> properly and assign it to the pool(s). >> >
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
But, it another cluster with version 14.2.16, it's working ... it's seems a problem of the version 14.2.6 ...? El 6/5/21 a las 18:28, Clyso GmbH - Ceph Foundation Member escribió:
Hi Andres,
does the commando work with the original rule/crushmap?
___________________________________ Clyso GmbH - Ceph Foundation Member support@clyso.com https://www.clyso.com
Am 06.05.2021 um 15:21 schrieb Andres Rojas Guerrero:
Yes, my ceph version is Nautilus:
# ceph -v ceph version 14.2.6 (f0aa067ac7a02ee46ea48aa26c6e298b5ea272e9) nautilus (stable)
First dump the crush map:
# ceph osd getcrushmap -o crush_map
Then, decompile the crush map:
# crushtool -d crush_map -o crush_map_d
Now, edit the crush rule and compile:
# crushtool -c crush_map_d -o crush_map_new
An finally test the mappings:
# crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f2d717acb40 thread_name:crushtool
El 6/5/21 a las 14:13, Eugen Block escribió:
Interesting, I haven't had that yet with crushtool. Your ceph version is Nautilus, right? And you did decompile the binary crushmap with crushtool, correct? I don't know how to reproduce that.
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
I have this error when try to show mappings with crushtool:
# crushtool -i crush_map_new --test --rule 2 --num-rep 7 --show-mappings CRUSH rule 2 x 0 [-5,-45,-49,-47,-43,-41,-29] *** Caught signal (Segmentation fault) ** in thread 7f7f7a0ccb40 thread_name:crushtool
El 6/5/21 a las 13:47, Eugen Block escribió:
Yes it is possible, but you should validate it with crushtool before injecting it to make sure the PGs land where they belong.
crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-mappings crushtool -i crushmap.bin --test --rule 2 --num-rep 7 --show-bad-mappings
If you don't get bad mappings and the 'show-mappings' confirms the PG distribution by host you can inject it. But be aware of a lot of data movement, that could explain the (temporarily) unavailable PGs. But to make your cluster resilient against host failure you'll have to go through that at some point.
https://docs.ceph.com/en/latest/rados/operations/crush-map-edits/
Zitat von Andres Rojas Guerrero <a.rojas@csic.es>:
Hi, I try to make a new crush rule (Nautilus) in order take the new correct_failure_domain to hosts:
"rule_id": 2, "rule_name": "nxtcloudAFhost", "ruleset": 2, "type": 3, "min_size": 3, "max_size": 7, "steps": [ { "op": "set_chooseleaf_tries", "num": 5 }, { "op": "set_choose_tries", "num": 100 }, { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_indep", "num": 0, "type": "host" }, { "op": "emit"
And I have changed the pool to this new crush rule:
# ceph osd pool set nxtcloudAF crush_rule nxtcloudAFhost
But suddenly the cephfs it's unavailable:
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 11 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests
And clients failing to respond:
HEALTH_WARN 11 clients failing to respond to capability release; 2 MDSs report slow metadata IOs; 1 MDSs report slow requests MDS_CLIENT_LATE_RELEASE 11 clients failing to respond to capability release mdsceph2mon03(mds.1): Client nxtcl3: failing to respond to capability release client_id: 1524269 mdsceph2mon01(mds.0): Client nxtcl5:nxtclproAF failing to respond to
I reversed the change, returning to the original crush rule, and all it's Ok. My question if it's possible to change on fly the crush rule of a EC pool.
Thanks El 5/5/21 a las 18:14, Andres Rojas Guerrero escribió: > Thanks, I will test it. > > El 5/5/21 a las 16:37, Joachim Kraftmayer escribió: >> Create a new crush rule with the correct failure domain, test it >> properly and assign it to the pool(s). >> >
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
I think that the recovery might be blocked due to all those PGs in inactive state: https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/4/html/ad... """ Inactive: Placement groups cannot process reads or writes because they are waiting for an OSD with the most up-to-date data to come back up. """ What is your pool configuration? And other configs? Can you send the output of "ceph config dump" and "osd pool detail"? On 05/05 11:00, Andres Rojas Guerrero wrote:
Yes, the principal problem is the MDS start to report slowly and the information is no longer accessible, and the cluster never recover.
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 2 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests 2 MDSs behind on trimming Reduced data availability: 238 pgs inactive, 8 pgs down, 230 pgs incomplete Degraded data redundancy: 1400453/220552172 objects degraded (0.635%), 461 pgs degraded, 464 pgs undersized 241 slow ops, oldest one blocked for 638 sec, daemons [osd.101,osd.127,osd.155,osd.166,osd.172,osd.189,osd.200,osd.210,osd.214,osd.233]... have slow ops.
services: mon: 3 daemons, quorum ceph2mon01,ceph2mon02,ceph2mon03 (age 25h) mgr: ceph2mon02(active, since 6d), standbys: ceph2mon01, ceph2mon03 mds: nxtclfs:2 {0=ceph2mon01=up:active,1=ceph2mon02=up:active} 1 up:standby osd: 768 osds: 736 up (since 11m), 736 in (since 95s); 416 remapped pgs
data: pools: 2 pools, 16384 pgs objects: 33.40M objects, 39 TiB usage: 63 TiB used, 2.6 PiB / 2.6 PiB avail pgs: 1.489% pgs not active 1400453/220552172 objects degraded (0.635%) 15676 active+clean 285 active+undersized+degraded+remapped+backfill_wait 230 incomplete 176 active+undersized+degraded+remapped+backfilling 8 down 6 peering 3 active+undersized+remapped
El 5/5/21 a las 10:54, David Caro escribió:
Can you share more information?
The output of 'ceph status' when the osd is down would help, also 'ceph health detail' could be useful.
On 05/05 10:48, Andres Rojas Guerrero wrote:
Hi, I have a Nautilus cluster version 14.2.6 , and I have noted that when some OSD go down the cluster doesn't start recover. I have checked that the option noout is unset.
What could be the reason for this behavior?
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
-- David Caro SRE - Cloud Services Wikimedia Foundation <https://wikimediafoundation.org/> PGP Signature: 7180 83A2 AC8B 314F B4CE 1171 4071 C7E1 D262 69C3 "Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment."
# ceph osd dump epoch 7668 fsid c74da5b8-3d1b-483e-8b3a-739134db6cf8 created 2019-10-28 15:57:50.962112 modified 2021-05-05 10:35:28.780920 flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit crush_version 419 full_ratio 0.95 backfillfull_ratio 0.9 nearfull_ratio 0.85 require_min_compat_client jewel min_compat_client jewel require_osd_release nautilus pool 3 'nxtcloudAF' erasure size 7 min_size 6 crush_rule 1 object_hash rjenkins pg_num 8192 pgp_num 8192 autoscale_mode warn last_change 1268 lfor 0/0/1227 flags hashpspool,ec_overwrites stripe_width 20480 application cephfs pool 5 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8192 pgp_num 8192 autoscale_mode warn last_change 1277 lfor 0/0/1275 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs max_osd 768 osd.0 up in weight 1 up_from 7660 up_thru 7662 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6802/6643,v1:10.100.190.41:6804/6643] [v2:10.100.188.22:6802/6643,v1:10.100.188.22:6805/6643] exists,up 85356a1d-d27f-4cee-b89d-cdc382426076 osd.1 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6809/6698,v1:10.100.190.40:6811/6698] [v2:10.100.188.21:6810/6698,v1:10.100.188.21:6811/6698] exists,up d8ff2664-2711-4d73-94b0-8e15619cbefe osd.2 up in weight 1 up_from 3661 up_thru 7660 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6802/16849,v1:10.100.190.42:6804/16849] [v2:10.100.188.23:6802/16849,v1:10.100.188.23:6803/16849] exists,up d043cba7-c7ea-4cca-ac2a-c529dabd7398 osd.3 up in weight 1 up_from 3746 up_thru 7662 down_at 3728 last_clean_interval [3330,3728) [v2:10.100.190.43:6843/14240,v1:10.100.190.43:6846/14240] [v2:10.100.188.24:6843/14240,v1:10.100.188.24:6846/14240] exists,up 9229ee17-d3d2-403b-810f-5ba72588b584 osd.4 up in weight 1 up_from 3762 up_thru 7664 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6832/14591,v1:10.100.190.44:6835/14591] [v2:10.100.188.25:6832/14591,v1:10.100.188.25:6835/14591] exists,up b90a663b-c7ff-4758-a25a-ff1585d577c6 osd.5 up in weight 1 up_from 3298 up_thru 7663 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6897/9630,v1:10.100.190.45:6902/9630] [v2:10.100.188.26:6897/9630,v1:10.100.188.26:6903/9630] exists,up 06887ff5-b3c4-4bf0-8f5c-13db434981ba osd.6 up in weight 1 up_from 2264 up_thru 7662 down_at 2263 last_clean_interval [2024,2257) [v2:10.100.190.46:6816/6770,v1:10.100.190.46:6817/6770] [v2:10.100.188.27:6816/6770,v1:10.100.188.27:6817/6770] exists,up befca5e0-ca82-4169-b6ce-5ec02f2d79b7 osd.7 up in weight 1 up_from 7547 up_thru 7661 down_at 7397 last_clean_interval [3148,7394) [v2:10.100.190.48:6805/6689,v1:10.100.190.48:6808/6689] [v2:10.100.188.29:6806/6689,v1:10.100.188.29:6809/6689] exists,up f91372f3-f8c6-4462-9c8f-e023bc3d8cdb osd.8 up in weight 1 up_from 2262 up_thru 7660 down_at 2256 last_clean_interval [2024,2254) [v2:10.100.190.47:6896/6679,v1:10.100.190.47:6897/6679] [v2:10.100.188.28:6896/6679,v1:10.100.188.28:6897/6679] exists,up eea99a63-e5c8-4a35-a0f0-d2e4ed24ba2e osd.9 up in weight 1 up_from 3233 up_thru 7660 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6898/9313,v1:10.100.190.49:6903/9313] [v2:10.100.188.30:6896/9313,v1:10.100.188.30:6902/9313] exists,up a9e32ab6-492f-4f60-a464-d7ffb46c6529 osd.10 up in weight 1 up_from 2263 up_thru 7662 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6835/6711,v1:10.100.190.50:6841/6711] [v2:10.100.188.31:6834/6711,v1:10.100.188.31:6841/6711] exists,up 364890b4-c302-488e-a9fd-4974d036cb6b osd.11 up in weight 1 up_from 2262 up_thru 7661 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6848/6698,v1:10.100.190.51:6856/6698] [v2:10.100.188.32:6850/6698,v1:10.100.188.32:6856/6698] exists,up 4dd98d8d-4ff7-49a3-92bb-358515b89707 osd.12 up in weight 1 up_from 2379 up_thru 7661 down_at 2043 last_clean_interval [2037,2041) [v2:10.100.190.52:6885/6742,v1:10.100.190.52:6896/6742] [v2:10.100.188.33:6883/6742,v1:10.100.188.33:6895/6742] exists,up 65ff6415-cb92-4328-882e-4673500375f2 osd.13 up in weight 1 up_from 2631 up_thru 7661 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6804/6809,v1:10.100.190.53:6805/6809] [v2:10.100.188.34:6804/6809,v1:10.100.188.34:6805/6809] exists,up 12feb1ae-bb6d-47ce-8524-231a3a3bc64c osd.14 up in weight 1 up_from 2261 up_thru 7661 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6897/6749,v1:10.100.190.54:6899/6749] [v2:10.100.188.35:6892/6749,v1:10.100.188.35:6898/6749] exists,up 77e7584d-854c-44c5-be38-286c1a6d51c9 osd.15 up in weight 1 up_from 2262 up_thru 7662 down_at 2096 last_clean_interval [2037,2078) [v2:10.100.190.55:6816/6662,v1:10.100.190.55:6817/6662] [v2:10.100.188.36:6816/6662,v1:10.100.188.36:6817/6662] exists,up be617b03-b8c6-417c-83e1-431c19612d8d osd.16 up in weight 1 up_from 2939 up_thru 7662 down_at 2161 last_clean_interval [2036,2149) [v2:10.100.190.56:6826/6679,v1:10.100.190.56:6827/6679] [v2:10.100.188.37:6826/6679,v1:10.100.188.37:6827/6679] exists,up 31283a31-f3d0-4f34-b2cd-9daabd870811 osd.17 up in weight 1 up_from 2260 up_thru 7660 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6860/6763,v1:10.100.190.57:6861/6763] [v2:10.100.188.38:6860/6763,v1:10.100.188.38:6861/6763] exists,up 4c5cad0f-2bbb-4290-bb4a-4c9e5e2a7689 osd.18 up in weight 1 up_from 2264 up_thru 7662 down_at 2096 last_clean_interval [1911,2078) [v2:10.100.190.58:6858/6677,v1:10.100.190.58:6859/6677] [v2:10.100.188.39:6858/6677,v1:10.100.188.39:6859/6677] exists,up ad8bd346-89ae-44d9-8df5-730c96801456 osd.19 up in weight 1 up_from 2260 up_thru 7660 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6800/6732,v1:10.100.190.59:6802/6732] [v2:10.100.188.40:6800/6732,v1:10.100.188.40:6801/6732] exists,up 0428d5c9-d941-4440-8cae-a7e342b1777c osd.20 up in weight 1 up_from 7558 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6853/6610,v1:10.100.190.40:6857/6610] [v2:10.100.188.21:6852/6610,v1:10.100.188.21:6859/6610] exists,up 0d795540-ee0a-4038-a0b5-9fcfcf8a921b osd.21 up in weight 1 up_from 7661 up_thru 7662 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6892/6669,v1:10.100.190.41:6906/6669] [v2:10.100.188.22:6898/6669,v1:10.100.188.22:6908/6669] exists,up af89e3f0-db58-4b22-8fd6-dd83548a4082 osd.22 up in weight 1 up_from 3660 up_thru 7662 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6853/17095,v1:10.100.190.42:6858/17095] [v2:10.100.188.23:6853/17095,v1:10.100.188.23:6857/17095] exists,up 3952a347-eca8-4e94-9a22-d2e2aa7cbb9e osd.23 up in weight 1 up_from 3744 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6819/14183,v1:10.100.190.43:6821/14183] [v2:10.100.188.24:6819/14183,v1:10.100.188.24:6820/14183] exists,up 4c1f6fcb-3a67-46ec-893f-5c57ca6a669f osd.24 up in weight 1 up_from 3761 up_thru 7665 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6800/14456,v1:10.100.190.44:6801/14456] [v2:10.100.188.25:6800/14456,v1:10.100.188.25:6801/14456] exists,up b96b27d3-0d83-4d79-a539-21f572e29fa5 osd.25 up in weight 1 up_from 3298 up_thru 7661 down_at 2263 last_clean_interval [2023,2257) [v2:10.100.190.45:6850/9579,v1:10.100.190.45:6855/9579] [v2:10.100.188.26:6853/9579,v1:10.100.188.26:6857/9579] exists,up 0c4e3de7-10ba-46a6-bc93-086c8a42967b osd.26 up in weight 1 up_from 2261 up_thru 7664 down_at 2260 last_clean_interval [2023,2257) [v2:10.100.190.46:6822/6672,v1:10.100.190.46:6823/6672] [v2:10.100.188.27:6822/6672,v1:10.100.188.27:6824/6672] exists,up 644b0c46-d335-4e6d-8e2f-5424fb3c64b3 osd.27 up in weight 1 up_from 7548 up_thru 7661 down_at 7396 last_clean_interval [3150,7394) [v2:10.100.190.48:6816/6756,v1:10.100.190.48:6820/6756] [v2:10.100.188.29:6816/6756,v1:10.100.188.29:6818/6756] exists,up 3b964690-ff8d-4446-8efc-ed9acfe26a60 osd.28 up in weight 1 up_from 2262 up_thru 7662 down_at 2256 last_clean_interval [2024,2254) [v2:10.100.190.47:6824/6620,v1:10.100.190.47:6832/6620] [v2:10.100.188.28:6824/6620,v1:10.100.188.28:6827/6620] exists,up f386d4bd-aacd-46fc-bc07-f3b0cd2d03dd osd.29 up in weight 1 up_from 3233 up_thru 7661 down_at 2228 last_clean_interval [2023,2209) [v2:10.100.190.49:6875/9333,v1:10.100.190.49:6878/9333] [v2:10.100.188.30:6875/9333,v1:10.100.188.30:6877/9333] exists,up fa8c07fa-8325-4caa-886c-8aec03a57c29 osd.30 up in weight 1 up_from 2263 up_thru 7663 down_at 2079 last_clean_interval [2037,2060) [v2:10.100.190.50:6816/6685,v1:10.100.190.50:6817/6685] [v2:10.100.188.31:6816/6685,v1:10.100.188.31:6817/6685] exists,up a1c9e324-8d45-4123-810c-7e0315b13204 osd.31 up in weight 1 up_from 2631 up_thru 7662 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6864/6813,v1:10.100.190.53:6868/6813] [v2:10.100.188.34:6861/6813,v1:10.100.188.34:6864/6813] exists,up 5b91cabd-af85-45b0-8f24-c9156a1e6b5c osd.32 up in weight 1 up_from 2380 up_thru 7662 down_at 2042 last_clean_interval [2038,2041) [v2:10.100.190.52:6879/6641,v1:10.100.190.52:6887/6641] [v2:10.100.188.33:6886/6641,v1:10.100.188.33:6891/6641] exists,up 5b4a7b2c-ab35-403b-9958-09026f08f191 osd.33 up in weight 1 up_from 2264 up_thru 7660 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6886/6743,v1:10.100.190.51:6890/6743] [v2:10.100.188.32:6884/6743,v1:10.100.188.32:6889/6743] exists,up 07923f3a-361e-4ef3-952a-39b9821cdd20 osd.34 up in weight 1 up_from 2263 up_thru 7661 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6808/6621,v1:10.100.190.54:6809/6621] [v2:10.100.188.35:6808/6621,v1:10.100.188.35:6809/6621] exists,up 5bb69410-fa69-4c39-99ec-aac2f540fef1 osd.35 up in weight 1 up_from 2263 up_thru 7661 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6892/6762,v1:10.100.190.55:6894/6762] [v2:10.100.188.36:6891/6762,v1:10.100.188.36:6895/6762] exists,up 287b1496-b9a3-4c2b-8cc0-b1e613214abd osd.36 up in weight 1 up_from 2940 up_thru 7662 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6851/6694,v1:10.100.190.56:6870/6694] [v2:10.100.188.37:6865/6694,v1:10.100.188.37:6869/6694] exists,up 369e483d-7eee-420d-bdc6-aa474207f345 osd.37 up in weight 1 up_from 2260 up_thru 7661 down_at 2110 last_clean_interval [2038,2102) [v2:10.100.190.57:6803/6734,v1:10.100.190.57:6806/6734] [v2:10.100.188.38:6803/6734,v1:10.100.188.38:6805/6734] exists,up 0010c682-4047-4053-be67-4339cf2d8e6c osd.38 up in weight 1 up_from 2265 up_thru 7663 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6869/6652,v1:10.100.190.58:6871/6652] [v2:10.100.188.39:6870/6652,v1:10.100.188.39:6871/6652] exists,up 0c250aa2-a998-4f30-a14a-3d65f60dcb05 osd.39 up in weight 1 up_from 2264 up_thru 7661 down_at 2238 last_clean_interval [1905,2220) [v2:10.100.190.59:6835/6705,v1:10.100.190.59:6837/6705] [v2:10.100.188.40:6835/6705,v1:10.100.188.40:6837/6705] exists,up d9719aed-c61c-42e0-be70-e75f5b75d9a1 osd.40 up in weight 1 up_from 7558 up_thru 7661 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6892/6666,v1:10.100.190.40:6903/6666] [v2:10.100.188.21:6895/6666,v1:10.100.188.21:6900/6666] exists,up 2e6d6d56-2736-4875-9f95-99919b8f1adb osd.41 up in weight 1 up_from 7660 up_thru 7663 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6838/6684,v1:10.100.190.41:6845/6684] [v2:10.100.188.22:6839/6684,v1:10.100.188.22:6845/6684] exists,up 7b460f7e-8703-4656-bee6-5e5a5f6cd110 osd.42 up in weight 1 up_from 3762 up_thru 7661 down_at 3748 last_clean_interval [3425,3747) [v2:10.100.190.44:6812/14513,v1:10.100.190.44:6813/14513] [v2:10.100.188.25:6812/14513,v1:10.100.188.25:6813/14513] exists,up 59d588cc-3820-4ec4-b603-44838f4bbed1 osd.43 up in weight 1 up_from 3746 up_thru 7660 down_at 3728 last_clean_interval [3330,3727) [v2:10.100.190.43:6828/14210,v1:10.100.190.43:6829/14210] [v2:10.100.188.24:6828/14210,v1:10.100.188.24:6829/14210] exists,up bfe7c2b5-4871-4881-bb07-a4446e43a38c osd.44 up in weight 1 up_from 3661 up_thru 7662 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6880/17115,v1:10.100.190.42:6886/17115] [v2:10.100.188.23:6882/17115,v1:10.100.188.23:6889/17115] exists,up 837d9987-a396-4fd6-ad30-81b3ebe5c21e osd.45 up in weight 1 up_from 7547 up_thru 7662 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6890/6680,v1:10.100.190.48:6898/6680] [v2:10.100.188.29:6890/6680,v1:10.100.188.29:6897/6680] exists,up 3aa4ba70-2365-4728-bd22-29b2a65cf13c osd.46 up in weight 1 up_from 3298 up_thru 7660 down_at 2263 last_clean_interval [2023,2257) [v2:10.100.190.45:6899/9618,v1:10.100.190.45:6903/9618] [v2:10.100.188.26:6899/9618,v1:10.100.188.26:6902/9618] exists,up 52b1e49e-a97b-4ef6-9e2f-e037ab9d58a3 osd.47 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6835/6669,v1:10.100.190.46:6842/6669] [v2:10.100.188.27:6839/6669,v1:10.100.188.27:6843/6669] exists,up 3e2d0dac-47d2-4453-b014-711efdea3db7 osd.48 up in weight 1 up_from 2261 up_thru 7662 down_at 2260 last_clean_interval [2023,2254) [v2:10.100.190.47:6831/6604,v1:10.100.190.47:6846/6604] [v2:10.100.188.28:6841/6604,v1:10.100.188.28:6846/6604] exists,up 1517cbce-c196-4dd4-9243-3ab532771a51 osd.49 up in weight 1 up_from 3232 up_thru 7661 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6847/9291,v1:10.100.190.49:6851/9291] [v2:10.100.188.30:6847/9291,v1:10.100.188.30:6851/9291] exists,up 11468520-4162-44d1-bc1a-7fe15c0f85e7 osd.50 up in weight 1 up_from 2263 up_thru 7662 down_at 2079 last_clean_interval [2037,2060) [v2:10.100.190.50:6848/6613,v1:10.100.190.50:6851/6613] [v2:10.100.188.31:6848/6613,v1:10.100.188.31:6851/6613] exists,up 276f3280-db19-4949-ae74-481243cf260c osd.51 up in weight 1 up_from 2260 up_thru 7662 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6808/6715,v1:10.100.190.51:6811/6715] [v2:10.100.188.32:6810/6715,v1:10.100.188.32:6811/6715] exists,up 72283398-ede1-4f24-a798-3d5c4b0605d1 osd.52 up in weight 1 up_from 2379 up_thru 7662 down_at 2043 last_clean_interval [2038,2041) [v2:10.100.190.52:6805/6730,v1:10.100.190.52:6808/6730] [v2:10.100.188.33:6807/6730,v1:10.100.188.33:6809/6730] exists,up fa3d8d99-c087-42b9-9ea8-f12b68f38188 osd.53 up in weight 1 up_from 2630 up_thru 7660 down_at 2048 last_clean_interval [2035,2047) [v2:10.100.190.53:6853/6738,v1:10.100.190.53:6858/6738] [v2:10.100.188.34:6853/6738,v1:10.100.188.34:6857/6738] exists,up fe737ca5-17ed-44ff-b52d-d4abe3270485 osd.54 up in weight 1 up_from 2263 up_thru 7663 down_at 2051 last_clean_interval [2037,2049) [v2:10.100.190.54:6851/6702,v1:10.100.190.54:6856/6702] [v2:10.100.188.35:6853/6702,v1:10.100.188.35:6858/6702] exists,up eaa3fd61-1645-433d-950d-0ddc9f1bb50d osd.55 up in weight 1 up_from 2262 up_thru 7661 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6822/6690,v1:10.100.190.55:6829/6690] [v2:10.100.188.36:6823/6690,v1:10.100.188.36:6828/6690] exists,up 665194fe-60da-464c-811d-97893102c38d osd.56 up in weight 1 up_from 2272 up_thru 7662 down_at 2109 last_clean_interval [2037,2102) [v2:10.100.190.57:6914/6721,v1:10.100.190.57:6917/6721] [v2:10.100.188.38:6915/6721,v1:10.100.188.38:6917/6721] exists,up a249813e-bc2c-493b-9386-c3e8cc856f33 osd.57 up in weight 1 up_from 2265 up_thru 7665 down_at 2096 last_clean_interval [1909,2078) [v2:10.100.190.58:6890/6668,v1:10.100.190.58:6894/6668] [v2:10.100.188.39:6892/6668,v1:10.100.188.39:6895/6668] exists,up 8165cb74-f728-4e14-924d-57c66e9d6f2d osd.58 up in weight 1 up_from 2939 up_thru 7662 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6806/6630,v1:10.100.190.56:6809/6630] [v2:10.100.188.37:6807/6630,v1:10.100.188.37:6809/6630] exists,up bbfcba28-76e7-4d34-9098-9a03d1b7146b osd.59 up in weight 1 up_from 2262 up_thru 7661 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6880/6746,v1:10.100.190.59:6882/6746] [v2:10.100.188.40:6880/6746,v1:10.100.188.40:6884/6746] exists,up dabbd4d1-ea44-47bb-88a2-bbe71a6070fe osd.60 up in weight 1 up_from 7559 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6891/6733,v1:10.100.190.40:6897/6733] [v2:10.100.188.21:6887/6733,v1:10.100.188.21:6890/6733] exists,up 0eef4956-f942-4dac-8275-4b1485b947be osd.61 up in weight 1 up_from 3745 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6888/14412,v1:10.100.190.43:6890/14412] [v2:10.100.188.24:6888/14412,v1:10.100.188.24:6889/14412] exists,up e5c59316-d3c6-4c76-98f2-521217a418e3 osd.62 up in weight 1 up_from 7662 up_thru 7665 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6841/6640,v1:10.100.190.41:6847/6640] [v2:10.100.188.22:6840/6640,v1:10.100.188.22:6846/6640] exists,up 73263a0a-cb9c-4876-a1ce-71f4cada4311 osd.63 up in weight 1 up_from 3659 up_thru 7661 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6828/17047,v1:10.100.190.42:6829/17047] [v2:10.100.188.23:6828/17047,v1:10.100.188.23:6829/17047] exists,up f3723126-2aa6-4971-a622-9dcd8d4bf894 osd.64 up in weight 1 up_from 3763 up_thru 7662 down_at 3748 last_clean_interval [3427,3747) [v2:10.100.190.44:6855/14649,v1:10.100.190.44:6861/14649] [v2:10.100.188.25:6857/14649,v1:10.100.188.25:6860/14649] exists,up 55a176f3-a12d-4411-a5b0-970a26538e89 osd.65 up in weight 1 up_from 7547 up_thru 7663 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6846/6792,v1:10.100.190.48:6848/6792] [v2:10.100.188.29:6844/6792,v1:10.100.188.29:6846/6792] exists,up 4bc927f2-c951-4014-a213-79ca9fde54bc osd.66 up in weight 1 up_from 3296 up_thru 7663 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6830/9591,v1:10.100.190.45:6834/9591] [v2:10.100.188.26:6830/9591,v1:10.100.188.26:6832/9591] exists,up 729fe977-e995-4e50-8401-265383a3a4c2 osd.67 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6834/6783,v1:10.100.190.46:6840/6783] [v2:10.100.188.27:6833/6783,v1:10.100.188.27:6837/6783] exists,up 9ad26596-524b-4d1e-b2b6-3d8cc3a1dfc4 osd.68 up in weight 1 up_from 2262 up_thru 7665 down_at 2255 last_clean_interval [2023,2254) [v2:10.100.190.47:6849/6669,v1:10.100.190.47:6857/6669] [v2:10.100.188.28:6852/6669,v1:10.100.188.28:6857/6669] exists,up dc4e2c53-ce7e-43e9-a385-beeb728dafc5 osd.69 up in weight 1 up_from 2263 up_thru 7661 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6819/6672,v1:10.100.190.50:6821/6672] [v2:10.100.188.31:6819/6672,v1:10.100.188.31:6822/6672] exists,up f4573e79-02e8-4089-8cc7-72e47d938fdb osd.70 up in weight 1 up_from 3232 up_thru 7662 down_at 2230 last_clean_interval [2023,2209) [v2:10.100.190.49:6824/9307,v1:10.100.190.49:6825/9307] [v2:10.100.188.30:6824/9307,v1:10.100.188.30:6825/9307] exists,up 988f2dfb-6b22-42b4-8a74-0b1cc6f699ae osd.71 up in weight 1 up_from 2380 up_thru 7664 down_at 2042 last_clean_interval [2038,2041) [v2:10.100.190.52:6878/6676,v1:10.100.190.52:6889/6676] [v2:10.100.188.33:6879/6676,v1:10.100.188.33:6889/6676] exists,up 60d8945d-4675-45f5-9a17-8a22c88f39c1 osd.72 up in weight 1 up_from 2263 up_thru 7663 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6820/6675,v1:10.100.190.51:6821/6675] [v2:10.100.188.32:6820/6675,v1:10.100.188.32:6821/6675] exists,up 298562cb-a376-4a9f-97d8-5c6177183f32 osd.73 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6892/6818,v1:10.100.190.53:6901/6818] [v2:10.100.188.34:6896/6818,v1:10.100.188.34:6904/6818] exists,up dc52057b-20d6-4d39-870d-c899a28cc107 osd.74 up in weight 1 up_from 2261 up_thru 7661 down_at 2050 last_clean_interval [2031,2049) [v2:10.100.190.54:6854/6698,v1:10.100.190.54:6859/6698] [v2:10.100.188.35:6852/6698,v1:10.100.188.35:6857/6698] exists,up 147a2083-cb2a-4872-80be-5e7cedde3bdd osd.75 up in weight 1 up_from 2264 up_thru 7662 down_at 2095 last_clean_interval [2035,2078) [v2:10.100.190.55:6851/6637,v1:10.100.190.55:6854/6637] [v2:10.100.188.36:6852/6637,v1:10.100.188.36:6854/6637] exists,up e548f6dd-d03b-4e80-967e-c359331007da osd.76 up in weight 1 up_from 2265 up_thru 7662 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6908/6683,v1:10.100.190.58:6909/6683] [v2:10.100.188.39:6908/6683,v1:10.100.188.39:6909/6683] exists,up e0ecedda-0395-4f29-82db-c3d4773e3fe1 osd.77 up in weight 1 up_from 2940 up_thru 7663 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6855/6640,v1:10.100.190.56:6876/6640] [v2:10.100.188.37:6870/6640,v1:10.100.188.37:6877/6640] exists,up 364a211e-0f6a-4d6e-bfcd-1d05c7bc09f1 osd.78 up in weight 1 up_from 2262 up_thru 7661 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6863/6692,v1:10.100.190.57:6874/6692] [v2:10.100.188.38:6870/6692,v1:10.100.188.38:6877/6692] exists,up 5346f326-f74f-4855-9cc2-dd59854a5c2e osd.79 up in weight 1 up_from 2264 up_thru 7664 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6872/6687,v1:10.100.190.59:6876/6687] [v2:10.100.188.40:6873/6687,v1:10.100.188.40:6878/6687] exists,up 49213252-a2e0-4607-957a-383b0c25a76f osd.80 up in weight 1 up_from 7559 up_thru 7664 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6850/6741,v1:10.100.190.40:6855/6741] [v2:10.100.188.21:6851/6741,v1:10.100.188.21:6856/6741] exists,up d48fce2f-8f71-4150-8cd1-f909bdcb46c9 osd.81 up in weight 1 up_from 3743 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6812/14185,v1:10.100.190.43:6813/14185] [v2:10.100.188.24:6812/14185,v1:10.100.188.24:6813/14185] exists,up d2edeee9-4fbc-4bc3-98e0-5862e0fb193e osd.82 up in weight 1 up_from 3762 up_thru 7661 down_at 3748 last_clean_interval [3425,3747) [v2:10.100.190.44:6884/14565,v1:10.100.190.44:6891/14565] [v2:10.100.188.25:6884/14565,v1:10.100.188.25:6892/14565] exists,up cd6f1ba6-ffe8-4f1f-9ab3-d01142ac16bf osd.83 up in weight 1 up_from 3659 up_thru 7662 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6824/16879,v1:10.100.190.42:6825/16879] [v2:10.100.188.23:6824/16879,v1:10.100.188.23:6825/16879] exists,up b8215792-19a4-4669-9eda-0f4fd99096e9 osd.84 up in weight 1 up_from 7547 up_thru 7662 down_at 7397 last_clean_interval [3150,7394) [v2:10.100.190.48:6832/6693,v1:10.100.190.48:6837/6693] [v2:10.100.188.29:6834/6693,v1:10.100.188.29:6836/6693] exists,up 8577c9f8-1e4d-4db2-b018-4c999fa4ff3b osd.85 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6820/6675,v1:10.100.190.46:6821/6675] [v2:10.100.188.27:6820/6675,v1:10.100.188.27:6821/6675] exists,up 5924ff8f-a074-4fa8-9add-3900668bdd3a osd.86 up in weight 1 up_from 3297 up_thru 7628 down_at 2263 last_clean_interval [2023,2257) [v2:10.100.190.45:6828/9612,v1:10.100.190.45:6829/9612] [v2:10.100.188.26:6828/9612,v1:10.100.188.26:6829/9612] exists,up 38c6c83f-98a7-47ff-84dc-eb65ebcb5879 osd.87 up in weight 1 up_from 7660 up_thru 7665 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6891/6591,v1:10.100.190.41:6908/6591] [v2:10.100.188.22:6897/6591,v1:10.100.188.22:6907/6591] exists,up fe067aab-3596-4134-879e-ce54a3aa1025 osd.88 up in weight 1 up_from 2261 up_thru 7662 down_at 2260 last_clean_interval [2024,2254) [v2:10.100.190.47:6827/6718,v1:10.100.190.47:6839/6718] [v2:10.100.188.28:6829/6718,v1:10.100.188.28:6839/6718] exists,up 0a7aea37-fb47-4d6e-883f-f6cd8f3afdf9 osd.89 up in weight 1 up_from 2263 up_thru 7662 down_at 2079 last_clean_interval [2036,2060) [v2:10.100.190.50:6884/6622,v1:10.100.190.50:6889/6622] [v2:10.100.188.31:6885/6622,v1:10.100.188.31:6889/6622] exists,up cbe2b190-7393-4d93-a175-298f47feca45 osd.90 up in weight 1 up_from 3233 up_thru 7663 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6808/9283,v1:10.100.190.49:6809/9283] [v2:10.100.188.30:6808/9283,v1:10.100.188.30:6809/9283] exists,up 44addcc1-fb83-4fe8-866f-d36b5ef9cc47 osd.91 up in weight 1 up_from 2380 up_thru 7662 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6884/6734,v1:10.100.190.52:6892/6734] [v2:10.100.188.33:6884/6734,v1:10.100.188.33:6896/6734] exists,up 874bbc77-e621-43c7-a098-2030fb0ec1ff osd.92 up in weight 1 up_from 2630 up_thru 7663 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6883/6725,v1:10.100.190.53:6897/6725] [v2:10.100.188.34:6885/6725,v1:10.100.188.34:6894/6725] exists,up 98994518-dfa8-4032-bc0f-85979fd0e93f osd.93 up in weight 1 up_from 2264 up_thru 7665 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6823/6710,v1:10.100.190.51:6827/6710] [v2:10.100.188.32:6824/6710,v1:10.100.188.32:6827/6710] exists,up 12b101f8-28bb-473f-ad31-96df8abd4b80 osd.94 up in weight 1 up_from 2263 up_thru 7661 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6881/6643,v1:10.100.190.54:6890/6643] [v2:10.100.188.35:6879/6643,v1:10.100.188.35:6888/6643] exists,up 9ca3c79d-a7b1-472b-845d-c405b205ba9d osd.95 up in weight 1 up_from 2263 up_thru 7661 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6802/6754,v1:10.100.190.55:6804/6754] [v2:10.100.188.36:6802/6754,v1:10.100.188.36:6804/6754] exists,up 10326d76-6c62-4d75-8455-b777639b9b90 osd.96 up in weight 1 up_from 2940 up_thru 7661 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6822/6599,v1:10.100.190.56:6823/6599] [v2:10.100.188.37:6822/6599,v1:10.100.188.37:6823/6599] exists,up 16e195b5-25b5-468a-b6a4-ab8485c1a981 osd.97 up in weight 1 up_from 2263 up_thru 7661 down_at 2096 last_clean_interval [1911,2078) [v2:10.100.190.58:6807/6693,v1:10.100.190.58:6814/6693] [v2:10.100.188.39:6809/6693,v1:10.100.188.39:6813/6693] exists,up b94d83f9-4fcb-4632-8893-2dcff58f73cb osd.98 up in weight 1 up_from 2260 up_thru 7662 down_at 2109 last_clean_interval [2037,2102) [v2:10.100.190.57:6800/6755,v1:10.100.190.57:6801/6755] [v2:10.100.188.38:6800/6755,v1:10.100.188.38:6801/6755] exists,up ecd51081-dd6b-49b4-8e41-3e8ead2b8ac0 osd.99 up in weight 1 up_from 2264 up_thru 7663 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6924/6655,v1:10.100.190.59:6925/6655] [v2:10.100.188.40:6924/6655,v1:10.100.188.40:6925/6655] exists,up 1d2ac88d-7b70-4ae4-aedb-e935c441bd49 osd.100 up in weight 1 up_from 3764 up_thru 7661 down_at 3748 last_clean_interval [3425,3748) [v2:10.100.190.44:6882/14596,v1:10.100.190.44:6890/14596] [v2:10.100.188.25:6882/14596,v1:10.100.188.25:6890/14596] exists,up a800f420-b367-4573-8551-6738c8fee7d5 osd.101 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6862/6669,v1:10.100.190.40:6865/6669] [v2:10.100.188.21:6862/6669,v1:10.100.188.21:6867/6669] exists,up ea743dab-a8b3-492f-9618-a81b57f4e388 osd.102 up in weight 1 up_from 3746 up_thru 7661 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6850/14278,v1:10.100.190.43:6855/14278] [v2:10.100.188.24:6851/14278,v1:10.100.188.24:6855/14278] exists,up 413cbf05-876e-487b-93be-6d349d0b3473 osd.103 up in weight 1 up_from 3661 up_thru 7662 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6884/17147,v1:10.100.190.42:6891/17147] [v2:10.100.188.23:6888/17147,v1:10.100.188.23:6891/17147] exists,up 47999851-3875-44e4-9d6f-e2cad4f9923f osd.104 up in weight 1 up_from 7548 up_thru 7571 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6825/6717,v1:10.100.190.48:6829/6717] [v2:10.100.188.29:6825/6717,v1:10.100.188.29:6827/6717] exists,up a3f7dd33-6f86-45f3-8894-d768795d1294 osd.105 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.46:6844/6712,v1:10.100.190.46:6848/6712] [v2:10.100.188.27:6844/6712,v1:10.100.188.27:6848/6712] exists,up ef9fa087-f9be-476d-90c5-2bf397d4bbcf osd.106 up in weight 1 up_from 3298 up_thru 7663 down_at 2263 last_clean_interval [2024,2257) [v2:10.100.190.45:6863/9606,v1:10.100.190.45:6869/9606] [v2:10.100.188.26:6862/9606,v1:10.100.188.26:6868/9606] exists,up 5e1cac22-fe72-4151-814b-74ae970db64f osd.107 up in weight 1 up_from 2263 up_thru 7660 down_at 2079 last_clean_interval [2036,2060) [v2:10.100.190.50:6875/6698,v1:10.100.190.50:6880/6698] [v2:10.100.188.31:6876/6698,v1:10.100.188.31:6882/6698] exists,up 7515b868-0c1a-4be7-952b-b1b8f22d8033 osd.108 up in weight 1 up_from 2262 up_thru 7664 down_at 2256 last_clean_interval [2024,2254) [v2:10.100.190.47:6898/6704,v1:10.100.190.47:6900/6704] [v2:10.100.188.28:6899/6704,v1:10.100.188.28:6901/6704] exists,up 971892a9-87a5-4bfa-8ad5-94d5d4d6475c osd.109 up in weight 1 up_from 3232 up_thru 7661 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6830/9297,v1:10.100.190.49:6832/9297] [v2:10.100.188.30:6830/9297,v1:10.100.188.30:6832/9297] exists,up b8212163-8f55-431b-8890-a36c990047c7 osd.110 up in weight 1 up_from 7662 up_thru 7663 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6895/6636,v1:10.100.190.41:6907/6636] [v2:10.100.188.22:6899/6636,v1:10.100.188.22:6909/6636] exists,up f6cbf4ee-734b-40e7-a7d2-e16f27a8991a osd.111 up in weight 1 up_from 2379 up_thru 7662 down_at 2042 last_clean_interval [2029,2041) [v2:10.100.190.52:6886/6782,v1:10.100.190.52:6895/6782] [v2:10.100.188.33:6881/6782,v1:10.100.188.33:6890/6782] exists,up 2ceb359c-587c-4493-b350-c8511a3942d8 osd.112 up in weight 1 up_from 2263 up_thru 7661 down_at 2051 last_clean_interval [2036,2049) [v2:10.100.190.54:6882/6640,v1:10.100.190.54:6893/6640] [v2:10.100.188.35:6876/6640,v1:10.100.188.35:6887/6640] exists,up aafe13d7-d743-41b2-98e2-83215a4f6fa8 osd.113 up in weight 1 up_from 2262 up_thru 7660 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6808/6658,v1:10.100.190.55:6810/6658] [v2:10.100.188.36:6808/6658,v1:10.100.188.36:6811/6658] exists,up 159a0c11-8265-4d9d-b84a-11a6c30c6f5a osd.114 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6822/6772,v1:10.100.190.53:6823/6772] [v2:10.100.188.34:6822/6772,v1:10.100.188.34:6823/6772] exists,up e09be275-7c0e-493a-b6c8-2670a34c1291 osd.115 up in weight 1 up_from 2263 up_thru 7661 down_at 2045 last_clean_interval [2038,2044) [v2:10.100.190.51:6904/6656,v1:10.100.190.51:6912/6656] [v2:10.100.188.32:6906/6656,v1:10.100.188.32:6910/6656] exists,up 0550b9f4-5ecc-4dc8-9ca4-e06475d63776 osd.116 up in weight 1 up_from 2940 up_thru 7661 down_at 2161 last_clean_interval [2036,2149) [v2:10.100.190.56:6890/6626,v1:10.100.190.56:6900/6626] [v2:10.100.188.37:6897/6626,v1:10.100.188.37:6899/6626] exists,up fef257d4-3989-4592-9822-178d414bd610 osd.117 up in weight 1 up_from 2267 up_thru 7661 down_at 2095 last_clean_interval [1910,2078) [v2:10.100.190.58:6916/6618,v1:10.100.190.58:6917/6618] [v2:10.100.188.39:6916/6618,v1:10.100.188.39:6917/6618] exists,up bb47143d-8722-41bc-aa3c-e9833b1812c8 osd.118 up in weight 1 up_from 2260 up_thru 7661 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6868/6707,v1:10.100.190.57:6873/6707] [v2:10.100.188.38:6868/6707,v1:10.100.188.38:6874/6707] exists,up 7141a5ed-8385-433d-a0a9-e4feb879050d osd.119 up in weight 1 up_from 2262 up_thru 7660 down_at 2238 last_clean_interval [1899,2220) [v2:10.100.190.59:6841/6630,v1:10.100.190.59:6847/6630] [v2:10.100.188.40:6841/6630,v1:10.100.188.40:6846/6630] exists,up 40c5a5bf-af18-4937-875f-46a3d04303ba osd.120 up in weight 1 up_from 3762 up_thru 7662 down_at 3748 last_clean_interval [3429,3747) [v2:10.100.190.44:6804/14477,v1:10.100.190.44:6805/14477] [v2:10.100.188.25:6804/14477,v1:10.100.188.25:6805/14477] exists,up 975dc6bf-3842-4e87-b317-743de64af04e osd.121 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6828/6622,v1:10.100.190.40:6833/6622] [v2:10.100.188.21:6829/6622,v1:10.100.188.21:6832/6622] exists,up 1a312db5-5ffa-4ba9-9899-3c3766a86c40 osd.122 up in weight 1 up_from 7548 up_thru 7660 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6851/6780,v1:10.100.190.48:6863/6780] [v2:10.100.188.29:6853/6780,v1:10.100.188.29:6862/6780] exists,up 10072bbf-df62-45c0-b7fb-d4842e0feb77 osd.123 up in weight 1 up_from 3744 up_thru 7661 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6863/14242,v1:10.100.190.43:6868/14242] [v2:10.100.188.24:6862/14242,v1:10.100.188.24:6867/14242] exists,up acdc3f39-1903-4a9c-84ef-90311ba839af osd.124 up in weight 1 up_from 3661 up_thru 7663 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6816/17007,v1:10.100.190.42:6817/17007] [v2:10.100.188.23:6816/17007,v1:10.100.188.23:6817/17007] exists,up 47084fb9-e546-4147-a64c-385db58ce56f osd.125 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2023,2254) [v2:10.100.190.47:6829/6631,v1:10.100.190.47:6841/6631] [v2:10.100.188.28:6837/6631,v1:10.100.188.28:6844/6631] exists,up 0e335d5f-18f7-41ab-a93f-93aad82b183b osd.126 up in weight 1 up_from 3298 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6831/9509,v1:10.100.190.45:6836/9509] [v2:10.100.188.26:6831/9509,v1:10.100.188.26:6834/9509] exists,up fddb9315-9b4f-477f-ac3f-d5308353f968 osd.127 up in weight 1 up_from 2263 up_thru 7663 down_at 2079 last_clean_interval [2037,2060) [v2:10.100.190.50:6908/6648,v1:10.100.190.50:6909/6648] [v2:10.100.188.31:6908/6648,v1:10.100.188.31:6909/6648] exists,up 1094ae90-6e04-43ac-9f59-cadf13253be8 osd.128 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6920/6814,v1:10.100.190.46:6922/6814] [v2:10.100.188.27:6920/6814,v1:10.100.188.27:6922/6814] exists,up a351f96e-7a12-4699-aba3-18063084b034 osd.129 up in weight 1 up_from 7660 up_thru 7663 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6889/6570,v1:10.100.190.41:6903/6570] [v2:10.100.188.22:6890/6570,v1:10.100.188.22:6903/6570] exists,up c2aea657-2032-4546-8092-275b20406407 osd.130 up in weight 1 up_from 3232 up_thru 7662 down_at 2228 last_clean_interval [2023,2209) [v2:10.100.190.49:6831/9285,v1:10.100.190.49:6833/9285] [v2:10.100.188.30:6831/9285,v1:10.100.188.30:6833/9285] exists,up 8a81f43b-be43-4b41-bdc3-c35b75bacad7 osd.131 up in weight 1 up_from 2380 up_thru 7662 down_at 2042 last_clean_interval [2038,2041) [v2:10.100.190.52:6842/6657,v1:10.100.190.52:6844/6657] [v2:10.100.188.33:6842/6657,v1:10.100.188.33:6844/6657] exists,up c19f0dca-c517-440d-b8a6-3d18caf40850 osd.132 up in weight 1 up_from 2263 up_thru 7661 down_at 2051 last_clean_interval [2033,2049) [v2:10.100.190.54:6880/6637,v1:10.100.190.54:6892/6637] [v2:10.100.188.35:6881/6637,v1:10.100.188.35:6889/6637] exists,up 07eceb59-f2f5-4ec6-8211-41bab3e4c40c osd.133 up in weight 1 up_from 2262 up_thru 7661 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6868/6735,v1:10.100.190.55:6870/6735] [v2:10.100.188.36:6869/6735,v1:10.100.188.36:6871/6735] exists,up ae44dd05-9b17-42b9-bd31-758cea7800a3 osd.134 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6898/6707,v1:10.100.190.53:6909/6707] [v2:10.100.188.34:6905/6707,v1:10.100.188.34:6908/6707] exists,up 97d22279-b06f-4078-bbc9-30ff2b4b348d osd.135 up in weight 1 up_from 2262 up_thru 7664 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6882/6749,v1:10.100.190.51:6887/6749] [v2:10.100.188.32:6881/6749,v1:10.100.188.32:6887/6749] exists,up f68499bb-7d68-4031-9ed6-78058aca5431 osd.136 up in weight 1 up_from 2940 up_thru 7664 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6893/6547,v1:10.100.190.56:6902/6547] [v2:10.100.188.37:6891/6547,v1:10.100.188.37:6898/6547] exists,up 7e2de460-6f77-4b31-9d53-3a864a64337e osd.137 up in weight 1 up_from 2265 up_thru 7665 down_at 2096 last_clean_interval [1909,2078) [v2:10.100.190.58:6852/6606,v1:10.100.190.58:6853/6606] [v2:10.100.188.39:6852/6606,v1:10.100.188.39:6853/6606] exists,up 1b68495e-dbb8-4e2c-b77b-fcd64ba3b7c7 osd.138 up in weight 1 up_from 2260 up_thru 7664 down_at 2109 last_clean_interval [2036,2102) [v2:10.100.190.57:6820/6789,v1:10.100.190.57:6821/6789] [v2:10.100.188.38:6820/6789,v1:10.100.188.38:6821/6789] exists,up a6fdf145-1550-4767-88a3-e0d6c72ac4fb osd.139 up in weight 1 up_from 2263 up_thru 7663 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6892/6748,v1:10.100.190.59:6894/6748] [v2:10.100.188.40:6892/6748,v1:10.100.188.40:6894/6748] exists,up 70b00ca2-24ad-49ab-903b-480e4affe51b osd.140 up in weight 1 up_from 3763 up_thru 7661 down_at 3748 last_clean_interval [3425,3747) [v2:10.100.190.44:6853/14594,v1:10.100.190.44:6860/14594] [v2:10.100.188.25:6855/14594,v1:10.100.188.25:6861/14594] exists,up efedd98f-2de9-407c-978a-43bc996c3ef9 osd.141 up in weight 1 up_from 3745 up_thru 7664 down_at 3728 last_clean_interval [3332,3727) [v2:10.100.190.43:6848/14364,v1:10.100.190.43:6851/14364] [v2:10.100.188.24:6848/14364,v1:10.100.188.24:6849/14364] exists,up 47408f07-9384-4244-90ab-10cfc50f7b63 osd.142 up in weight 1 up_from 7548 up_thru 7662 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6852/6761,v1:10.100.190.48:6861/6761] [v2:10.100.188.29:6850/6761,v1:10.100.188.29:6857/6761] exists,up a19539df-4e26-4ded-897c-e6bdae1b95a1 osd.143 up in weight 1 up_from 7557 up_thru 7661 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6824/6641,v1:10.100.190.40:6827/6641] [v2:10.100.188.21:6824/6641,v1:10.100.188.21:6827/6641] exists,up a3fe791d-6c87-4f66-aab9-87c9c2105896 osd.144 up in weight 1 up_from 3660 up_thru 7661 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6871/17086,v1:10.100.190.42:6875/17086] [v2:10.100.188.23:6873/17086,v1:10.100.188.23:6877/17086] exists,up a8de9354-8745-4634-afb8-f09a82dbd285 osd.145 up in weight 1 up_from 3298 up_thru 7662 down_at 2263 last_clean_interval [2024,2257) [v2:10.100.190.45:6800/9498,v1:10.100.190.45:6801/9498] [v2:10.100.188.26:6800/9498,v1:10.100.188.26:6801/9498] exists,up b9452f84-338c-4a8f-b4e6-366a82fa88a2 osd.146 up in weight 1 up_from 3233 up_thru 7664 down_at 2230 last_clean_interval [2023,2209) [v2:10.100.190.49:6848/9309,v1:10.100.190.49:6852/9309] [v2:10.100.188.30:6850/9309,v1:10.100.188.30:6853/9309] exists,up a2e2b8bb-b02a-44fd-a223-1b36887fc267 osd.147 up in weight 1 up_from 2264 up_thru 7660 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6885/6617,v1:10.100.190.50:6891/6617] [v2:10.100.188.31:6886/6617,v1:10.100.188.31:6890/6617] exists,up 1fa5ebfa-1440-44b7-b904-2622790082f1 osd.148 up in weight 1 up_from 2261 up_thru 7662 down_at 2260 last_clean_interval [2023,2257) [v2:10.100.190.46:6809/6806,v1:10.100.190.46:6811/6806] [v2:10.100.188.27:6809/6806,v1:10.100.188.27:6811/6806] exists,up 1dd6d075-6b00-491d-8e9a-2aa55a48bba1 osd.149 up in weight 1 up_from 7661 up_thru 7662 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6839/6647,v1:10.100.190.41:6848/6647] [v2:10.100.188.22:6841/6647,v1:10.100.188.22:6844/6647] exists,up 19509f6a-6539-46a0-877d-79ff0140b3e3 osd.150 up in weight 1 up_from 2262 up_thru 7664 down_at 2255 last_clean_interval [2024,2254) [v2:10.100.190.47:6820/6696,v1:10.100.190.47:6821/6696] [v2:10.100.188.28:6820/6696,v1:10.100.188.28:6821/6696] exists,up 089fd0d5-783d-484a-b595-15d2a0172946 osd.151 up in weight 1 up_from 2380 up_thru 7664 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6854/6772,v1:10.100.190.52:6858/6772] [v2:10.100.188.33:6857/6772,v1:10.100.188.33:6861/6772] exists,up 612b4dee-6c3e-4fef-96e0-9581b2a0ac80 osd.152 up in weight 1 up_from 2263 up_thru 7662 down_at 2051 last_clean_interval [2036,2049) [v2:10.100.190.54:6877/6651,v1:10.100.190.54:6883/6651] [v2:10.100.188.35:6872/6651,v1:10.100.188.35:6878/6651] exists,up 2d2f30c6-7c5e-45a8-aee7-cfea175a945f osd.153 up in weight 1 up_from 2264 up_thru 7662 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6850/6673,v1:10.100.190.55:6852/6673] [v2:10.100.188.36:6850/6673,v1:10.100.188.36:6851/6673] exists,up 7cfc57f4-7e27-485c-9714-71c8a5b55c80 osd.154 up in weight 1 up_from 2630 up_thru 7664 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6850/6820,v1:10.100.190.53:6852/6820] [v2:10.100.188.34:6848/6820,v1:10.100.188.34:6850/6820] exists,up 09897f02-0115-408d-ae10-c26592251984 osd.155 up in weight 1 up_from 2940 up_thru 7661 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6899/6612,v1:10.100.190.56:6905/6612] [v2:10.100.188.37:6900/6612,v1:10.100.188.37:6906/6612] exists,up f035e0b9-dba6-4d05-b842-49414413e888 osd.156 up in weight 1 up_from 2264 up_thru 7661 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6892/6684,v1:10.100.190.51:6896/6684] [v2:10.100.188.32:6892/6684,v1:10.100.188.32:6898/6684] exists,up 25a7f1c8-f894-4734-b0d4-093cbca5f332 osd.157 up in weight 1 up_from 2265 up_thru 7660 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6872/6711,v1:10.100.190.58:6877/6711] [v2:10.100.188.39:6872/6711,v1:10.100.188.39:6876/6711] exists,up 2c1d130f-be05-4210-8e9d-6f5e10112d96 osd.158 up in weight 1 up_from 2262 up_thru 7664 down_at 2109 last_clean_interval [2037,2102) [v2:10.100.190.57:6825/6673,v1:10.100.190.57:6829/6673] [v2:10.100.188.38:6825/6673,v1:10.100.188.38:6828/6673] exists,up 3ce11e99-0fe8-4a8e-98fe-216dd189376e osd.159 up in weight 1 up_from 2263 up_thru 7661 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6869/6624,v1:10.100.190.59:6871/6624] [v2:10.100.188.40:6870/6624,v1:10.100.188.40:6871/6624] exists,up 1d3de7ee-ab79-4daf-8bc0-45100c9bb035 osd.160 up in weight 1 up_from 3763 up_thru 7662 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6880/14693,v1:10.100.190.44:6885/14693] [v2:10.100.188.25:6880/14693,v1:10.100.188.25:6886/14693] exists,up fb901121-5048-470b-bfd9-632518385569 osd.161 up in weight 1 up_from 3745 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6834/14206,v1:10.100.190.43:6837/14206] [v2:10.100.188.24:6835/14206,v1:10.100.188.24:6838/14206] exists,up 2e288ba8-0228-4b03-8043-587303205b05 osd.162 up in weight 1 up_from 7547 up_thru 7664 down_at 7397 last_clean_interval [3148,7394) [v2:10.100.190.48:6903/6687,v1:10.100.190.48:6910/6687] [v2:10.100.188.29:6903/6687,v1:10.100.188.29:6906/6687] exists,up 7f64796c-0340-4116-8bcc-85b245b8c584 osd.163 up in weight 1 up_from 3298 up_thru 7661 down_at 2261 last_clean_interval [2024,2257) [v2:10.100.190.45:6832/9602,v1:10.100.190.45:6837/9602] [v2:10.100.188.26:6833/9602,v1:10.100.188.26:6836/9602] exists,up 8715bbc4-60af-4a6c-8531-f9aafa2ebf5f osd.164 up in weight 1 up_from 3661 up_thru 7662 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6832/17057,v1:10.100.190.42:6833/17057] [v2:10.100.188.23:6832/17057,v1:10.100.188.23:6833/17057] exists,up 3b8c19a5-6b66-48aa-b80a-67722687290b osd.165 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6883/6637,v1:10.100.190.40:6887/6637] [v2:10.100.188.21:6883/6637,v1:10.100.188.21:6888/6637] exists,up 143464ce-c449-4a45-aac2-59c0926f271e osd.166 up in weight 1 up_from 2380 up_thru 7663 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6830/6769,v1:10.100.190.52:6831/6769] [v2:10.100.188.33:6828/6769,v1:10.100.188.33:6831/6769] exists,up 577d32f0-67ac-4fb9-b8c0-a8dbcccadc0c osd.167 up in weight 1 up_from 2265 up_thru 7662 down_at 2264 last_clean_interval [2024,2257) [v2:10.100.190.46:6884/6729,v1:10.100.190.46:6887/6729] [v2:10.100.188.27:6885/6729,v1:10.100.188.27:6891/6729] exists,up beec2da0-613d-4a6d-9d8d-31a83dc15b53 osd.168 up in weight 1 up_from 3231 up_thru 7661 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6899/9339,v1:10.100.190.49:6906/9339] [v2:10.100.188.30:6901/9339,v1:10.100.188.30:6908/9339] exists,up d27c5bdd-c7d0-4c1d-9523-947cdba356ec osd.169 up in weight 1 up_from 7660 up_thru 7662 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6846/6582,v1:10.100.190.41:6854/6582] [v2:10.100.188.22:6849/6582,v1:10.100.188.22:6854/6582] exists,up 0cfee8a4-750d-45cc-acd5-f8601d35b229 osd.170 up in weight 1 up_from 2263 up_thru 7662 down_at 2078 last_clean_interval [2037,2060) [v2:10.100.190.50:6870/6703,v1:10.100.190.50:6871/6703] [v2:10.100.188.31:6870/6703,v1:10.100.188.31:6871/6703] exists,up 185b8ca6-70d5-4c09-9535-4d6c0bdcbb52 osd.171 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2023,2254) [v2:10.100.190.47:6880/6687,v1:10.100.190.47:6885/6687] [v2:10.100.188.28:6879/6687,v1:10.100.188.28:6883/6687] exists,up 634ecf51-247a-46ed-a970-b2afcace09f3 osd.172 up in weight 1 up_from 2263 up_thru 7663 down_at 2050 last_clean_interval [2035,2049) [v2:10.100.190.54:6843/6706,v1:10.100.190.54:6846/6706] [v2:10.100.188.35:6841/6706,v1:10.100.188.35:6845/6706] exists,up a3fe729e-a025-402b-9ac1-0989f3c79e4b osd.173 up in weight 1 up_from 2264 up_thru 7662 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6918/6641,v1:10.100.190.55:6921/6641] [v2:10.100.188.36:6919/6641,v1:10.100.188.36:6921/6641] exists,up 5fa81fae-64ef-4161-953b-0d4ff2c6117a osd.174 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6812/6796,v1:10.100.190.53:6813/6796] [v2:10.100.188.34:6812/6796,v1:10.100.188.34:6813/6796] exists,up 1e4492d8-27f2-425b-b2e9-7b6648ff5df5 osd.175 up in weight 1 up_from 2261 up_thru 7665 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6847/6736,v1:10.100.190.51:6854/6736] [v2:10.100.188.32:6847/6736,v1:10.100.188.32:6853/6736] exists,up 36679910-7c01-4ead-bd08-6a3ed6f0ede3 osd.176 up in weight 1 up_from 2940 up_thru 7662 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6885/6622,v1:10.100.190.56:6898/6622] [v2:10.100.188.37:6888/6622,v1:10.100.188.37:6896/6622] exists,up e734f4a0-69d9-4be4-8ebd-c74e023b79d0 osd.177 up in weight 1 up_from 2265 up_thru 7662 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6864/6730,v1:10.100.190.58:6865/6730] [v2:10.100.188.39:6864/6730,v1:10.100.188.39:6865/6730] exists,up bd911d73-99bd-4315-8805-32df8bdf8cda osd.178 up in weight 1 up_from 2260 up_thru 7663 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6841/6744,v1:10.100.190.57:6844/6744] [v2:10.100.188.38:6840/6744,v1:10.100.188.38:6844/6744] exists,up 836c34db-7c72-4d6f-b168-7530d102dab0 osd.179 up in weight 1 up_from 2264 up_thru 7664 down_at 2239 last_clean_interval [1896,2220) [v2:10.100.190.59:6902/6663,v1:10.100.190.59:6905/6663] [v2:10.100.188.40:6903/6663,v1:10.100.188.40:6904/6663] exists,up fb490051-ee0a-48ef-bb77-0a5c00d4f79f osd.180 up in weight 1 up_from 3762 up_thru 7661 down_at 3748 last_clean_interval [3428,3747) [v2:10.100.190.44:6816/14399,v1:10.100.190.44:6817/14399] [v2:10.100.188.25:6816/14399,v1:10.100.188.25:6817/14399] exists,up 967319de-b971-4a8b-93b8-c0085f2021af osd.181 up in weight 1 up_from 3746 up_thru 7661 down_at 3728 last_clean_interval [3334,3727) [v2:10.100.190.43:6871/14238,v1:10.100.190.43:6873/14238] [v2:10.100.188.24:6872/14238,v1:10.100.188.24:6875/14238] exists,up 231a6864-c08f-4d0f-b3cd-b9952e1e371b osd.182 up in weight 1 up_from 7548 up_thru 7661 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6867/6773,v1:10.100.190.48:6871/6773] [v2:10.100.188.29:6865/6773,v1:10.100.188.29:6872/6773] exists,up 2a3ed687-3f89-4dbe-b7a7-407f34618752 osd.183 up in weight 1 up_from 3298 up_thru 7662 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.45:6860/9529,v1:10.100.190.45:6866/9529] [v2:10.100.188.26:6863/9529,v1:10.100.188.26:6869/9529] exists,up 6bf8a2a3-2f79-49c8-9582-cfa8e705ca4f osd.184 up in weight 1 up_from 2379 up_thru 7663 down_at 2043 last_clean_interval [2037,2041) [v2:10.100.190.52:6890/6698,v1:10.100.190.52:6901/6698] [v2:10.100.188.33:6888/6698,v1:10.100.188.33:6899/6698] exists,up 3d356527-8d80-4805-aa4c-35c26f854fe8 osd.185 up in weight 1 up_from 3661 up_thru 7662 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6808/16840,v1:10.100.190.42:6809/16840] [v2:10.100.188.23:6808/16840,v1:10.100.188.23:6809/16840] exists,up e4a36a6c-3695-4cea-adbd-4f7db916fc7b osd.186 up in weight 1 up_from 2265 up_thru 7661 down_at 2264 last_clean_interval [2024,2257) [v2:10.100.190.46:6885/6748,v1:10.100.190.46:6889/6748] [v2:10.100.188.27:6884/6748,v1:10.100.188.27:6887/6748] exists,up 81a85893-5d42-454b-b405-24fed1e37f8f osd.187 up in weight 1 up_from 3232 up_thru 7662 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6900/9327,v1:10.100.190.49:6907/9327] [v2:10.100.188.30:6898/9327,v1:10.100.188.30:6905/9327] exists,up 1b60f019-d20e-42d9-b9f4-94b2cd57e343 osd.188 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6825/6645,v1:10.100.190.40:6830/6645] [v2:10.100.188.21:6825/6645,v1:10.100.188.21:6830/6645] exists,up 18ae3c5d-7213-401d-b0d5-04a387e47ce4 osd.189 up in weight 1 up_from 2263 up_thru 7662 down_at 2079 last_clean_interval [2036,2060) [v2:10.100.190.50:6883/6667,v1:10.100.190.50:6888/6667] [v2:10.100.188.31:6883/6667,v1:10.100.188.31:6887/6667] exists,up 5ab7b1f2-dda7-403c-a8e3-cb5bfaba2d15 osd.190 up in weight 1 up_from 2262 up_thru 7662 down_at 2256 last_clean_interval [2023,2254) [v2:10.100.190.47:6904/6673,v1:10.100.190.47:6906/6673] [v2:10.100.188.28:6904/6673,v1:10.100.188.28:6906/6673] exists,up 5c0da3f8-5cda-466b-a420-68bbfa4cf2dd osd.191 up in weight 1 up_from 7661 up_thru 7662 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6820/6608,v1:10.100.190.41:6821/6608] [v2:10.100.188.22:6820/6608,v1:10.100.188.22:6821/6608] exists,up aa46e7e2-73fc-4c67-b014-79b8506a4dca osd.192 up in weight 1 up_from 2262 up_thru 7661 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6800/6730,v1:10.100.190.55:6801/6730] [v2:10.100.188.36:6800/6730,v1:10.100.188.36:6801/6730] exists,up 89cf31aa-1831-4a5a-864f-cea50ef6da86 osd.193 up in weight 1 up_from 2263 up_thru 7661 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6849/6720,v1:10.100.190.54:6852/6720] [v2:10.100.188.35:6846/6720,v1:10.100.188.35:6851/6720] exists,up d3c858fa-00e2-4bfc-8c78-9ac4f74f4023 osd.194 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6828/6774,v1:10.100.190.53:6831/6774] [v2:10.100.188.34:6827/6774,v1:10.100.188.34:6830/6774] exists,up ca147a2d-dc3e-4b51-9b90-e717dc3a2901 osd.195 up in weight 1 up_from 2263 up_thru 7660 down_at 2046 last_clean_interval [2037,2044) [v2:10.100.190.51:6893/6646,v1:10.100.190.51:6897/6646] [v2:10.100.188.32:6893/6646,v1:10.100.188.32:6897/6646] exists,up 07da64b3-06d8-4f01-80e7-22fab7ab3bfb osd.196 up in weight 1 up_from 2941 up_thru 7661 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6880/6616,v1:10.100.190.56:6884/6616] [v2:10.100.188.37:6880/6616,v1:10.100.188.37:6889/6616] exists,up ba1a77dd-e170-4580-8881-135ed00be652 osd.197 up in weight 1 up_from 2262 up_thru 7661 down_at 2096 last_clean_interval [1911,2078) [v2:10.100.190.58:6800/6584,v1:10.100.190.58:6801/6584] [v2:10.100.188.39:6800/6584,v1:10.100.188.39:6801/6584] exists,up 9ad6c665-e40d-4f4a-9826-256a962632dc osd.198 up in weight 1 up_from 2262 up_thru 7662 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6866/6675,v1:10.100.190.57:6872/6675] [v2:10.100.188.38:6866/6675,v1:10.100.188.38:6873/6675] exists,up 1b9e7280-4e40-45e7-81c3-c8fa6b86dfb7 osd.199 up in weight 1 up_from 2264 up_thru 7661 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6912/6643,v1:10.100.190.59:6914/6643] [v2:10.100.188.40:6912/6643,v1:10.100.188.40:6914/6643] exists,up c82d1c01-b3ae-4963-a657-f0c266878690 osd.200 up in weight 1 up_from 3763 up_thru 7660 down_at 3748 last_clean_interval [3425,3747) [v2:10.100.190.44:6829/14657,v1:10.100.190.44:6831/14657] [v2:10.100.188.25:6829/14657,v1:10.100.188.25:6831/14657] exists,up ad064e2f-f5b6-4f4c-b77d-1a78154dab7e osd.201 up in weight 1 up_from 3745 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6816/14179,v1:10.100.190.43:6817/14179] [v2:10.100.188.24:6816/14179,v1:10.100.188.24:6817/14179] exists,up 733e07aa-bb61-48dc-8546-e75f1776fa1d osd.202 up in weight 1 up_from 7547 up_thru 7661 down_at 7397 last_clean_interval [3147,7394) [v2:10.100.190.48:6830/6665,v1:10.100.190.48:6838/6665] [v2:10.100.188.29:6840/6665,v1:10.100.188.29:6842/6665] exists,up 5590bc9d-791a-4b29-93cf-0e2ca37cb1d1 osd.203 up in weight 1 up_from 3298 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6875/9620,v1:10.100.190.45:6879/9620] [v2:10.100.188.26:6875/9620,v1:10.100.188.26:6879/9620] exists,up 5f356f17-6454-48e8-a1d5-845b7e17ce05 osd.204 up in weight 1 up_from 2380 up_thru 7661 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6823/6645,v1:10.100.190.52:6827/6645] [v2:10.100.188.33:6823/6645,v1:10.100.188.33:6825/6645] exists,up b4e683b5-0353-463d-949e-b1990cd9487d osd.205 up in weight 1 up_from 3661 up_thru 7661 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6810/16834,v1:10.100.190.42:6812/16834] [v2:10.100.188.23:6810/16834,v1:10.100.188.23:6812/16834] exists,up 7a330198-e249-4094-bad2-43d3ee855fe9 osd.206 up in weight 1 up_from 3232 up_thru 7664 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6835/9279,v1:10.100.190.49:6838/9279] [v2:10.100.188.30:6835/9279,v1:10.100.188.30:6840/9279] exists,up e760bcee-4ca7-4577-854c-8fbb06c95063 osd.207 up in weight 1 up_from 2262 up_thru 7664 down_at 2255 last_clean_interval [2024,2254) [v2:10.100.190.47:6882/6683,v1:10.100.190.47:6888/6683] [v2:10.100.188.28:6885/6683,v1:10.100.188.28:6890/6683] exists,up e503fd02-ada9-4148-a38b-94fef76c500e osd.208 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.46:6876/6752,v1:10.100.190.46:6878/6752] [v2:10.100.188.27:6876/6752,v1:10.100.188.27:6878/6752] exists,up f6a7897c-2868-40ec-aa70-2bea66ec5148 osd.209 up in weight 1 up_from 7558 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6888/6705,v1:10.100.190.40:6894/6705] [v2:10.100.188.21:6892/6705,v1:10.100.188.21:6908/6705] exists,up 7c178736-5bc7-459a-9aa2-cdaad379d0d1 osd.210 up in weight 1 up_from 2264 up_thru 7662 down_at 2079 last_clean_interval [2037,2060) [v2:10.100.190.50:6834/6651,v1:10.100.190.50:6843/6651] [v2:10.100.188.31:6836/6651,v1:10.100.188.31:6842/6651] exists,up 98c71add-56bf-4904-85d9-a27669231c62 osd.211 up in weight 1 up_from 7661 up_thru 7664 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6810/6585,v1:10.100.190.41:6812/6585] [v2:10.100.188.22:6810/6585,v1:10.100.188.22:6811/6585] exists,up 4eac3e2f-558f-452a-b915-dcf3b184ba74 osd.212 up in weight 1 up_from 2262 up_thru 7662 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6872/6715,v1:10.100.190.55:6875/6715] [v2:10.100.188.36:6872/6715,v1:10.100.188.36:6875/6715] exists,up 1ec00cce-f7d6-48c5-905a-f442b8207e10 osd.213 up in weight 1 up_from 2262 up_thru 7664 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6846/6668,v1:10.100.190.51:6849/6668] [v2:10.100.188.32:6844/6668,v1:10.100.188.32:6849/6668] exists,up 52472ced-1561-49cf-ad6b-b0419368f77c osd.214 up in weight 1 up_from 2941 up_thru 7665 down_at 2161 last_clean_interval [2036,2149) [v2:10.100.190.56:6835/6701,v1:10.100.190.56:6839/6701] [v2:10.100.188.37:6835/6701,v1:10.100.188.37:6840/6701] exists,up 32b9c773-4bc7-419a-8381-b6a1383a19a1 osd.215 up in weight 1 up_from 2629 up_thru 7662 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6866/6835,v1:10.100.190.53:6869/6835] [v2:10.100.188.34:6863/6835,v1:10.100.188.34:6866/6835] exists,up e4b43e0f-eff4-42ba-859e-ae83092006e2 osd.216 up in weight 1 up_from 2264 up_thru 7661 down_at 2096 last_clean_interval [1911,2078) [v2:10.100.190.58:6840/6637,v1:10.100.190.58:6841/6637] [v2:10.100.188.39:6840/6637,v1:10.100.188.39:6841/6637] exists,up c13a9927-4e66-4d01-9e4c-2f92a30a9b54 osd.217 up in weight 1 up_from 2260 up_thru 7662 down_at 2051 last_clean_interval [2036,2049) [v2:10.100.190.54:6819/6634,v1:10.100.190.54:6824/6634] [v2:10.100.188.35:6822/6634,v1:10.100.188.35:6827/6634] exists,up a4ce5143-5066-4a59-8b4c-ff9e41b42db8 osd.218 up in weight 1 up_from 2260 up_thru 7664 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6840/6698,v1:10.100.190.57:6845/6698] [v2:10.100.188.38:6841/6698,v1:10.100.188.38:6845/6698] exists,up 51fb292e-9a01-436c-9d79-f3dad114666e osd.219 up in weight 1 up_from 2262 up_thru 7660 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6801/6765,v1:10.100.190.59:6803/6765] [v2:10.100.188.40:6802/6765,v1:10.100.188.40:6803/6765] exists,up c531fd04-15ae-4c4a-a7dd-3c30e33a1141 osd.220 up in weight 1 up_from 3763 up_thru 7661 down_at 3748 last_clean_interval [3427,3747) [v2:10.100.190.44:6845/14628,v1:10.100.190.44:6850/14628] [v2:10.100.188.25:6846/14628,v1:10.100.188.25:6850/14628] exists,up aaebd8ea-d6eb-4e7e-bbf9-d6ec0094868c osd.221 up in weight 1 up_from 3746 up_thru 7661 down_at 3728 last_clean_interval [3332,3727) [v2:10.100.190.43:6867/14212,v1:10.100.190.43:6872/14212] [v2:10.100.188.24:6869/14212,v1:10.100.188.24:6871/14212] exists,up 260d4a8c-64df-420d-9eac-ed87f4a240b4 osd.222 up in weight 1 up_from 7548 up_thru 7661 down_at 7397 last_clean_interval [3148,7394) [v2:10.100.190.48:6870/6784,v1:10.100.190.48:6872/6784] [v2:10.100.188.29:6870/6784,v1:10.100.188.29:6874/6784] exists,up b906cf43-dfa0-44c5-a38e-61742a6d5925 osd.223 up in weight 1 up_from 3233 up_thru 7664 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6811/9295,v1:10.100.190.49:6813/9295] [v2:10.100.188.30:6812/9295,v1:10.100.188.30:6814/9295] exists,up 4b4c99c4-914c-4b2d-8b93-4f3026370837 osd.224 up in weight 1 up_from 3299 up_thru 7664 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6817/9582,v1:10.100.190.45:6819/9582] [v2:10.100.188.26:6818/9582,v1:10.100.188.26:6819/9582] exists,up aa3c5eac-49a9-4ac1-a05d-25c998e97d05 osd.225 up in weight 1 up_from 2262 up_thru 7662 down_at 2255 last_clean_interval [2023,2254) [v2:10.100.190.47:6876/6650,v1:10.100.190.47:6878/6650] [v2:10.100.188.28:6875/6650,v1:10.100.188.28:6877/6650] exists,up 73b4f257-8e5d-4572-9fb4-30e30a0999e4 osd.226 up in weight 1 up_from 2380 up_thru 7661 down_at 2043 last_clean_interval [2037,2041) [v2:10.100.190.52:6871/6636,v1:10.100.190.52:6872/6636] [v2:10.100.188.33:6870/6636,v1:10.100.188.33:6872/6636] exists,up 4608dcd6-b3a3-4d5d-9100-7d2088f694b1 osd.227 up in weight 1 up_from 3661 up_thru 7664 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6843/17039,v1:10.100.190.42:6845/17039] [v2:10.100.188.23:6843/17039,v1:10.100.188.23:6845/17039] exists,up 38e2ce2c-d6f2-441d-a60e-fe96e14456c2 osd.228 up in weight 1 up_from 2263 up_thru 7663 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6837/6691,v1:10.100.190.46:6843/6691] [v2:10.100.188.27:6840/6691,v1:10.100.188.27:6842/6691] exists,up 36bac11d-cdd1-4477-a975-f6832f41f178 osd.229 up in weight 1 up_from 2263 up_thru 7661 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6832/6597,v1:10.100.190.50:6837/6597] [v2:10.100.188.31:6832/6597,v1:10.100.188.31:6835/6597] exists,up e9d50773-a001-4d34-907f-91a797dc403a osd.230 up in weight 1 up_from 7558 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6826/6613,v1:10.100.190.40:6831/6613] [v2:10.100.188.21:6828/6613,v1:10.100.188.21:6835/6613] exists,up 20953270-113c-4c3b-9f73-4bc282cde457 osd.231 up in weight 1 up_from 7661 up_thru 7661 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6887/6614,v1:10.100.190.41:6897/6614] [v2:10.100.188.22:6891/6614,v1:10.100.188.22:6902/6614] exists,up 54330218-0c5a-4c2f-982d-1b567b07e6b6 osd.232 up in weight 1 up_from 2263 up_thru 7662 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6821/6738,v1:10.100.190.55:6826/6738] [v2:10.100.188.36:6820/6738,v1:10.100.188.36:6825/6738] exists,up 687ba722-871e-4cd4-833b-7edd88193df3 osd.233 up in weight 1 up_from 2260 up_thru 7663 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6800/6672,v1:10.100.190.51:6801/6672] [v2:10.100.188.32:6800/6672,v1:10.100.188.32:6801/6672] exists,up 0e1fb0a0-5f2b-4f75-93ae-98be7529c170 osd.234 up in weight 1 up_from 2940 up_thru 7661 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6849/6636,v1:10.100.190.56:6859/6636] [v2:10.100.188.37:6851/6636,v1:10.100.188.37:6856/6636] exists,up c7c2fd3a-c521-4389-91a0-32118e70b681 osd.235 up in weight 1 up_from 2630 up_thru 7664 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6857/6742,v1:10.100.190.53:6861/6742] [v2:10.100.188.34:6862/6742,v1:10.100.188.34:6869/6742] exists,up 503973c3-f031-4ca3-8fa8-2ea4697fbf23 osd.236 up in weight 1 up_from 2261 up_thru 7661 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6865/6646,v1:10.100.190.54:6868/6646] [v2:10.100.188.35:6862/6646,v1:10.100.188.35:6866/6646] exists,up f5a557e1-fb05-467a-a08f-acf9d92b19c1 osd.237 up in weight 1 up_from 2264 up_thru 7664 down_at 2096 last_clean_interval [1909,2078) [v2:10.100.190.58:6844/6674,v1:10.100.190.58:6845/6674] [v2:10.100.188.39:6844/6674,v1:10.100.188.39:6845/6674] exists,up 6b5e2e05-03de-46f1-b1a3-fedcece56664 osd.238 up in weight 1 up_from 2262 up_thru 7664 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6827/6792,v1:10.100.190.57:6831/6792] [v2:10.100.188.38:6829/6792,v1:10.100.188.38:6831/6792] exists,up 4557a22b-998b-46d2-8bec-08f06c59a58d osd.239 up in weight 1 up_from 2262 up_thru 7661 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6809/6681,v1:10.100.190.59:6812/6681] [v2:10.100.188.40:6810/6681,v1:10.100.188.40:6813/6681] exists,up 028535da-051f-4cb1-a4b6-7b54effe9707 osd.240 up in weight 1 up_from 3764 up_thru 7662 down_at 3748 last_clean_interval [3427,3748) [v2:10.100.190.44:6843/14634,v1:10.100.190.44:6846/14634] [v2:10.100.188.25:6842/14634,v1:10.100.188.25:6843/14634] exists,up e7211690-5254-4f0b-a9e2-9b0bd25b8f44 osd.241 up in weight 1 up_from 3747 up_thru 7660 down_at 3728 last_clean_interval [3333,3727) [v2:10.100.190.43:6881/14408,v1:10.100.190.43:6884/14408] [v2:10.100.188.24:6881/14408,v1:10.100.188.24:6883/14408] exists,up 7a028812-817d-4f27-a7d2-59e2581024e8 osd.242 up in weight 1 up_from 3232 up_thru 7663 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6895/9311,v1:10.100.190.49:6902/9311] [v2:10.100.188.30:6894/9311,v1:10.100.188.30:6900/9311] exists,up 1d0ece46-464a-45eb-aa19-7ebd7b65ebe1 osd.243 up in weight 1 up_from 3298 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6816/9565,v1:10.100.190.45:6818/9565] [v2:10.100.188.26:6815/9565,v1:10.100.188.26:6816/9565] exists,up 2a0e8148-2754-46c8-a0e7-6fbf3aaf602d osd.244 up in weight 1 up_from 2262 up_thru 7661 down_at 2256 last_clean_interval [2023,2254) [v2:10.100.190.47:6845/6667,v1:10.100.190.47:6851/6667] [v2:10.100.188.28:6845/6667,v1:10.100.188.28:6848/6667] exists,up 565a6fce-3b46-4cbb-a368-503ed2714dfa osd.245 up in weight 1 up_from 7548 up_thru 7662 down_at 7397 last_clean_interval [3150,7394) [v2:10.100.190.48:6855/6736,v1:10.100.190.48:6864/6736] [v2:10.100.188.29:6854/6736,v1:10.100.188.29:6863/6736] exists,up a60e79b2-7f9b-4851-81cc-8ead90d12f84 osd.246 up in weight 1 up_from 2263 up_thru 7663 down_at 2078 last_clean_interval [2037,2060) [v2:10.100.190.50:6887/6603,v1:10.100.190.50:6892/6603] [v2:10.100.188.31:6888/6603,v1:10.100.188.31:6892/6603] exists,up 0c0db517-fb4e-4955-8863-06fac628e409 osd.247 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.46:6891/6684,v1:10.100.190.46:6898/6684] [v2:10.100.188.27:6892/6684,v1:10.100.188.27:6898/6684] exists,up e68d1c9f-22c9-4e06-9696-4379d1e209fb osd.248 up in weight 1 up_from 2379 up_thru 7661 down_at 2043 last_clean_interval [2037,2041) [v2:10.100.190.52:6846/6693,v1:10.100.190.52:6849/6693] [v2:10.100.188.33:6847/6693,v1:10.100.188.33:6849/6693] exists,up aa8333e8-bda2-4223-ba18-0f6197092b90 osd.249 up in weight 1 up_from 3661 up_thru 7641 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6800/16842,v1:10.100.190.42:6801/16842] [v2:10.100.188.23:6800/16842,v1:10.100.188.23:6801/16842] exists,up 57069d30-746b-4dd2-967e-a2705a42a661 osd.250 up in weight 1 up_from 7557 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6890/6744,v1:10.100.190.40:6901/6744] [v2:10.100.188.21:6894/6744,v1:10.100.188.21:6901/6744] exists,up ed47cc45-61b7-4d04-af21-3e5c301d4d67 osd.251 up in weight 1 up_from 2263 up_thru 7664 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6809/6696,v1:10.100.190.51:6810/6696] [v2:10.100.188.32:6808/6696,v1:10.100.188.32:6809/6696] exists,up aca79fd9-1a5c-450d-bf87-a5d5ecb727aa osd.252 up in weight 1 up_from 7661 up_thru 7665 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6816/6602,v1:10.100.190.41:6817/6602] [v2:10.100.188.22:6816/6602,v1:10.100.188.22:6817/6602] exists,up e07d0b48-7423-4602-a410-227633d455ad osd.253 up in weight 1 up_from 2264 up_thru 7664 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6844/6683,v1:10.100.190.55:6847/6683] [v2:10.100.188.36:6844/6683,v1:10.100.188.36:6848/6683] exists,up 7ea66afa-027e-4600-82f4-37287f270f39 osd.254 up in weight 1 up_from 2940 up_thru 7662 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6804/6551,v1:10.100.190.56:6807/6551] [v2:10.100.188.37:6804/6551,v1:10.100.188.37:6806/6551] exists,up 4c9121a0-3c1f-4b9d-97f1-37f7b1beb903 osd.255 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6884/6715,v1:10.100.190.53:6888/6715] [v2:10.100.188.34:6878/6715,v1:10.100.188.34:6879/6715] exists,up 1bb69a08-b492-4df5-8e93-5b421cb17726 osd.256 up in weight 1 up_from 2263 up_thru 7661 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6875/6675,v1:10.100.190.54:6889/6675] [v2:10.100.188.35:6877/6675,v1:10.100.188.35:6891/6675] exists,up 06b57203-6917-4131-9770-e9c3fd1a939a osd.257 up in weight 1 up_from 2268 up_thru 7663 down_at 2096 last_clean_interval [1912,2078) [v2:10.100.190.58:6912/6721,v1:10.100.190.58:6913/6721] [v2:10.100.188.39:6912/6721,v1:10.100.188.39:6913/6721] exists,up a78dc553-c2e0-4e25-a4cb-72952d631ee3 osd.258 up in weight 1 up_from 2273 up_thru 7662 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6915/6799,v1:10.100.190.57:6916/6799] [v2:10.100.188.38:6914/6799,v1:10.100.188.38:6916/6799] exists,up 735c0bba-a170-42fd-929c-bd95c1a840b7 osd.259 up in weight 1 up_from 2262 up_thru 7662 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6862/6741,v1:10.100.190.59:6863/6741] [v2:10.100.188.40:6862/6741,v1:10.100.188.40:6863/6741] exists,up fb228968-8db7-43ae-94c9-5cff994a287d osd.260 up in weight 1 up_from 3763 up_thru 7662 down_at 3748 last_clean_interval [3426,3748) [v2:10.100.190.44:6854/14738,v1:10.100.190.44:6858/14738] [v2:10.100.188.25:6852/14738,v1:10.100.188.25:6858/14738] exists,up d7c96c28-1646-459a-af9a-583eb275208b osd.261 up in weight 1 up_from 3744 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6861/14232,v1:10.100.190.43:6866/14232] [v2:10.100.188.24:6861/14232,v1:10.100.188.24:6866/14232] exists,up 5b5a6240-d721-4138-b2d6-76db4c967b82 osd.262 up in weight 1 up_from 3232 up_thru 7664 down_at 2230 last_clean_interval [2023,2209) [v2:10.100.190.49:6890/9335,v1:10.100.190.49:6893/9335] [v2:10.100.188.30:6889/9335,v1:10.100.188.30:6892/9335] exists,up 6360e99b-c067-4735-87df-991eb65474a8 osd.263 up in weight 1 up_from 7547 up_thru 7662 down_at 7397 last_clean_interval [3150,7394) [v2:10.100.190.48:6869/6752,v1:10.100.190.48:6874/6752] [v2:10.100.188.29:6868/6752,v1:10.100.188.29:6871/6752] exists,up bb2d9b6a-8da1-4b9e-805d-7d163940af0b osd.264 up in weight 1 up_from 3298 up_thru 7661 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6886/9614,v1:10.100.190.45:6892/9614] [v2:10.100.188.26:6888/9614,v1:10.100.188.26:6894/9614] exists,up b8d7ceed-7d42-499b-af65-a5329e9aea8d osd.265 up in weight 1 up_from 2263 up_thru 7663 down_at 2078 last_clean_interval [2037,2060) [v2:10.100.190.50:6800/6689,v1:10.100.190.50:6803/6689] [v2:10.100.188.31:6800/6689,v1:10.100.188.31:6801/6689] exists,up 74bed836-8ab0-4139-94b3-c0c7d2323b7a osd.266 up in weight 1 up_from 2262 up_thru 7661 down_at 2256 last_clean_interval [2024,2254) [v2:10.100.190.47:6847/6662,v1:10.100.190.47:6854/6662] [v2:10.100.188.28:6849/6662,v1:10.100.188.28:6867/6662] exists,up c0320d66-5119-45d3-ba4d-a125850c0056 osd.267 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.46:6833/6681,v1:10.100.190.46:6839/6681] [v2:10.100.188.27:6834/6681,v1:10.100.188.27:6838/6681] exists,up 2569691b-8d0f-48c4-862e-46a4531bed3f osd.268 up in weight 1 up_from 2380 up_thru 7661 down_at 2042 last_clean_interval [2036,2041) [v2:10.100.190.52:6800/6725,v1:10.100.190.52:6801/6725] [v2:10.100.188.33:6800/6725,v1:10.100.188.33:6801/6725] exists,up 3ed79a61-f70a-4a56-9a1c-ce78d1d84fc9 osd.269 up in weight 1 up_from 2263 up_thru 7661 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6838/6679,v1:10.100.190.51:6839/6679] [v2:10.100.188.32:6838/6679,v1:10.100.188.32:6839/6679] exists,up add90750-25c8-4941-94ce-9c9c82dc1edb osd.270 up in weight 1 up_from 7559 up_thru 7660 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6898/6712,v1:10.100.190.40:6906/6712] [v2:10.100.188.21:6898/6712,v1:10.100.188.21:6903/6712] exists,up 7273a32d-e30e-4d53-96ae-23f70d6ec70d osd.271 up in weight 1 up_from 3661 up_thru 7664 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6872/17110,v1:10.100.190.42:6876/17110] [v2:10.100.188.23:6871/17110,v1:10.100.188.23:6875/17110] exists,up 8f357593-c542-4f6c-9aa8-6ef3c6ae8148 osd.272 up in weight 1 up_from 2263 up_thru 7664 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6845/6726,v1:10.100.190.55:6848/6726] [v2:10.100.188.36:6845/6726,v1:10.100.188.36:6847/6726] exists,up 2ed7ccc2-c6f8-41f4-96c8-67c0c72ee710 osd.273 up in weight 1 up_from 7660 up_thru 7662 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6824/6700,v1:10.100.190.41:6826/6700] [v2:10.100.188.22:6824/6700,v1:10.100.188.22:6826/6700] exists,up 2b67fbe8-9234-4d0d-bd8d-42a09a0d5eba osd.274 up in weight 1 up_from 2263 up_thru 7660 down_at 2050 last_clean_interval [2033,2049) [v2:10.100.190.54:6841/6731,v1:10.100.190.54:6848/6731] [v2:10.100.188.35:6844/6731,v1:10.100.188.35:6850/6731] exists,up 043e8f46-3738-47b1-81db-56226475a9ba osd.275 up in weight 1 up_from 2630 up_thru 7662 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6814/6735,v1:10.100.190.53:6815/6735] [v2:10.100.188.34:6814/6735,v1:10.100.188.34:6815/6735] exists,up f4582527-3eb3-4015-b442-6f4c95eed7bd osd.276 up in weight 1 up_from 2941 up_thru 7663 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6833/6665,v1:10.100.190.56:6836/6665] [v2:10.100.188.37:6832/6665,v1:10.100.188.37:6833/6665] exists,up f71b62db-1303-42f2-a6da-121a793e964a osd.277 up in weight 1 up_from 2265 up_thru 7662 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6901/6612,v1:10.100.190.58:6903/6612] [v2:10.100.188.39:6901/6612,v1:10.100.188.39:6903/6612] exists,up 0cbfafe8-6364-4a17-93d6-0741e5fff45c osd.278 up in weight 1 up_from 2260 up_thru 7662 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6869/6678,v1:10.100.190.57:6876/6678] [v2:10.100.188.38:6867/6678,v1:10.100.188.38:6875/6678] exists,up fda108ed-f92d-42d0-af55-4e675e6cb580 osd.279 up in weight 1 up_from 2262 up_thru 7661 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6828/6762,v1:10.100.190.59:6829/6762] [v2:10.100.188.40:6828/6762,v1:10.100.188.40:6829/6762] exists,up 8d819c09-a429-4edc-93f2-e94d041cec92 osd.280 up in weight 1 up_from 3764 up_thru 7664 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6883/14651,v1:10.100.190.44:6893/14651] [v2:10.100.188.25:6887/14651,v1:10.100.188.25:6894/14651] exists,up b66a6ae5-d786-44b9-bc98-26fd16c656b0 osd.281 up in weight 1 up_from 3744 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6805/14189,v1:10.100.190.43:6807/14189] [v2:10.100.188.24:6805/14189,v1:10.100.188.24:6807/14189] exists,up 9967a3e6-40f9-45a4-a9b1-2f84c04f7720 osd.282 up in weight 1 up_from 3233 up_thru 7665 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6894/9293,v1:10.100.190.49:6905/9293] [v2:10.100.188.30:6895/9293,v1:10.100.188.30:6899/9293] exists,up 60b06bf8-5623-467d-b07f-9e1fd4e65c64 osd.283 up in weight 1 up_from 3297 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6854/9616,v1:10.100.190.45:6857/9616] [v2:10.100.188.26:6854/9616,v1:10.100.188.26:6856/9616] exists,up 716c1d8a-16b1-42e5-a31f-69cc2c325100 osd.284 up in weight 1 up_from 7547 up_thru 7663 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6800/6685,v1:10.100.190.48:6802/6685] [v2:10.100.188.29:6800/6685,v1:10.100.188.29:6801/6685] exists,up 9fdec204-02ae-45b1-af23-4c389ff39485 osd.285 up in weight 1 up_from 2262 up_thru 7662 down_at 2255 last_clean_interval [2024,2254) [v2:10.100.190.47:6833/6654,v1:10.100.190.47:6843/6654] [v2:10.100.188.28:6836/6654,v1:10.100.188.28:6843/6654] exists,up cccf02c7-0fdf-492b-a493-573d074ea615 osd.286 up in weight 1 up_from 2263 up_thru 7662 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6912/6692,v1:10.100.190.50:6913/6692] [v2:10.100.188.31:6912/6692,v1:10.100.188.31:6913/6692] exists,up bd697e2d-0e65-429f-a330-25bf9b85d22c osd.287 up in weight 1 up_from 2264 up_thru 7662 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6850/6722,v1:10.100.190.51:6855/6722] [v2:10.100.188.32:6848/6722,v1:10.100.188.32:6855/6722] exists,up ecb3d462-5f56-4d25-9fed-439631a5ba31 osd.288 up in weight 1 up_from 2380 up_thru 7664 down_at 2042 last_clean_interval [2036,2041) [v2:10.100.190.52:6822/6740,v1:10.100.190.52:6826/6740] [v2:10.100.188.33:6822/6740,v1:10.100.188.33:6824/6740] exists,up b2102620-7c59-4208-b510-f5c59a09c7c1 osd.289 up in weight 1 up_from 2264 up_thru 7583 down_at 2263 last_clean_interval [2023,2257) [v2:10.100.190.46:6894/6761,v1:10.100.190.46:6900/6761] [v2:10.100.188.27:6893/6761,v1:10.100.188.27:6899/6761] exists,up d71b449c-2250-4724-aeb3-ba38429288ee osd.290 up in weight 1 up_from 7557 up_thru 7661 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6870/6626,v1:10.100.190.40:6876/6626] [v2:10.100.188.21:6868/6626,v1:10.100.188.21:6873/6626] exists,up a2f65758-9653-4050-ab56-efa28b9718fe osd.291 up in weight 1 up_from 3660 up_thru 7661 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6854/17107,v1:10.100.190.42:6861/17107] [v2:10.100.188.23:6858/17107,v1:10.100.188.23:6861/17107] exists,up 7679e082-f878-4d79-a461-c8435f60b48b osd.292 up in weight 1 up_from 2264 up_thru 7662 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6897/6701,v1:10.100.190.55:6900/6701] [v2:10.100.188.36:6898/6701,v1:10.100.188.36:6899/6701] exists,up cfa64c7b-2270-4e25-984c-255bc8ff1778 osd.293 up in weight 1 up_from 2263 up_thru 7665 down_at 2050 last_clean_interval [2039,2049) [v2:10.100.190.54:6804/6745,v1:10.100.190.54:6805/6745] [v2:10.100.188.35:6804/6745,v1:10.100.188.35:6805/6745] exists,up afdfece1-d950-4bba-8f5c-bd519a0dc812 osd.294 up in weight 1 up_from 7664 up_thru 7667 down_at 7564 last_clean_interval [2025,7563) [v2:10.100.190.41:6808/6624,v1:10.100.190.41:6809/6624] [v2:10.100.188.22:6808/6624,v1:10.100.188.22:6809/6624] exists,up 165a5670-915a-4901-8de0-354799afdff0 osd.295 up in weight 1 up_from 2630 up_thru 7664 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6891/6787,v1:10.100.190.53:6900/6787] [v2:10.100.188.34:6886/6787,v1:10.100.188.34:6899/6787] exists,up 141a6fc4-92db-4bfa-b2e9-838bdfcbfda2 osd.296 up in weight 1 up_from 2262 up_thru 7662 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6832/6661,v1:10.100.190.58:6833/6661] [v2:10.100.188.39:6832/6661,v1:10.100.188.39:6833/6661] exists,up 113b9ff6-9879-4a7b-b008-a322584635b1 osd.297 up in weight 1 up_from 2939 up_thru 7663 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6882/6658,v1:10.100.190.56:6887/6658] [v2:10.100.188.37:6879/6658,v1:10.100.188.37:6886/6658] exists,up 155162ce-ebd9-455a-b2de-ef90e1033282 osd.298 up in weight 1 up_from 2260 up_thru 7661 down_at 2109 last_clean_interval [2037,2102) [v2:10.100.190.57:6804/6696,v1:10.100.190.57:6807/6696] [v2:10.100.188.38:6806/6696,v1:10.100.188.38:6807/6696] exists,up fa14d40a-a8c4-4340-a54e-b4d49441c45e osd.299 up in weight 1 up_from 2262 up_thru 7662 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6873/6729,v1:10.100.190.59:6879/6729] [v2:10.100.188.40:6876/6729,v1:10.100.188.40:6879/6729] exists,up 47981397-4117-4482-a9e2-10f0fc0182a9 osd.300 up in weight 1 up_from 3762 up_thru 7664 down_at 3748 last_clean_interval [3425,3747) [v2:10.100.190.44:6828/14632,v1:10.100.190.44:6830/14632] [v2:10.100.188.25:6828/14632,v1:10.100.188.25:6830/14632] exists,up 01c11f0e-88cb-45a0-989b-560c363428f3 osd.301 up in weight 1 up_from 3233 up_thru 7660 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6844/9315,v1:10.100.190.49:6845/9315] [v2:10.100.188.30:6844/9315,v1:10.100.188.30:6845/9315] exists,up b08d9e2b-355b-4f73-8a47-1039e6812106 osd.302 up in weight 1 up_from 3746 up_thru 7663 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6853/14373,v1:10.100.190.43:6857/14373] [v2:10.100.188.24:6854/14373,v1:10.100.188.24:6857/14373] exists,up 1e943ab2-b4e6-4164-885d-7a018965381e osd.303 up in weight 1 up_from 2260 up_thru 7661 down_at 2256 last_clean_interval [2023,2254) [v2:10.100.190.47:6812/6691,v1:10.100.190.47:6813/6691] [v2:10.100.188.28:6812/6691,v1:10.100.188.28:6813/6691] exists,up eabb8c4c-e9f9-448a-b09e-ea3abbd4896c osd.304 up in weight 1 up_from 3298 up_thru 7661 down_at 2263 last_clean_interval [2024,2257) [v2:10.100.190.45:6870/9610,v1:10.100.190.45:6876/9610] [v2:10.100.188.26:6870/9610,v1:10.100.188.26:6876/9610] exists,up 2ed156c9-ce42-481b-bd7c-eea0b23bb7ff osd.305 up in weight 1 up_from 7548 up_thru 7661 down_at 7397 last_clean_interval [3148,7394) [v2:10.100.190.48:6818/6730,v1:10.100.190.48:6823/6730] [v2:10.100.188.29:6820/6730,v1:10.100.188.29:6823/6730] exists,up 739ffa15-f469-4ee2-96f8-cdee90fda7aa osd.306 up in weight 1 up_from 2264 up_thru 7662 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6916/6728,v1:10.100.190.50:6919/6728] [v2:10.100.188.31:6916/6728,v1:10.100.188.31:6919/6728] exists,up c9c0d265-8fab-4219-a8cb-e3e8c0fb7e3f osd.307 up in weight 1 up_from 2262 up_thru 7661 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6812/6731,v1:10.100.190.51:6814/6731] [v2:10.100.188.32:6812/6731,v1:10.100.188.32:6815/6731] exists,up abe1b884-7f0e-4f10-8c0f-078051879f6c osd.308 up in weight 1 up_from 2263 up_thru 7661 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6823/6695,v1:10.100.190.55:6828/6695] [v2:10.100.188.36:6821/6695,v1:10.100.188.36:6824/6695] exists,up 96607bb7-bfba-45e4-8023-7f181c368b50 osd.309 up in weight 1 up_from 2379 up_thru 7661 down_at 2043 last_clean_interval [2037,2041) [v2:10.100.190.52:6835/6686,v1:10.100.190.52:6838/6686] [v2:10.100.188.33:6833/6686,v1:10.100.188.33:6836/6686] exists,up 5b16799e-346b-47ca-b058-b8711aecdb13 osd.310 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6861/6688,v1:10.100.190.46:6866/6688] [v2:10.100.188.27:6861/6688,v1:10.100.188.27:6867/6688] exists,up e1741535-e641-4c40-a62e-7e00df837106 osd.311 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6873/6691,v1:10.100.190.40:6878/6691] [v2:10.100.188.21:6874/6691,v1:10.100.188.21:6878/6691] exists,up 4909a261-3334-4c9e-aaee-a940c0828867 osd.312 up in weight 1 up_from 3661 up_thru 7663 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6883/17142,v1:10.100.190.42:6889/17142] [v2:10.100.188.23:6881/17142,v1:10.100.188.23:6886/17142] exists,up e441ee1e-f199-444c-8a06-2c5c91c33f90 osd.313 up in weight 1 up_from 2263 up_thru 7662 down_at 2051 last_clean_interval [2037,2049) [v2:10.100.190.54:6891/6718,v1:10.100.190.54:6898/6718] [v2:10.100.188.35:6886/6718,v1:10.100.188.35:6890/6718] exists,up 1d0e9b05-58e1-4987-b6d6-f0689d5609f8 osd.314 up in weight 1 up_from 7660 up_thru 7661 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6850/6628,v1:10.100.190.41:6855/6628] [v2:10.100.188.22:6852/6628,v1:10.100.188.22:6857/6628] exists,up e520f40f-f550-439e-9f46-b854a0d88f1b osd.315 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6882/6780,v1:10.100.190.53:6889/6780] [v2:10.100.188.34:6881/6780,v1:10.100.188.34:6892/6780] exists,up 9db13c25-2931-4182-95c2-f468a5d70081 osd.316 up in weight 1 up_from 2262 up_thru 7661 down_at 2096 last_clean_interval [1911,2078) [v2:10.100.190.58:6804/6689,v1:10.100.190.58:6812/6689] [v2:10.100.188.39:6808/6689,v1:10.100.188.39:6811/6689] exists,up 3b0b30d5-519d-4ee8-94c5-99d1dc86e73f osd.317 up in weight 1 up_from 2941 up_thru 7664 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6842/6534,v1:10.100.190.56:6846/6534] [v2:10.100.188.37:6839/6534,v1:10.100.188.37:6841/6534] exists,up 8c63c1d2-8475-4f05-8c3b-5c7c6c81f5e4 osd.318 up in weight 1 up_from 2260 up_thru 7664 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6865/6710,v1:10.100.190.57:6870/6710] [v2:10.100.188.38:6863/6710,v1:10.100.188.38:6869/6710] exists,up 4825f6a4-d210-4b81-8a24-6cfb6db20452 osd.319 up in weight 1 up_from 2262 up_thru 7662 down_at 2239 last_clean_interval [1902,2220) [v2:10.100.190.59:6860/6672,v1:10.100.190.59:6861/6672] [v2:10.100.188.40:6859/6672,v1:10.100.188.40:6861/6672] exists,up b0414356-7cf2-400b-8ce2-21324c95f218 osd.320 up in weight 1 up_from 3763 up_thru 7664 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6851/14653,v1:10.100.190.44:6856/14653] [v2:10.100.188.25:6849/14653,v1:10.100.188.25:6853/14653] exists,up 52177851-34c8-4770-9a7d-b615697c3dff osd.321 up in weight 1 up_from 3232 up_thru 7660 down_at 2230 last_clean_interval [2023,2209) [v2:10.100.190.49:6869/9317,v1:10.100.190.49:6874/9317] [v2:10.100.188.30:6870/9317,v1:10.100.188.30:6874/9317] exists,up 05c660ff-09d2-4906-bd95-b17dfda0b678 osd.322 up in weight 1 up_from 3746 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6911/14533,v1:10.100.190.43:6914/14533] [v2:10.100.188.24:6911/14533,v1:10.100.188.24:6914/14533] exists,up e309e5a3-abc7-4570-aea8-992cb2a485d9 osd.323 up in weight 1 up_from 3298 up_thru 7662 down_at 2263 last_clean_interval [2023,2257) [v2:10.100.190.45:6859/9572,v1:10.100.190.45:6865/9572] [v2:10.100.188.26:6859/9572,v1:10.100.188.26:6864/9572] exists,up 71ab1b01-42f2-44ec-95b0-3d5b6818c60a osd.324 up in weight 1 up_from 2262 up_thru 7663 down_at 2255 last_clean_interval [2023,2254) [v2:10.100.190.47:6805/6610,v1:10.100.190.47:6806/6610] [v2:10.100.188.28:6804/6610,v1:10.100.188.28:6805/6610] exists,up a73e6d72-b0db-4e74-ad19-06f8f572275b osd.325 up in weight 1 up_from 7547 up_thru 7661 down_at 7397 last_clean_interval [3150,7394) [v2:10.100.190.48:6801/6723,v1:10.100.190.48:6804/6723] [v2:10.100.188.29:6802/6723,v1:10.100.188.29:6803/6723] exists,up f3cfdc0a-80de-49fd-a4e4-8b24e277c23e osd.326 up in weight 1 up_from 2263 up_thru 7661 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6914/6680,v1:10.100.190.55:6915/6680] [v2:10.100.188.36:6914/6680,v1:10.100.188.36:6915/6680] exists,up 263c1eb5-404f-4685-b593-db11b59e0838 osd.327 up in weight 1 up_from 2260 up_thru 7661 down_at 2078 last_clean_interval [2037,2060) [v2:10.100.190.50:6829/6679,v1:10.100.190.50:6831/6679] [v2:10.100.188.31:6829/6679,v1:10.100.188.31:6831/6679] exists,up 91f6033d-ea07-48c9-8e81-093e231b30c4 osd.328 up in weight 1 up_from 2262 up_thru 7664 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6851/6771,v1:10.100.190.51:6858/6771] [v2:10.100.188.32:6852/6771,v1:10.100.188.32:6859/6771] exists,up 003f62ab-cf12-490c-b074-7e4403c730ad osd.329 up in weight 1 up_from 2380 up_thru 7662 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6897/6663,v1:10.100.190.52:6902/6663] [v2:10.100.188.33:6893/6663,v1:10.100.188.33:6901/6663] exists,up a2e9f92e-9228-41d8-8b50-6e3547e7e299 osd.330 up in weight 1 up_from 7557 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6854/6738,v1:10.100.190.40:6858/6738] [v2:10.100.188.21:6853/6738,v1:10.100.188.21:6861/6738] exists,up 34a4492f-272a-4178-89fa-3f99910293f0 osd.331 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6895/6802,v1:10.100.190.46:6901/6802] [v2:10.100.188.27:6894/6802,v1:10.100.188.27:6900/6802] exists,up 4b48ea42-68d4-4ae9-8347-838ced1c5d33 osd.332 up in weight 1 up_from 2262 up_thru 7662 down_at 2051 last_clean_interval [2034,2049) [v2:10.100.190.54:6817/6664,v1:10.100.190.54:6820/6664] [v2:10.100.188.35:6817/6664,v1:10.100.188.35:6820/6664] exists,up 5b14a16c-dfad-441b-b6fc-825ad826c509 osd.333 up in weight 1 up_from 3661 up_thru 7662 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6892/17207,v1:10.100.190.42:6896/17207] [v2:10.100.188.23:6893/17207,v1:10.100.188.23:6899/17207] exists,up a2e47691-84ca-4ece-ac2c-71fee6362484 osd.334 up in weight 1 up_from 7661 up_thru 7663 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6842/6690,v1:10.100.190.41:6849/6690] [v2:10.100.188.22:6843/6690,v1:10.100.188.22:6848/6690] exists,up 494ff536-da44-4212-ad4f-a2fd19ca4ef5 osd.335 up in weight 1 up_from 2631 up_thru 7662 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6825/6756,v1:10.100.190.53:6829/6756] [v2:10.100.188.34:6825/6756,v1:10.100.188.34:6829/6756] exists,up c763fa12-c2bb-4791-93e1-77f49bc76421 osd.336 up in weight 1 up_from 2264 up_thru 7662 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6846/6608,v1:10.100.190.58:6847/6608] [v2:10.100.188.39:6846/6608,v1:10.100.188.39:6847/6608] exists,up c66e4da4-36df-4d87-bed7-6921cb1d79bb osd.337 up in weight 1 up_from 2941 up_thru 7662 down_at 2161 last_clean_interval [2037,2149) [v2:10.100.190.56:6844/6583,v1:10.100.190.56:6850/6583] [v2:10.100.188.37:6842/6583,v1:10.100.188.37:6847/6583] exists,up 930b8d63-d0bd-4aea-aabf-f1483f413a95 osd.338 up in weight 1 up_from 2262 up_thru 7662 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6864/6773,v1:10.100.190.57:6871/6773] [v2:10.100.188.38:6864/6773,v1:10.100.188.38:6871/6773] exists,up a3d4ce51-6df5-4bf1-9923-cbf5dc1c2262 osd.339 up in weight 1 up_from 2262 up_thru 7661 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6819/6713,v1:10.100.190.59:6821/6713] [v2:10.100.188.40:6820/6713,v1:10.100.188.40:6821/6713] exists,up 628193eb-62c8-4aad-9049-2696c94adf20 osd.340 up in weight 1 up_from 3762 up_thru 7661 down_at 3748 last_clean_interval [3427,3747) [v2:10.100.190.44:6808/14429,v1:10.100.190.44:6809/14429] [v2:10.100.188.25:6808/14429,v1:10.100.188.25:6809/14429] exists,up fc4aa9ff-232c-4107-9911-a31ecb7542ed osd.341 up in weight 1 up_from 3232 up_thru 7662 down_at 2230 last_clean_interval [2023,2209) [v2:10.100.190.49:6856/9305,v1:10.100.190.49:6858/9305] [v2:10.100.188.30:6855/9305,v1:10.100.188.30:6859/9305] exists,up d4f60a58-419b-4594-a034-b8a48067e516 osd.342 up in weight 1 up_from 3745 up_thru 7662 down_at 3728 last_clean_interval [3332,3727) [v2:10.100.190.43:6832/14221,v1:10.100.190.43:6833/14221] [v2:10.100.188.24:6832/14221,v1:10.100.188.24:6833/14221] exists,up cea22766-5b63-44a8-8fae-799e5d5e1804 osd.343 up in weight 1 up_from 2264 up_thru 7584 down_at 2255 last_clean_interval [2023,2254) [v2:10.100.190.47:6914/6665,v1:10.100.190.47:6917/6665] [v2:10.100.188.28:6914/6665,v1:10.100.188.28:6917/6665] exists,up 6e55af08-b5f5-40fd-a24f-f9fe0dd3dd6b osd.344 up in weight 1 up_from 3298 up_thru 7661 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6874/9638,v1:10.100.190.45:6878/9638] [v2:10.100.188.26:6874/9638,v1:10.100.188.26:6878/9638] exists,up ec2fe060-70eb-449b-86fe-2257e5c8e701 osd.345 up in weight 1 up_from 7547 up_thru 7662 down_at 7397 last_clean_interval [3148,7394) [v2:10.100.190.48:6889/6741,v1:10.100.190.48:6896/6741] [v2:10.100.188.29:6887/6741,v1:10.100.188.29:6893/6741] exists,up 5646f628-ef2e-4bda-ba45-7e6c0e4c9b76 osd.346 up in weight 1 up_from 2264 up_thru 7661 down_at 2095 last_clean_interval [2037,2078) [v2:10.100.190.55:6893/6712,v1:10.100.190.55:6896/6712] [v2:10.100.188.36:6893/6712,v1:10.100.188.36:6896/6712] exists,up 4ab9ff7c-efad-4510-aa3a-66299adfa07a osd.347 up in weight 1 up_from 2261 up_thru 7660 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6882/6717,v1:10.100.190.50:6886/6717] [v2:10.100.188.31:6881/6717,v1:10.100.188.31:6884/6717] exists,up 7083a96f-e8b4-47c1-98be-47934d88ac84 osd.348 up in weight 1 up_from 2380 up_thru 7661 down_at 2042 last_clean_interval [2038,2041) [v2:10.100.190.52:6860/6722,v1:10.100.190.52:6862/6722] [v2:10.100.188.33:6859/6722,v1:10.100.188.33:6860/6722] exists,up 5b7f52f7-fe21-45ec-8430-16c387eb401e osd.349 up in weight 1 up_from 2263 up_thru 7660 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6843/6663,v1:10.100.190.51:6845/6663] [v2:10.100.188.32:6842/6663,v1:10.100.188.32:6845/6663] exists,up 0ec07be3-da34-4917-bb91-2b1947fe613a osd.350 up in weight 1 up_from 2263 up_thru 7664 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6824/6698,v1:10.100.190.46:6825/6698] [v2:10.100.188.27:6823/6698,v1:10.100.188.27:6825/6698] exists,up 6ec9d419-1225-4c36-b2bf-cbddb319b5f4 osd.351 up in weight 1 up_from 7557 up_thru 7579 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6899/6682,v1:10.100.190.40:6904/6682] [v2:10.100.188.21:6893/6682,v1:10.100.188.21:6897/6682] exists,up df5a03cb-a7d1-4c83-b429-b1c300b1f130 osd.352 up in weight 1 up_from 2263 up_thru 7661 down_at 2051 last_clean_interval [2036,2049) [v2:10.100.190.54:6814/6678,v1:10.100.190.54:6815/6678] [v2:10.100.188.35:6814/6678,v1:10.100.188.35:6815/6678] exists,up 04c59fca-b731-4a67-922b-30ccfa90907f osd.353 up in weight 1 up_from 3659 up_thru 7661 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6836/17091,v1:10.100.190.42:6837/17091] [v2:10.100.188.23:6836/17091,v1:10.100.188.23:6837/17091] exists,up 05e5d0cb-c6f8-4c86-b18f-e88fe0de77ca osd.354 up in weight 1 up_from 2265 up_thru 7662 down_at 2096 last_clean_interval [1912,2078) [v2:10.100.190.58:6881/6706,v1:10.100.190.58:6885/6706] [v2:10.100.188.39:6882/6706,v1:10.100.188.39:6886/6706] exists,up 39346332-dcd7-46b7-a257-00a155048f5d osd.355 up in weight 1 up_from 2630 up_thru 7662 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6885/6729,v1:10.100.190.53:6896/6729] [v2:10.100.188.34:6883/6729,v1:10.100.188.34:6893/6729] exists,up 4124e0c9-aaac-430f-9c72-f453cc0f6683 osd.356 up in weight 1 up_from 7660 up_thru 7663 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6885/6693,v1:10.100.190.41:6893/6693] [v2:10.100.188.22:6886/6693,v1:10.100.188.22:6894/6693] exists,up 2f9d390a-fc9c-4f24-89ab-26b78dd2901c osd.357 up in weight 1 up_from 2940 up_thru 7664 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6881/6646,v1:10.100.190.56:6888/6646] [v2:10.100.188.37:6887/6646,v1:10.100.188.37:6892/6646] exists,up d484466d-fa37-4555-9d39-43033f92013e osd.358 up in weight 1 up_from 2260 up_thru 7662 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6894/6729,v1:10.100.190.57:6897/6729] [v2:10.100.188.38:6892/6729,v1:10.100.188.38:6895/6729] exists,up 63ae6ff7-4ff2-45cf-b3eb-204a7777a135 osd.359 up in weight 1 up_from 2262 up_thru 7662 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6833/6638,v1:10.100.190.59:6836/6638] [v2:10.100.188.40:6833/6638,v1:10.100.188.40:6836/6638] exists,up 18ed58de-04d7-4336-88f5-e94687b99209 osd.360 up in weight 1 up_from 3763 up_thru 7662 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6844/14586,v1:10.100.190.44:6849/14586] [v2:10.100.188.25:6845/14586,v1:10.100.188.25:6847/14586] exists,up 3515f40d-eea4-4dba-a181-e765eb31e6e2 osd.361 up in weight 1 up_from 3233 up_thru 7661 down_at 2230 last_clean_interval [2023,2209) [v2:10.100.190.49:6868/9325,v1:10.100.190.49:6873/9325] [v2:10.100.188.30:6867/9325,v1:10.100.188.30:6871/9325] exists,up 86bc99ae-a64e-4272-8b1b-09213923d7f8 osd.362 up in weight 1 up_from 2262 up_thru 7662 down_at 2256 last_clean_interval [2024,2254) [v2:10.100.190.47:6830/6622,v1:10.100.190.47:6838/6622] [v2:10.100.188.28:6828/6622,v1:10.100.188.28:6834/6622] exists,up 8b3b81a7-8f32-4a7f-bd4b-8928f67a823e osd.363 up in weight 1 up_from 3744 up_thru 7662 down_at 3728 last_clean_interval [3332,3727) [v2:10.100.190.43:6804/14187,v1:10.100.190.43:6806/14187] [v2:10.100.188.24:6804/14187,v1:10.100.188.24:6806/14187] exists,up c8288e0a-95db-4cc4-b8be-d1180311dce0 osd.364 up in weight 1 up_from 7547 up_thru 7660 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6857/6797,v1:10.100.190.48:6859/6797] [v2:10.100.188.29:6849/6797,v1:10.100.188.29:6859/6797] exists,up 54a34b51-7a2c-4a1c-b654-98624daa7c3a osd.365 up in weight 1 up_from 3298 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6804/9542,v1:10.100.190.45:6806/9542] [v2:10.100.188.26:6804/9542,v1:10.100.188.26:6806/9542] exists,up 4710ce5a-e5df-4bf2-80b9-8c25b7b7c64b osd.366 up in weight 1 up_from 2263 up_thru 7664 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6886/6648,v1:10.100.190.55:6889/6648] [v2:10.100.188.36:6886/6648,v1:10.100.188.36:6888/6648] exists,up 8ad25ef8-a703-460b-a7a7-50b87f1a93fa osd.367 up in weight 1 up_from 2263 up_thru 7662 down_at 2079 last_clean_interval [2036,2060) [v2:10.100.190.50:6860/6659,v1:10.100.190.50:6867/6659] [v2:10.100.188.31:6865/6659,v1:10.100.188.31:6869/6659] exists,up 612802df-042d-433e-af3a-dbbe92933d71 osd.368 up in weight 1 up_from 2261 up_thru 7662 down_at 2050 last_clean_interval [2033,2049) [v2:10.100.190.54:6874/6723,v1:10.100.190.54:6888/6723] [v2:10.100.188.35:6885/6723,v1:10.100.188.35:6893/6723] exists,up 7415ffb3-0730-4619-8904-9fc96dde53e0 osd.369 up in weight 1 up_from 2263 up_thru 7663 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6857/6757,v1:10.100.190.46:6864/6757] [v2:10.100.188.27:6858/6757,v1:10.100.188.27:6863/6757] exists,up b06ce988-4208-4eaf-a1e3-f07710ebca51 osd.370 up in weight 1 up_from 2264 up_thru 7663 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6885/6691,v1:10.100.190.51:6889/6691] [v2:10.100.188.32:6883/6691,v1:10.100.188.32:6888/6691] exists,up 5f668e33-8e26-4b31-93d2-bdb9194a7151 osd.371 up in weight 1 up_from 2380 up_thru 7662 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6893/6716,v1:10.100.190.52:6903/6716] [v2:10.100.188.33:6897/6716,v1:10.100.188.33:6903/6716] exists,up 7187a8a3-5f09-4db8-aa08-af1f5ed6bee9 osd.372 up in weight 1 up_from 7557 up_thru 7662 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6813/6718,v1:10.100.190.40:6816/6718] [v2:10.100.188.21:6813/6718,v1:10.100.188.21:6816/6718] exists,up 804200cb-89ee-46cb-be21-8cc7849772d9 osd.373 up in weight 1 up_from 2265 up_thru 7662 down_at 2096 last_clean_interval [1912,2078) [v2:10.100.190.58:6876/6646,v1:10.100.190.58:6882/6646] [v2:10.100.188.39:6879/6646,v1:10.100.188.39:6883/6646] exists,up 3c7c0f3d-5d21-44b5-b903-30973c8299ee osd.374 up in weight 1 up_from 3661 up_thru 7662 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6847/17100,v1:10.100.190.42:6849/17100] [v2:10.100.188.23:6846/17100,v1:10.100.188.23:6848/17100] exists,up a06bdfac-8aa4-4089-95af-4337ecc571f3 osd.375 up in weight 1 up_from 2630 up_thru 7662 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6874/6719,v1:10.100.190.53:6877/6719] [v2:10.100.188.34:6873/6719,v1:10.100.188.34:6877/6719] exists,up c65287ed-d962-41d9-a06e-afb5a78bd40e osd.376 up in weight 1 up_from 2939 up_thru 7661 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6805/6656,v1:10.100.190.56:6808/6656] [v2:10.100.188.37:6805/6656,v1:10.100.188.37:6808/6656] exists,up 671005c2-b018-4a8e-b982-5cb4b89cd295 osd.377 up in weight 1 up_from 2260 up_thru 7663 down_at 2109 last_clean_interval [2036,2102) [v2:10.100.190.57:6826/6680,v1:10.100.190.57:6830/6680] [v2:10.100.188.38:6826/6680,v1:10.100.188.38:6830/6680] exists,up ddf5caf6-b842-49c3-85f4-564232e7f783 osd.378 up in weight 1 up_from 7660 up_thru 7663 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6829/6661,v1:10.100.190.41:6832/6661] [v2:10.100.188.22:6829/6661,v1:10.100.188.22:6831/6661] exists,up 31c58a69-7656-4188-b8ec-6c7f930d5342 osd.379 up in weight 1 up_from 2262 up_thru 7665 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6810/6721,v1:10.100.190.59:6813/6721] [v2:10.100.188.40:6809/6721,v1:10.100.188.40:6812/6721] exists,up d31d3ace-4309-4dd4-a9c6-5ff3d0d94939 osd.380 up in weight 1 up_from 3763 up_thru 7664 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6887/14736,v1:10.100.190.44:6894/14736] [v2:10.100.188.25:6885/14736,v1:10.100.188.25:6891/14736] exists,up 38518998-4284-40bf-9cd0-22de6be49dee osd.381 up in weight 1 up_from 3231 up_thru 7662 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6862/9319,v1:10.100.190.49:6865/9319] [v2:10.100.188.30:6862/9319,v1:10.100.188.30:6864/9319] exists,up af092133-d394-4f3f-a39c-147596e283de osd.382 up in weight 1 up_from 2262 up_thru 7661 down_at 2255 last_clean_interval [2023,2254) [v2:10.100.190.47:6800/6702,v1:10.100.190.47:6801/6702] [v2:10.100.188.28:6800/6702,v1:10.100.188.28:6801/6702] exists,up 2c0877aa-f8e6-4598-8d14-dc0a7d344ba8 osd.383 up in weight 1 up_from 3745 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6800/14154,v1:10.100.190.43:6801/14154] [v2:10.100.188.24:6800/14154,v1:10.100.188.24:6801/14154] exists,up 584f7149-1a4d-4996-a722-21cb7e046c01 osd.384 up in weight 1 up_from 7548 up_thru 7662 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6844/6711,v1:10.100.190.48:6847/6711] [v2:10.100.188.29:6845/6711,v1:10.100.188.29:6848/6711] exists,up 2151d0ad-879b-4016-bc3f-19c83e30d33d osd.385 up in weight 1 up_from 2264 up_thru 7660 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6820/6757,v1:10.100.190.55:6827/6757] [v2:10.100.188.36:6822/6757,v1:10.100.188.36:6827/6757] exists,up d1b73a0a-9747-4983-8328-4992501adef4 osd.386 up in weight 1 up_from 3298 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6864/9599,v1:10.100.190.45:6872/9599] [v2:10.100.188.26:6867/9599,v1:10.100.188.26:6873/9599] exists,up 11a75825-06d0-4257-8474-c821b3cd1686 osd.387 up in weight 1 up_from 2263 up_thru 7664 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6801/6591,v1:10.100.190.50:6805/6591] [v2:10.100.188.31:6802/6591,v1:10.100.188.31:6803/6591] exists,up 592e999c-2e1c-478f-b554-b90db143219b osd.388 up in weight 1 up_from 2263 up_thru 7662 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6836/6766,v1:10.100.190.51:6837/6766] [v2:10.100.188.32:6836/6766,v1:10.100.188.32:6837/6766] exists,up c957a33d-19bd-4060-8fcc-c62d17ae2c7d osd.389 up in weight 1 up_from 2379 up_thru 7662 down_at 2043 last_clean_interval [2038,2041) [v2:10.100.190.52:6820/6754,v1:10.100.190.52:6821/6754] [v2:10.100.188.33:6820/6754,v1:10.100.188.33:6821/6754] exists,up 21f7c14f-8b9f-42b8-90d3-ec54a9b888a4 osd.390 up in weight 1 up_from 2261 up_thru 7663 down_at 2260 last_clean_interval [2023,2257) [v2:10.100.190.46:6890/6678,v1:10.100.190.46:6899/6678] [v2:10.100.188.27:6896/6678,v1:10.100.188.27:6901/6678] exists,up 3cbc4e6f-6a6e-42ff-887a-e5765d1475fe osd.391 up in weight 1 up_from 2260 up_thru 7660 down_at 2051 last_clean_interval [2036,2049) [v2:10.100.190.54:6842/6693,v1:10.100.190.54:6845/6693] [v2:10.100.188.35:6840/6693,v1:10.100.188.35:6842/6693] exists,up 5e8f9a24-ea8c-44c8-a358-bbcfffa5b432 osd.392 up in weight 1 up_from 7558 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6881/6687,v1:10.100.190.40:6884/6687] [v2:10.100.188.21:6880/6687,v1:10.100.188.21:6885/6687] exists,up e4ab1eac-1194-4feb-ba12-9100f2d27ec9 osd.393 up in weight 1 up_from 2260 up_thru 7661 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6828/6628,v1:10.100.190.58:6829/6628] [v2:10.100.188.39:6828/6628,v1:10.100.188.39:6829/6628] exists,up e818a078-0330-4434-8a05-aa79a1a8bd71 osd.394 up in weight 1 up_from 3661 up_thru 7661 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6840/17024,v1:10.100.190.42:6841/17024] [v2:10.100.188.23:6840/17024,v1:10.100.188.23:6841/17024] exists,up e6e91e70-77c7-4838-aa95-e0d6adfbe439 osd.395 up in weight 1 up_from 2271 up_thru 7660 down_at 2109 last_clean_interval [2037,2102) [v2:10.100.190.57:6912/6783,v1:10.100.190.57:6913/6783] [v2:10.100.188.38:6912/6783,v1:10.100.188.38:6913/6783] exists,up 6c1b8d1c-733b-4c79-b6c2-47c716082fc3 osd.396 up in weight 1 up_from 2941 up_thru 7661 down_at 2161 last_clean_interval [2036,2149) [v2:10.100.190.56:6845/6661,v1:10.100.190.56:6853/6661] [v2:10.100.188.37:6845/6661,v1:10.100.188.37:6848/6661] exists,up e3f6bbb0-3da4-4677-bcce-f01ca6106b30 osd.397 up in weight 1 up_from 2630 up_thru 7662 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6893/6767,v1:10.100.190.53:6905/6767] [v2:10.100.188.34:6897/6767,v1:10.100.188.34:6903/6767] exists,up 1147d9ff-58a6-4bb8-b74b-6603c8c812f9 osd.398 up in weight 1 up_from 7660 up_thru 7663 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6877/6597,v1:10.100.190.41:6879/6597] [v2:10.100.188.22:6877/6597,v1:10.100.188.22:6879/6597] exists,up 758318ff-0180-423f-85bb-edd3f4d30349 osd.399 up in weight 1 up_from 2264 up_thru 7660 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6920/6753,v1:10.100.190.59:6921/6753] [v2:10.100.188.40:6920/6753,v1:10.100.188.40:6921/6753] exists,up 742757ed-376e-4ca4-87ce-3e3ab9c889f7 osd.400 up in weight 1 up_from 3763 up_thru 7662 down_at 3748 last_clean_interval [3428,3747) [v2:10.100.190.44:6881/14749,v1:10.100.190.44:6889/14749] [v2:10.100.188.25:6881/14749,v1:10.100.188.25:6888/14749] exists,up 32a446b4-879b-493b-9518-42b253ec288e osd.401 up in weight 1 up_from 3233 up_thru 7663 down_at 2230 last_clean_interval [2023,2209) [v2:10.100.190.49:6810/9301,v1:10.100.190.49:6812/9301] [v2:10.100.188.30:6810/9301,v1:10.100.188.30:6811/9301] exists,up 0155551b-c976-4870-80c5-3d1a0d55460c osd.402 up in weight 1 up_from 2261 up_thru 7662 down_at 2260 last_clean_interval [2023,2254) [v2:10.100.190.47:6828/6652,v1:10.100.190.47:6844/6652] [v2:10.100.188.28:6838/6652,v1:10.100.188.28:6842/6652] exists,up 620bee6d-e57b-48dc-84d7-c067a0c87e37 osd.403 up in weight 1 up_from 2264 up_thru 7663 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6863/6732,v1:10.100.190.55:6864/6732] [v2:10.100.188.36:6862/6732,v1:10.100.188.36:6863/6732] exists,up d3e60e1a-9793-4e4b-944b-1c3c6a79495a osd.404 up in weight 1 up_from 7546 up_thru 7661 down_at 7397 last_clean_interval [7227,7394) [v2:10.100.190.48:6856/6747,v1:10.100.190.48:6868/6747] [v2:10.100.188.29:6861/6747,v1:10.100.188.29:6869/6747] exists,up 796edf26-021a-4bde-a00c-15f102d83b88 osd.405 up in weight 1 up_from 3745 up_thru 7663 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6845/14269,v1:10.100.190.43:6847/14269] [v2:10.100.188.24:6845/14269,v1:10.100.188.24:6847/14269] exists,up 959f22dc-64e3-4a33-95c7-08a4e9cc9b02 osd.406 up in weight 1 up_from 3297 up_thru 7661 down_at 2263 last_clean_interval [2023,2257) [v2:10.100.190.45:6906/9624,v1:10.100.190.45:6910/9624] [v2:10.100.188.26:6905/9624,v1:10.100.188.26:6910/9624] exists,up 46dbb607-d338-4ff8-a78f-801e63e2408d osd.407 up in weight 1 up_from 2263 up_thru 7559 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6846/6641,v1:10.100.190.50:6850/6641] [v2:10.100.188.31:6846/6641,v1:10.100.188.31:6849/6641] exists,up 819d3fe2-fc53-4f68-915b-520a95342afa osd.408 up in weight 1 up_from 2263 up_thru 7663 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6825/6652,v1:10.100.190.51:6828/6652] [v2:10.100.188.32:6825/6652,v1:10.100.188.32:6828/6652] exists,up c3c67e7f-40fb-4cdb-8f64-f0134adf3163 osd.409 up in weight 1 up_from 2380 up_thru 7661 down_at 2042 last_clean_interval [2038,2041) [v2:10.100.190.52:6881/6747,v1:10.100.190.52:6894/6747] [v2:10.100.188.33:6882/6747,v1:10.100.188.33:6894/6747] exists,up cc2c6e40-e1c1-4689-bbb5-5eca2c783332 osd.410 up in weight 1 up_from 2263 up_thru 7664 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6844/6657,v1:10.100.190.54:6847/6657] [v2:10.100.188.35:6843/6657,v1:10.100.188.35:6848/6657] exists,up e4d58da0-906e-48a4-a645-4c842aaba475 osd.411 up in weight 1 up_from 2263 up_thru 7664 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.46:6877/6706,v1:10.100.190.46:6879/6706] [v2:10.100.188.27:6877/6706,v1:10.100.188.27:6879/6706] exists,up 16c2d2cb-d839-4b3d-94a0-00b7f5af669e osd.412 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6895/6696,v1:10.100.190.40:6905/6696] [v2:10.100.188.21:6896/6696,v1:10.100.188.21:6905/6696] exists,up 262d1517-c372-4d95-8bdc-4f3b4b8959a7 osd.413 up in weight 1 up_from 3659 up_thru 7662 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6894/17181,v1:10.100.190.42:6901/17181] [v2:10.100.188.23:6896/17181,v1:10.100.188.23:6902/17181] exists,up 5a3e06ca-8c6a-48b0-a921-8b3bd0afae36 osd.414 up in weight 1 up_from 2264 up_thru 7661 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6856/6714,v1:10.100.190.58:6857/6714] [v2:10.100.188.39:6856/6714,v1:10.100.188.39:6857/6714] exists,up 17a661b1-2667-4301-b9d8-a4e6d31d2e05 osd.415 up in weight 1 up_from 2262 up_thru 7662 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6842/6780,v1:10.100.190.57:6847/6780] [v2:10.100.188.38:6843/6780,v1:10.100.188.38:6847/6780] exists,up 6a95c4f1-c138-4231-8b52-b1968965c501 osd.416 up in weight 1 up_from 2940 up_thru 7660 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6848/6651,v1:10.100.190.56:6863/6651] [v2:10.100.188.37:6859/6651,v1:10.100.188.37:6862/6651] exists,up 6c1801a1-44ca-4c41-88de-edc6ef97d910 osd.417 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6832/6746,v1:10.100.190.53:6833/6746] [v2:10.100.188.34:6832/6746,v1:10.100.188.34:6833/6746] exists,up 8ead36ef-92a8-4b86-9995-5f30d347e65f osd.418 up in weight 1 up_from 7661 up_thru 7662 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6894/6619,v1:10.100.190.41:6905/6619] [v2:10.100.188.22:6895/6619,v1:10.100.188.22:6906/6619] exists,up 1dcef7ae-6bfe-498c-923d-ab8a96e61e9f osd.419 up in weight 1 up_from 2260 up_thru 7662 down_at 2238 last_clean_interval [1901,2220) [v2:10.100.190.59:6808/6773,v1:10.100.190.59:6811/6773] [v2:10.100.188.40:6808/6773,v1:10.100.188.40:6811/6773] exists,up 1050fa98-6651-4d2d-9842-c249c628d1d0 osd.420 up in weight 1 up_from 3762 up_thru 7660 down_at 3749 last_clean_interval [3425,3748) [v2:10.100.190.44:6886/14745,v1:10.100.190.44:6892/14745] [v2:10.100.188.25:6883/14745,v1:10.100.188.25:6889/14745] exists,up 134068b3-346e-4944-92cc-8f42bb0104f8 osd.421 up in weight 1 up_from 2263 up_thru 7661 down_at 2256 last_clean_interval [2023,2254) [v2:10.100.190.47:6837/6627,v1:10.100.190.47:6842/6627] [v2:10.100.188.28:6830/6627,v1:10.100.188.28:6835/6627] exists,up 49a4d225-1caf-4aac-a1f4-7e60311f02ef osd.422 up in weight 1 up_from 3232 up_thru 7663 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6827/9281,v1:10.100.190.49:6829/9281] [v2:10.100.188.30:6827/9281,v1:10.100.188.30:6829/9281] exists,up 349ccd79-9b4a-4591-b899-1b1b5ff0305b osd.423 up in weight 1 up_from 2264 up_thru 7660 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6873/6654,v1:10.100.190.55:6876/6654] [v2:10.100.188.36:6873/6654,v1:10.100.188.36:6877/6654] exists,up cb92ecbc-1bed-413a-b2b2-96b9a7d98f3e osd.424 up in weight 1 up_from 7547 up_thru 7661 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6839/6678,v1:10.100.190.48:6843/6678] [v2:10.100.188.29:6839/6678,v1:10.100.188.29:6843/6678] exists,up 2062c14d-aee0-47dc-a563-424539b88325 osd.425 up in weight 1 up_from 3297 up_thru 7662 down_at 2263 last_clean_interval [2023,2257) [v2:10.100.190.45:6862/9622,v1:10.100.190.45:6868/9622] [v2:10.100.188.26:6861/9622,v1:10.100.188.26:6866/9622] exists,up 52b47708-d9d9-4bd0-96dc-8ee810a22721 osd.426 up in weight 1 up_from 3746 up_thru 7661 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6824/14276,v1:10.100.190.43:6825/14276] [v2:10.100.188.24:6824/14276,v1:10.100.188.24:6825/14276] exists,up 27e54373-cac8-42fc-9d5f-93ae0299a174 osd.427 up in weight 1 up_from 2261 up_thru 7662 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6838/6708,v1:10.100.190.50:6845/6708] [v2:10.100.188.31:6840/6708,v1:10.100.188.31:6845/6708] exists,up 20a4def5-f696-4a3d-bd2c-4c37480c94ea osd.428 up in weight 1 up_from 2262 up_thru 7661 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6883/6636,v1:10.100.190.51:6888/6636] [v2:10.100.188.32:6886/6636,v1:10.100.188.32:6891/6636] exists,up 1061a1ad-f896-4317-bcdc-4b30dd7ed6d3 osd.429 up in weight 1 up_from 2380 up_thru 7664 down_at 2043 last_clean_interval [2037,2041) [v2:10.100.190.52:6853/6706,v1:10.100.190.52:6856/6706] [v2:10.100.188.33:6853/6706,v1:10.100.188.33:6854/6706] exists,up ab847624-9931-4fac-9141-6a070e9a3eba osd.430 up in weight 1 up_from 2263 up_thru 7662 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6822/6654,v1:10.100.190.54:6827/6654] [v2:10.100.188.35:6819/6654,v1:10.100.188.35:6823/6654] exists,up e4772818-d6ec-4781-9bff-b37b8e790be8 osd.431 up in weight 1 up_from 7557 up_thru 7661 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6802/6730,v1:10.100.190.40:6803/6730] [v2:10.100.188.21:6802/6730,v1:10.100.188.21:6803/6730] exists,up 9b91fd97-c76e-468a-97e5-a5dfa264570d osd.432 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.46:6888/6796,v1:10.100.190.46:6896/6796] [v2:10.100.188.27:6890/6796,v1:10.100.188.27:6897/6796] exists,up 41c97db4-ccf9-4d31-a66b-595a373ca5b8 osd.433 up in weight 1 up_from 2263 up_thru 7661 down_at 2096 last_clean_interval [1912,2078) [v2:10.100.190.58:6836/6725,v1:10.100.190.58:6837/6725] [v2:10.100.188.39:6836/6725,v1:10.100.188.39:6837/6725] exists,up 28c2003f-00d3-4242-8ae4-8fbaa8aaa667 osd.434 up in weight 1 up_from 3660 up_thru 7660 down_at 3640 last_clean_interval [2261,3639) [v2:10.100.190.42:6905/17205,v1:10.100.190.42:6909/17205] [v2:10.100.188.23:6906/17205,v1:10.100.188.23:6910/17205] exists,up b32646e2-d3ca-45eb-a1fd-e58135c8922c osd.435 up in weight 1 up_from 2260 up_thru 7661 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6862/6768,v1:10.100.190.57:6867/6768] [v2:10.100.188.38:6862/6768,v1:10.100.188.38:6865/6768] exists,up a7d250ed-a72f-4b3b-8b3e-2ee739f0b446 osd.436 up in weight 1 up_from 2941 up_thru 7662 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6847/6573,v1:10.100.190.56:6854/6573] [v2:10.100.188.37:6846/6573,v1:10.100.188.37:6849/6573] exists,up b202f444-3c11-4f82-9790-a3f0e0654338 osd.437 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6840/6750,v1:10.100.190.53:6845/6750] [v2:10.100.188.34:6842/6750,v1:10.100.188.34:6846/6750] exists,up 2193062c-a391-4eea-ad83-23ba5ff99f29 osd.438 up in weight 1 up_from 7662 up_thru 7663 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6800/6588,v1:10.100.190.41:6801/6588] [v2:10.100.188.22:6800/6588,v1:10.100.188.22:6801/6588] exists,up a7a33031-f51a-4225-8797-8301b4f07c77 osd.439 up in weight 1 up_from 2264 up_thru 7662 down_at 2238 last_clean_interval [1901,2220) [v2:10.100.190.59:6906/6633,v1:10.100.190.59:6907/6633] [v2:10.100.188.40:6906/6633,v1:10.100.188.40:6907/6633] exists,up 8bab49d8-3b78-4056-b3fa-6c9e841ee7d5 osd.440 up in weight 1 up_from 3764 up_thru 7661 down_at 3748 last_clean_interval [3425,3747) [v2:10.100.190.44:6833/14723,v1:10.100.190.44:6836/14723] [v2:10.100.188.25:6833/14723,v1:10.100.188.25:6837/14723] exists,up 128ffb06-83f1-4f7b-997b-38978ee1b0e1 osd.441 up in weight 1 up_from 2264 up_thru 7665 down_at 2256 last_clean_interval [2023,2254) [v2:10.100.190.47:6918/6593,v1:10.100.190.47:6919/6593] [v2:10.100.188.28:6918/6593,v1:10.100.188.28:6920/6593] exists,up d8aed8da-cea2-4b0b-81ac-953bdc7da240 osd.442 up in weight 1 up_from 3233 up_thru 7663 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6800/9289,v1:10.100.190.49:6802/9289] [v2:10.100.188.30:6800/9289,v1:10.100.188.30:6801/9289] exists,up 26a64374-6858-46f0-b091-f5b8dfe906c0 osd.443 up in weight 1 up_from 7547 up_thru 7662 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6891/6800,v1:10.100.190.48:6899/6800] [v2:10.100.188.29:6888/6800,v1:10.100.188.29:6899/6800] exists,up 6a2fc0a6-d98d-4606-be81-c3844d6f9afe osd.444 up in weight 1 up_from 2262 up_thru 7567 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6824/6708,v1:10.100.190.55:6830/6708] [v2:10.100.188.36:6826/6708,v1:10.100.188.36:6830/6708] exists,up af958fb8-a790-4f66-a2e5-fa27b98229ce osd.445 up in weight 1 up_from 3745 up_thru 7660 down_at 3728 last_clean_interval [3330,3727) [v2:10.100.190.43:6899/14414,v1:10.100.190.43:6901/14414] [v2:10.100.188.24:6896/14414,v1:10.100.188.24:6900/14414] exists,up 01f8a8e1-9ac7-474c-ae07-d186bfa2bfcd osd.446 up in weight 1 up_from 3298 up_thru 7662 down_at 2263 last_clean_interval [2024,2257) [v2:10.100.190.45:6908/9636,v1:10.100.190.45:6913/9636] [v2:10.100.188.26:6909/9636,v1:10.100.188.26:6914/9636] exists,up 29cacb01-7d68-4f0d-a2f7-05854cc060e3 osd.447 up in weight 1 up_from 2262 up_thru 7664 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6874/6601,v1:10.100.190.50:6878/6601] [v2:10.100.188.31:6872/6601,v1:10.100.188.31:6877/6601] exists,up d6bcf2ef-d448-40e3-a860-8c1988aaa101 osd.448 up in weight 1 up_from 2379 up_thru 7662 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6861/6750,v1:10.100.190.52:6864/6750] [v2:10.100.188.33:6864/6750,v1:10.100.188.33:6868/6750] exists,up b812cdee-94e4-4767-b510-e88e4d488d98 osd.449 up in weight 1 up_from 2261 up_thru 7661 down_at 2051 last_clean_interval [2036,2049) [v2:10.100.190.54:6840/6684,v1:10.100.190.54:6857/6684] [v2:10.100.188.35:6854/6684,v1:10.100.188.35:6863/6684] exists,up 44c18e15-615d-4864-a372-361e1c3f7b92 osd.450 up in weight 1 up_from 2264 up_thru 7662 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6924/6649,v1:10.100.190.51:6925/6649] [v2:10.100.188.32:6924/6649,v1:10.100.188.32:6925/6649] exists,up f1621a91-e8cc-47e6-8ef2-5ce1184280f3 osd.451 up in weight 1 up_from 7558 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6848/6707,v1:10.100.190.40:6852/6707] [v2:10.100.188.21:6850/6707,v1:10.100.188.21:6854/6707] exists,up 829f60c9-45d0-4b9e-b2c7-bed137cb236b osd.452 up in weight 1 up_from 2264 up_thru 7663 down_at 2263 last_clean_interval [2023,2257) [v2:10.100.190.46:6921/6765,v1:10.100.190.46:6923/6765] [v2:10.100.188.27:6921/6765,v1:10.100.188.27:6923/6765] exists,up 69fdbe53-11a2-46f5-bc7e-7ec10c755a5c osd.453 up in weight 1 up_from 2267 up_thru 7661 down_at 2096 last_clean_interval [1912,2078) [v2:10.100.190.58:6920/6625,v1:10.100.190.58:6921/6625] [v2:10.100.188.39:6920/6625,v1:10.100.188.39:6921/6625] exists,up f735ed90-d9c7-4b8b-a1a6-0ac0d355ccc8 osd.454 up in weight 1 up_from 3661 up_thru 7662 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6882/17088,v1:10.100.190.42:6888/17088] [v2:10.100.188.23:6879/17088,v1:10.100.188.23:6884/17088] exists,up 00993de2-0497-45ac-b469-7c5fc73d7c5e osd.455 up in weight 1 up_from 2259 up_thru 7660 down_at 2109 last_clean_interval [2037,2102) [v2:10.100.190.57:6848/6688,v1:10.100.190.57:6850/6688] [v2:10.100.188.38:6848/6688,v1:10.100.188.38:6850/6688] exists,up 75b96506-615c-4973-90ce-3d0dbb391088 osd.456 up in weight 1 up_from 2940 up_thru 7662 down_at 2161 last_clean_interval [2036,2149) [v2:10.100.190.56:6832/6569,v1:10.100.190.56:6837/6569] [v2:10.100.188.37:6837/6569,v1:10.100.188.37:6843/6569] exists,up e559f095-1e45-4b7a-a2a0-d15d242b3e11 osd.457 up in weight 1 up_from 2629 up_thru 7661 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6870/6702,v1:10.100.190.53:6873/6702] [v2:10.100.188.34:6870/6702,v1:10.100.188.34:6875/6702] exists,up 935148d2-d257-4fba-bcf4-59870072635a osd.458 up in weight 1 up_from 7661 up_thru 7662 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6837/6656,v1:10.100.190.41:6843/6656] [v2:10.100.188.22:6838/6656,v1:10.100.188.22:6847/6656] exists,up abebbf7a-4b79-4af0-b777-0179a4c444a0 osd.459 up in weight 1 up_from 2262 up_thru 7660 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6845/6697,v1:10.100.190.59:6850/6697] [v2:10.100.188.40:6844/6697,v1:10.100.188.40:6848/6697] exists,up 80409cf0-7dbb-4222-84a0-e97fca1f45fc osd.460 up in weight 1 up_from 3764 up_thru 7581 down_at 3748 last_clean_interval [3427,3747) [v2:10.100.190.44:6824/14740,v1:10.100.190.44:6825/14740] [v2:10.100.188.25:6824/14740,v1:10.100.188.25:6825/14740] exists,up e7eff009-7b6a-43cb-9c3f-84d453a9673d osd.461 up in weight 1 up_from 2262 up_thru 7662 down_at 2256 last_clean_interval [2023,2254) [v2:10.100.190.47:6879/6709,v1:10.100.190.47:6883/6709] [v2:10.100.188.28:6878/6709,v1:10.100.188.28:6881/6709] exists,up 734573f1-5a14-4cc6-9c02-48af40dc4f93 osd.462 up in weight 1 up_from 3231 up_thru 7662 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6849/9299,v1:10.100.190.49:6853/9299] [v2:10.100.188.30:6849/9299,v1:10.100.188.30:6852/9299] exists,up 0cf5a9fd-b933-4d96-b4c0-02f4c8a331b8 osd.463 up in weight 1 up_from 2264 up_thru 7660 down_at 2095 last_clean_interval [2037,2078) [v2:10.100.190.55:6884/6692,v1:10.100.190.55:6885/6692] [v2:10.100.188.36:6884/6692,v1:10.100.188.36:6885/6692] exists,up b04c6a3d-961c-40e9-86c6-7cfc2e19d15e osd.464 up in weight 1 up_from 7548 up_thru 7663 down_at 7397 last_clean_interval [3150,7394) [v2:10.100.190.48:6880/6673,v1:10.100.190.48:6888/6673] [v2:10.100.188.29:6876/6673,v1:10.100.188.29:6884/6673] exists,up c051098c-3cbf-486c-b6a6-9a4142578c23 osd.465 up in weight 1 up_from 3744 up_thru 7660 down_at 3728 last_clean_interval [3332,3727) [v2:10.100.190.43:6897/14416,v1:10.100.190.43:6900/14416] [v2:10.100.188.24:6897/14416,v1:10.100.188.24:6901/14416] exists,up 00e26d89-f9a1-4172-908b-9e78e853efbd osd.466 up in weight 1 up_from 3297 up_thru 7660 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6833/9505,v1:10.100.190.45:6838/9505] [v2:10.100.188.26:6835/9505,v1:10.100.188.26:6838/9505] exists,up 6cc220a9-7522-4827-b1f4-3f7b71961a25 osd.467 up in weight 1 up_from 2264 up_thru 7665 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6924/6594,v1:10.100.190.50:6925/6594] [v2:10.100.188.31:6924/6594,v1:10.100.188.31:6925/6594] exists,up 3d59cf6e-0b0b-470e-bec1-3098c9355dd0 osd.468 up in weight 1 up_from 2379 up_thru 7661 down_at 2043 last_clean_interval [2037,2041) [v2:10.100.190.52:6807/6777,v1:10.100.190.52:6809/6777] [v2:10.100.188.33:6806/6777,v1:10.100.188.33:6808/6777] exists,up 2de2d7af-6a82-49c6-a4a1-b8da18884eb4 osd.469 up in weight 1 up_from 7558 up_thru 7661 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6808/6643,v1:10.100.190.40:6810/6643] [v2:10.100.188.21:6808/6643,v1:10.100.188.21:6809/6643] exists,up 84177633-b87d-4c43-9982-37e805deb81a osd.470 up in weight 1 up_from 2264 up_thru 7662 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6880/6660,v1:10.100.190.51:6881/6660] [v2:10.100.188.32:6880/6660,v1:10.100.188.32:6882/6660] exists,up 2476261e-8911-44ea-9d3d-fe702a16b4a7 osd.471 up in weight 1 up_from 2264 up_thru 7662 down_at 2051 last_clean_interval [2036,2049) [v2:10.100.190.54:6812/6696,v1:10.100.190.54:6813/6696] [v2:10.100.188.35:6812/6696,v1:10.100.188.35:6813/6696] exists,up f056d7be-85ee-4c33-9779-e2bc688c86ff osd.472 up in weight 1 up_from 2261 up_thru 7663 down_at 2260 last_clean_interval [2024,2257) [v2:10.100.190.46:6836/6809,v1:10.100.190.46:6841/6809] [v2:10.100.188.27:6835/6809,v1:10.100.188.27:6841/6809] exists,up fe749597-8573-4873-bb34-c1479545bc64 osd.473 up in weight 1 up_from 2263 up_thru 7662 down_at 2096 last_clean_interval [1912,2078) [v2:10.100.190.58:6810/6610,v1:10.100.190.58:6816/6610] [v2:10.100.188.39:6815/6610,v1:10.100.188.39:6817/6610] exists,up 449561a4-cb5b-4f65-870f-d47ce3d1ddcf osd.474 up in weight 1 up_from 3660 up_thru 7663 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6914/17199,v1:10.100.190.42:6916/17199] [v2:10.100.188.23:6913/17199,v1:10.100.188.23:6916/17199] exists,up 0acc65f5-df00-48dd-9cdb-e0ce909bc755 osd.475 up in weight 1 up_from 2260 up_thru 7661 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6824/6752,v1:10.100.190.57:6828/6752] [v2:10.100.188.38:6824/6752,v1:10.100.188.38:6827/6752] exists,up f7d4574d-2367-4b5c-bd53-fdd2edbae323 osd.476 up in weight 1 up_from 2940 up_thru 7662 down_at 2162 last_clean_interval [2038,2149) [v2:10.100.190.56:6800/6555,v1:10.100.190.56:6801/6555] [v2:10.100.188.37:6800/6555,v1:10.100.188.37:6801/6555] exists,up 720aa16b-28a2-4ad3-bbf9-17d9898af934 osd.477 up in weight 1 up_from 2630 up_thru 7664 down_at 2048 last_clean_interval [2035,2047) [v2:10.100.190.53:6879/6798,v1:10.100.190.53:6894/6798] [v2:10.100.188.34:6888/6798,v1:10.100.188.34:6901/6798] exists,up 8a82c700-c2d7-48ed-8e87-9959ea5999bc osd.478 up in weight 1 up_from 7661 up_thru 7662 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6834/6632,v1:10.100.190.41:6840/6632] [v2:10.100.188.22:6836/6632,v1:10.100.188.22:6837/6632] exists,up 611d714e-0743-456e-874c-3ba1d469fc1c osd.479 up in weight 1 up_from 2264 up_thru 7660 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6896/6758,v1:10.100.190.59:6897/6758] [v2:10.100.188.40:6896/6758,v1:10.100.188.40:6897/6758] exists,up adbc212a-7563-4ba5-bf3f-9c4ea347ed8e osd.480 up in weight 1 up_from 3763 up_thru 7661 down_at 3748 last_clean_interval [3427,3747) [v2:10.100.190.44:6820/14731,v1:10.100.190.44:6821/14731] [v2:10.100.188.25:6820/14731,v1:10.100.188.25:6821/14731] exists,up 3df5d5b6-4ebc-4e2a-9711-02cd8c454dea osd.481 up in weight 1 up_from 2260 up_thru 7662 down_at 2255 last_clean_interval [2023,2254) [v2:10.100.190.47:6804/6614,v1:10.100.190.47:6807/6614] [v2:10.100.188.28:6806/6614,v1:10.100.188.28:6807/6614] exists,up 1256429a-11e6-433a-a18c-fdd5f19a4067 osd.482 up in weight 1 up_from 3232 up_thru 7564 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6801/9287,v1:10.100.190.49:6803/9287] [v2:10.100.188.30:6802/9287,v1:10.100.188.30:6803/9287] exists,up bf04c8f3-6eea-4cc9-8602-235680aa04d0 osd.483 up in weight 1 up_from 7547 up_thru 7661 down_at 7397 last_clean_interval [3150,7394) [v2:10.100.190.48:6803/6705,v1:10.100.190.48:6806/6705] [v2:10.100.188.29:6804/6705,v1:10.100.188.29:6805/6705] exists,up 8eb3adce-b234-4082-a24d-5b60a8e652f9 osd.484 up in weight 1 up_from 2262 up_thru 7663 down_at 2096 last_clean_interval [2037,2078) [v2:10.100.190.55:6865/6749,v1:10.100.190.55:6867/6749] [v2:10.100.188.36:6865/6749,v1:10.100.188.36:6867/6749] exists,up 6c9b01a7-abb4-4443-a096-79b6f8074a97 osd.485 up in weight 1 up_from 3298 up_thru 7664 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6904/9626,v1:10.100.190.45:6911/9626] [v2:10.100.188.26:6908/9626,v1:10.100.188.26:6915/9626] exists,up 77a4d435-5d28-4a7f-9aff-47010bcffecc osd.486 up in weight 1 up_from 3744 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6835/14274,v1:10.100.190.43:6838/14274] [v2:10.100.188.24:6834/14274,v1:10.100.188.24:6836/14274] exists,up 04f1b250-120a-4bfd-8937-707a5f5b31d4 osd.487 up in weight 1 up_from 2263 up_thru 7662 down_at 2079 last_clean_interval [2036,2060) [v2:10.100.190.50:6915/6630,v1:10.100.190.50:6918/6630] [v2:10.100.188.31:6915/6630,v1:10.100.188.31:6918/6630] exists,up 58a1ccb5-75ed-43d5-85ab-f367c637cd7c osd.488 up in weight 1 up_from 2380 up_thru 7661 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6866/6633,v1:10.100.190.52:6870/6633] [v2:10.100.188.33:6867/6633,v1:10.100.188.33:6869/6633] exists,up a524a134-355d-4bb6-93c6-d318a349d9d2 osd.489 up in weight 1 up_from 2264 up_thru 7661 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6906/6761,v1:10.100.190.51:6910/6761] [v2:10.100.188.32:6902/6761,v1:10.100.188.32:6908/6761] exists,up 6c3dc3fb-bcd4-447b-8ee6-8c15c138a78a osd.490 up in weight 1 up_from 7557 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6829/6676,v1:10.100.190.40:6832/6676] [v2:10.100.188.21:6826/6676,v1:10.100.188.21:6831/6676] exists,up dae19bac-2f86-4baf-88f3-fa083d264388 osd.491 up in weight 1 up_from 2260 up_thru 7660 down_at 2051 last_clean_interval [2036,2049) [v2:10.100.190.54:6821/6737,v1:10.100.190.54:6828/6737] [v2:10.100.188.35:6825/6737,v1:10.100.188.35:6828/6737] exists,up aea9957d-e452-46f3-915b-3793af91ebde osd.492 up in weight 1 up_from 2261 up_thru 7661 down_at 2260 last_clean_interval [2023,2257) [v2:10.100.190.46:6845/6775,v1:10.100.190.46:6850/6775] [v2:10.100.188.27:6845/6775,v1:10.100.188.27:6850/6775] exists,up 87cc4ddc-fb7f-4341-b48b-afb0fb6f240b osd.493 up in weight 1 up_from 2265 up_thru 7663 down_at 2096 last_clean_interval [1912,2078) [v2:10.100.190.58:6900/6681,v1:10.100.190.58:6902/6681] [v2:10.100.188.39:6900/6681,v1:10.100.188.39:6902/6681] exists,up a3a5d460-24e7-4e92-beae-a0a2aa2b70ca osd.494 up in weight 1 up_from 3659 up_thru 7662 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6893/17188,v1:10.100.190.42:6898/17188] [v2:10.100.188.23:6894/17188,v1:10.100.188.23:6898/17188] exists,up 27c1721a-e00c-45a6-9151-49ef8456faeb osd.495 up in weight 1 up_from 2259 up_thru 7555 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6816/6703,v1:10.100.190.57:6817/6703] [v2:10.100.188.38:6816/6703,v1:10.100.188.38:6817/6703] exists,up 473afcd6-0891-419d-8f62-033199862bed osd.496 up in weight 1 up_from 2939 up_thru 7661 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6897/6601,v1:10.100.190.56:6904/6601] [v2:10.100.188.37:6902/6601,v1:10.100.188.37:6910/6601] exists,up ec182890-3c4a-4978-aa71-e1a3437d5bd5 osd.497 up in weight 1 up_from 7661 up_thru 7662 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6859/6650,v1:10.100.190.41:6864/6650] [v2:10.100.188.22:6858/6650,v1:10.100.188.22:6861/6650] exists,up 1629654b-f734-4e1c-b93e-dcb50ae4799c osd.498 up in weight 1 up_from 2631 up_thru 7662 down_at 2048 last_clean_interval [2034,2047) [v2:10.100.190.53:6834/6824,v1:10.100.190.53:6839/6824] [v2:10.100.188.34:6834/6824,v1:10.100.188.34:6836/6824] exists,up 2f6a5719-2e7e-46d8-8e7b-9ee3edc1333d osd.499 up in weight 1 up_from 2262 up_thru 7662 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6831/6678,v1:10.100.190.59:6834/6678] [v2:10.100.188.40:6831/6678,v1:10.100.188.40:6834/6678] exists,up 36c95491-0c8f-4703-a627-bad9bf786f01 osd.500 up in weight 1 up_from 3763 up_thru 7661 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6912/14907,v1:10.100.190.44:6913/14907] [v2:10.100.188.25:6912/14907,v1:10.100.188.25:6913/14907] exists,up bf76c614-ffbb-4c13-9142-da76abe6ad7e osd.501 up in weight 1 up_from 2262 up_thru 7661 down_at 2256 last_clean_interval [2023,2254) [v2:10.100.190.47:6913/6618,v1:10.100.190.47:6915/6618] [v2:10.100.188.28:6912/6618,v1:10.100.188.28:6915/6618] exists,up 8fab9a16-6c8a-42d8-a46d-5e7d8bb750ec osd.502 up in weight 1 up_from 3232 up_thru 7664 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6884/9329,v1:10.100.190.49:6889/9329] [v2:10.100.188.30:6887/9329,v1:10.100.188.30:6891/9329] exists,up 43108dd4-2c36-46c9-85d4-58b925e6890b osd.503 up in weight 1 up_from 7547 up_thru 7661 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6902/6726,v1:10.100.190.48:6908/6726] [v2:10.100.188.29:6902/6726,v1:10.100.188.29:6907/6726] exists,up a6a261da-eb03-4649-bbf9-5c8a68ba33f0 osd.504 up in weight 1 up_from 2263 up_thru 7665 down_at 2095 last_clean_interval [2034,2078) [v2:10.100.190.55:6809/6645,v1:10.100.190.55:6811/6645] [v2:10.100.188.36:6809/6645,v1:10.100.188.36:6810/6645] exists,up 2a3d52fa-a17c-4eed-92d6-17268912244b osd.505 up in weight 1 up_from 3298 up_thru 7661 down_at 2260 last_clean_interval [2023,2257) [v2:10.100.190.45:6907/9634,v1:10.100.190.45:6912/9634] [v2:10.100.188.26:6906/9634,v1:10.100.188.26:6911/9634] exists,up f0bf0e1f-b5dd-43fc-8fc8-6374774603ed osd.506 up in weight 1 up_from 2379 up_thru 7662 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6848/6765,v1:10.100.190.52:6852/6765] [v2:10.100.188.33:6848/6765,v1:10.100.188.33:6851/6765] exists,up d36efe43-2112-4f51-aa94-25de3bbac480 osd.507 up in weight 1 up_from 3745 up_thru 7663 down_at 3728 last_clean_interval [3332,3727) [v2:10.100.190.43:6885/14406,v1:10.100.190.43:6887/14406] [v2:10.100.188.24:6884/14406,v1:10.100.188.24:6886/14406] exists,up 38ac0651-0653-4628-ae62-668f1bea280f osd.508 up in weight 1 up_from 2264 up_thru 7663 down_at 2079 last_clean_interval [2036,2060) [v2:10.100.190.50:6804/6665,v1:10.100.190.50:6808/6665] [v2:10.100.188.31:6805/6665,v1:10.100.188.31:6808/6665] exists,up 4e27abaa-c25a-4bdc-8cb2-3d0a3841d768 osd.509 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6835/6752,v1:10.100.190.40:6837/6752] [v2:10.100.188.21:6833/6752,v1:10.100.188.21:6834/6752] exists,up 66062673-158c-4579-8c17-6e6f6df71b27 osd.510 up in weight 1 up_from 2263 up_thru 7660 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6879/6681,v1:10.100.190.54:6894/6681] [v2:10.100.188.35:6884/6681,v1:10.100.188.35:6894/6681] exists,up c6ad30a5-73e3-4bf3-aca0-5031d072e08f osd.511 up in weight 1 up_from 2263 up_thru 7664 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6852/6703,v1:10.100.190.51:6859/6703] [v2:10.100.188.32:6851/6703,v1:10.100.188.32:6858/6703] exists,up f2577681-2541-4278-951d-d796a98c06cf osd.512 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.46:6886/6719,v1:10.100.190.46:6893/6719] [v2:10.100.188.27:6886/6719,v1:10.100.188.27:6889/6719] exists,up 72c7c730-f5dc-40fb-ad58-204d9f82eb98 osd.513 up in weight 1 up_from 2260 up_thru 7663 down_at 2096 last_clean_interval [1910,2078) [v2:10.100.190.58:6803/6588,v1:10.100.190.58:6809/6588] [v2:10.100.188.39:6804/6588,v1:10.100.188.39:6806/6588] exists,up c8982145-ef62-4fcc-ac42-79119a2a0028 osd.514 up in weight 1 up_from 3659 up_thru 7661 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6852/17104,v1:10.100.190.42:6857/17104] [v2:10.100.188.23:6852/17104,v1:10.100.188.23:6854/17104] exists,up cf5c15e6-1a39-4d93-b301-d9d128d6b7aa osd.515 up in weight 1 up_from 2262 up_thru 7662 down_at 2108 last_clean_interval [2038,2102) [v2:10.100.190.57:6877/6740,v1:10.100.190.57:6880/6740] [v2:10.100.188.38:6878/6740,v1:10.100.188.38:6880/6740] exists,up 6dc0c23a-a5f0-4726-9be2-dc6aec9c4938 osd.516 up in weight 1 up_from 2940 up_thru 7661 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6816/6591,v1:10.100.190.56:6817/6591] [v2:10.100.188.37:6816/6591,v1:10.100.188.37:6817/6591] exists,up b2e76ba9-93c8-4900-b091-b75427019aed osd.517 up in weight 1 up_from 7661 up_thru 7662 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6888/6666,v1:10.100.190.41:6900/6666] [v2:10.100.188.22:6888/6666,v1:10.100.188.22:6901/6666] exists,up cc519650-772c-4a3a-889f-2a311dfeaf83 osd.518 up in weight 1 up_from 2629 up_thru 7663 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6837/6717,v1:10.100.190.53:6844/6717] [v2:10.100.188.34:6841/6717,v1:10.100.188.34:6844/6717] exists,up 7bc4366f-75ac-40e2-9a28-cd660a698971 osd.519 up in weight 1 up_from 2263 up_thru 7661 down_at 2238 last_clean_interval [1901,2220) [v2:10.100.190.59:6893/6700,v1:10.100.190.59:6895/6700] [v2:10.100.188.40:6893/6700,v1:10.100.188.40:6895/6700] exists,up 332a214b-22a6-4d9c-abd3-7827c705a6c6 osd.520 up in weight 1 up_from 3764 up_thru 7661 down_at 3748 last_clean_interval [3427,3747) [v2:10.100.190.44:6848/14655,v1:10.100.190.44:6852/14655] [v2:10.100.188.25:6851/14655,v1:10.100.188.25:6856/14655] exists,up 29bf0981-f608-40ad-a704-fada57b7a53f osd.521 up in weight 1 up_from 2262 up_thru 7661 down_at 2256 last_clean_interval [2023,2254) [v2:10.100.190.47:6825/6597,v1:10.100.190.47:6835/6597] [v2:10.100.188.28:6825/6597,v1:10.100.188.28:6831/6597] exists,up 41b7c35f-0f56-4dcc-b718-95ecd58c6246 osd.522 up in weight 1 up_from 3232 up_thru 7662 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6866/9323,v1:10.100.190.49:6871/9323] [v2:10.100.188.30:6863/9323,v1:10.100.188.30:6869/9323] exists,up d0901083-b8e6-4a82-9095-9bb05e9201a7 osd.523 up in weight 1 up_from 7547 up_thru 7661 down_at 7395 last_clean_interval [3150,7394) [v2:10.100.190.48:6819/6661,v1:10.100.190.48:6822/6661] [v2:10.100.188.29:6817/6661,v1:10.100.188.29:6819/6661] exists,up 9603d726-a0e2-42a5-8877-93ab823d12c6 osd.524 up in weight 1 up_from 3297 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6898/9632,v1:10.100.190.45:6901/9632] [v2:10.100.188.26:6896/9632,v1:10.100.188.26:6900/9632] exists,up ea1de973-e6bf-4aa6-b2ec-4527ee8db68a osd.525 up in weight 1 up_from 2263 up_thru 7663 down_at 2095 last_clean_interval [2035,2078) [v2:10.100.190.55:6887/6724,v1:10.100.190.55:6890/6724] [v2:10.100.188.36:6887/6724,v1:10.100.188.36:6890/6724] exists,up b726fc82-e324-4480-b859-e61917018e92 osd.526 up in weight 1 up_from 2380 up_thru 7662 down_at 2042 last_clean_interval [2038,2041) [v2:10.100.190.52:6851/6670,v1:10.100.190.52:6855/6670] [v2:10.100.188.33:6852/6670,v1:10.100.188.33:6856/6670] exists,up 1444f5bf-93b9-4bc0-a504-7d862edeacde osd.527 up in weight 1 up_from 2263 up_thru 7662 down_at 2078 last_clean_interval [2037,2060) [v2:10.100.190.50:6836/6657,v1:10.100.190.50:6842/6657] [v2:10.100.188.31:6837/6657,v1:10.100.188.31:6844/6657] exists,up fe0fb998-b53d-4238-89c2-299928545dd8 osd.528 up in weight 1 up_from 3745 up_thru 7663 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6862/14353,v1:10.100.190.43:6869/14353] [v2:10.100.188.24:6865/14353,v1:10.100.188.24:6870/14353] exists,up cb13f6b2-01eb-4693-b9a8-93bd49b46211 osd.529 up in weight 1 up_from 2263 up_thru 7662 down_at 2050 last_clean_interval [2037,2049) [v2:10.100.190.54:6896/6741,v1:10.100.190.54:6900/6741] [v2:10.100.188.35:6896/6741,v1:10.100.188.35:6900/6741] exists,up 429fa325-da75-46a6-8127-327efb27a57d osd.530 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6892/6824,v1:10.100.190.46:6897/6824] [v2:10.100.188.27:6888/6824,v1:10.100.188.27:6895/6824] exists,up cd54a15e-cbe1-4819-825d-b97c0a1bbc6b osd.531 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6896/6618,v1:10.100.190.40:6912/6618] [v2:10.100.188.21:6909/6618,v1:10.100.188.21:6912/6618] exists,up a4ed792e-6761-4b68-b7a5-26485bfc43d8 osd.532 up in weight 1 up_from 2263 up_thru 7662 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6907/6727,v1:10.100.190.51:6911/6727] [v2:10.100.188.32:6905/6727,v1:10.100.188.32:6912/6727] exists,up e04f070f-2a3b-46f7-b763-4defcb830e15 osd.533 up in weight 1 up_from 2265 up_thru 7661 down_at 2096 last_clean_interval [1912,2078) [v2:10.100.190.58:6873/6623,v1:10.100.190.58:6878/6623] [v2:10.100.188.39:6874/6623,v1:10.100.188.39:6877/6623] exists,up 2cf21132-a06e-41d4-a733-9abbfa9c0f49 osd.534 up in weight 1 up_from 3659 up_thru 7661 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6820/17031,v1:10.100.190.42:6821/17031] [v2:10.100.188.23:6820/17031,v1:10.100.188.23:6821/17031] exists,up 2672dd08-7bce-43f3-8b83-afb92781dfba osd.535 up in weight 1 up_from 2262 up_thru 7661 down_at 2109 last_clean_interval [2036,2102) [v2:10.100.190.57:6896/6804,v1:10.100.190.57:6899/6804] [v2:10.100.188.38:6894/6804,v1:10.100.188.38:6897/6804] exists,up e32c4c4f-4453-4846-8e62-bceb3d987fa4 osd.536 up in weight 1 up_from 2939 up_thru 7661 down_at 2162 last_clean_interval [2036,2149) [v2:10.100.190.56:6878/6675,v1:10.100.190.56:6889/6675] [v2:10.100.188.37:6878/6675,v1:10.100.188.37:6882/6675] exists,up 254c3467-22e0-4261-a421-18ed26dbd8a1 osd.537 up in weight 1 up_from 7660 up_thru 7662 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6890/6579,v1:10.100.190.41:6901/6579] [v2:10.100.188.22:6889/6579,v1:10.100.188.22:6900/6579] exists,up ae107ce0-2f9c-4c8b-99d7-8e60ef8a4fea osd.538 up in weight 1 up_from 2630 up_thru 7559 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6818/6830,v1:10.100.190.53:6820/6830] [v2:10.100.188.34:6818/6830,v1:10.100.188.34:6821/6830] exists,up 82d43087-d7da-4cb7-aadd-783a48d0109d osd.539 up in weight 1 up_from 2262 up_thru 7663 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6838/6718,v1:10.100.190.59:6842/6718] [v2:10.100.188.40:6838/6718,v1:10.100.188.40:6840/6718] exists,up d77f5479-890a-4197-833a-1079ea476f23 osd.540 up in weight 1 up_from 3764 up_thru 7662 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6915/14968,v1:10.100.190.44:6917/14968] [v2:10.100.188.25:6915/14968,v1:10.100.188.25:6917/14968] exists,up 6cdaeeee-0a62-409d-9dcd-5360264a05e5 osd.541 up in weight 1 up_from 2260 up_thru 7661 down_at 2256 last_clean_interval [2024,2254) [v2:10.100.190.47:6826/6637,v1:10.100.190.47:6836/6637] [v2:10.100.188.28:6826/6637,v1:10.100.188.28:6833/6637] exists,up a88733e8-8fc2-4fbb-93e2-9dfbaf2a896e osd.542 up in weight 1 up_from 3231 up_thru 7662 down_at 2229 last_clean_interval [2022,2209) [v2:10.100.190.49:6846/9331,v1:10.100.190.49:6850/9331] [v2:10.100.188.30:6846/9331,v1:10.100.188.30:6848/9331] exists,up 59944409-f98a-4abb-95bc-354dd59576e9 osd.543 up in weight 1 up_from 7548 up_thru 7661 down_at 7397 last_clean_interval [3148,7394) [v2:10.100.190.48:6817/6767,v1:10.100.190.48:6821/6767] [v2:10.100.188.29:6821/6767,v1:10.100.188.29:6822/6767] exists,up bf410053-6090-42b4-9344-e0402ff184cb osd.544 up in weight 1 up_from 3298 up_thru 7660 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6849/9594,v1:10.100.190.45:6853/9594] [v2:10.100.188.26:6849/9594,v1:10.100.188.26:6852/9594] exists,up fa107b14-6e78-458a-966f-f982394d8b00 osd.545 up in weight 1 up_from 2264 up_thru 7662 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6901/6668,v1:10.100.190.55:6905/6668] [v2:10.100.188.36:6901/6668,v1:10.100.188.36:6903/6668] exists,up 980c1acc-4afd-4007-ae4e-92c20fa73ed0 osd.546 up in weight 1 up_from 2263 up_thru 7661 down_at 2079 last_clean_interval [2037,2060) [v2:10.100.190.50:6802/6609,v1:10.100.190.50:6806/6609] [v2:10.100.188.31:6804/6609,v1:10.100.188.31:6806/6609] exists,up 40af3091-0aa3-4602-9ac4-ab3b0907d97c osd.547 up in weight 1 up_from 3744 up_thru 7662 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6894/14461,v1:10.100.190.43:6896/14461] [v2:10.100.188.24:6894/14461,v1:10.100.188.24:6898/14461] exists,up 141ab229-2c57-4be0-8a4d-24855b5d5618 osd.548 up in weight 1 up_from 2379 up_thru 7663 down_at 2042 last_clean_interval [2038,2041) [v2:10.100.190.52:6888/6703,v1:10.100.190.52:6899/6703] [v2:10.100.188.33:6887/6703,v1:10.100.188.33:6898/6703] exists,up 408a5fd4-a645-43ca-b991-0a0d4ada14f0 osd.549 up in weight 1 up_from 2263 up_thru 7661 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6850/6629,v1:10.100.190.54:6853/6629] [v2:10.100.188.35:6847/6629,v1:10.100.188.35:6849/6629] exists,up 59f089e9-9d3f-4e85-b651-5032172e3497 osd.550 up in weight 1 up_from 7558 up_thru 7662 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6820/6726,v1:10.100.190.40:6821/6726] [v2:10.100.188.21:6820/6726,v1:10.100.188.21:6821/6726] exists,up b06185e6-a03c-4ed2-bdf3-2c62b2b00c8b osd.551 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.46:6800/6743,v1:10.100.190.46:6801/6743] [v2:10.100.188.27:6800/6743,v1:10.100.188.27:6801/6743] exists,up 6a155232-8b4b-485c-ad87-a75523492b1d osd.552 up in weight 1 up_from 2263 up_thru 7663 down_at 2045 last_clean_interval [2037,2044) [v2:10.100.190.51:6857/6755,v1:10.100.190.51:6862/6755] [v2:10.100.188.32:6857/6755,v1:10.100.188.32:6861/6755] exists,up 48d3b529-4d47-4173-ba9e-4aa2026c393a osd.553 up in weight 1 up_from 2265 up_thru 7663 down_at 2096 last_clean_interval [1909,2078) [v2:10.100.190.58:6875/6699,v1:10.100.190.58:6879/6699] [v2:10.100.188.39:6873/6699,v1:10.100.188.39:6875/6699] exists,up dc8e21d1-63db-4e27-af5d-0b37ac6924b8 osd.554 up in weight 1 up_from 3659 up_thru 7663 down_at 3640 last_clean_interval [2264,3639) [v2:10.100.190.42:6915/17237,v1:10.100.190.42:6918/17237] [v2:10.100.188.23:6915/17237,v1:10.100.188.23:6917/17237] exists,up 454bd5c1-2c1d-4b51-ad6d-1e0d08f6e776 osd.555 up in weight 1 up_from 2940 up_thru 7662 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6843/6669,v1:10.100.190.56:6864/6669] [v2:10.100.188.37:6855/6669,v1:10.100.188.37:6863/6669] exists,up 9824dd9d-468a-4b15-903e-d11b56f8c7e0 osd.556 up in weight 1 up_from 2264 up_thru 7661 down_at 2109 last_clean_interval [2037,2102) [v2:10.100.190.57:6904/6725,v1:10.100.190.57:6905/6725] [v2:10.100.188.38:6904/6725,v1:10.100.188.38:6905/6725] exists,up 4863f4d5-f6b3-4b3d-8e9b-91b72d730bd3 osd.557 up in weight 1 up_from 7662 up_thru 7662 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6853/6677,v1:10.100.190.41:6857/6677] [v2:10.100.188.22:6853/6677,v1:10.100.188.22:6856/6677] exists,up fe738e77-adc8-4f93-8523-5b1e669846bc osd.558 up in weight 1 up_from 2631 up_thru 7662 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6806/6800,v1:10.100.190.53:6808/6800] [v2:10.100.188.34:6806/6800,v1:10.100.188.34:6808/6800] exists,up 9f8b6c86-809b-4170-bc95-1cc579512023 osd.559 up in weight 1 up_from 2264 up_thru 7661 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6913/6779,v1:10.100.190.59:6915/6779] [v2:10.100.188.40:6913/6779,v1:10.100.188.40:6915/6779] exists,up 269e4b89-37a2-47a0-937f-c9e3ff684aac osd.560 up in weight 1 up_from 3764 up_thru 7661 down_at 3748 last_clean_interval [3426,3747) [v2:10.100.190.44:6888/14747,v1:10.100.190.44:6895/14747] [v2:10.100.188.25:6893/14747,v1:10.100.188.25:6895/14747] exists,up 99ca6567-5f98-4218-afc6-a0c5ec27b968 osd.561 up in weight 1 up_from 3231 up_thru 7662 down_at 2230 last_clean_interval [2023,2209) [v2:10.100.190.49:6896/9321,v1:10.100.190.49:6912/9321] [v2:10.100.188.30:6909/9321,v1:10.100.188.30:6913/9321] exists,up 2d66f28b-1ccc-400e-9623-6c759671b41b osd.562 up in weight 1 up_from 2262 up_thru 7662 down_at 2255 last_clean_interval [2024,2254) [v2:10.100.190.47:6816/6657,v1:10.100.190.47:6817/6657] [v2:10.100.188.28:6816/6657,v1:10.100.188.28:6817/6657] exists,up e03f47ae-ee37-4fde-940d-99a7574d64de osd.563 up in weight 1 up_from 7548 up_thru 7661 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6900/6702,v1:10.100.190.48:6907/6702] [v2:10.100.188.29:6901/6702,v1:10.100.188.29:6911/6702] exists,up f6491bac-dfeb-4173-9244-96369274f16d osd.564 up in weight 1 up_from 3298 up_thru 7662 down_at 2260 last_clean_interval [2024,2257) [v2:10.100.190.45:6840/9576,v1:10.100.190.45:6843/9576] [v2:10.100.188.26:6839/9576,v1:10.100.188.26:6842/9576] exists,up d523ba1e-5cf7-4a70-9033-fd5668a0c2b1 osd.565 up in weight 1 up_from 2263 up_thru 7661 down_at 2078 last_clean_interval [2037,2060) [v2:10.100.190.50:6844/6599,v1:10.100.190.50:6849/6599] [v2:10.100.188.31:6839/6599,v1:10.100.188.31:6847/6599] exists,up 7e484232-4733-4104-bb73-a56f4753082d osd.566 up in weight 1 up_from 3745 up_thru 7661 down_at 3728 last_clean_interval [3332,3727) [v2:10.100.190.43:6912/14564,v1:10.100.190.43:6915/14564] [v2:10.100.188.24:6912/14564,v1:10.100.188.24:6915/14564] exists,up 7d363dff-f420-4d2b-9aeb-4698c0d5de2b osd.567 up in weight 1 up_from 2380 up_thru 7662 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6900/6674,v1:10.100.190.52:6905/6674] [v2:10.100.188.33:6900/6674,v1:10.100.188.33:6904/6674] exists,up fc9a18de-8ae7-400e-a398-4af703a6d622 osd.568 up in weight 1 up_from 2262 up_thru 7662 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6916/6651,v1:10.100.190.55:6919/6651] [v2:10.100.188.36:6916/6651,v1:10.100.188.36:6917/6651] exists,up 5a10e0a5-e259-41db-8ae1-697ac5bc2241 osd.569 up in weight 1 up_from 2262 up_thru 7558 down_at 2051 last_clean_interval [2034,2049) [v2:10.100.190.54:6895/6687,v1:10.100.190.54:6901/6687] [v2:10.100.188.35:6895/6687,v1:10.100.188.35:6901/6687] exists,up 75429e53-a1b3-448c-821c-1c79d165cc5c osd.570 up in weight 1 up_from 2264 up_thru 7666 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6884/6740,v1:10.100.190.51:6891/6740] [v2:10.100.188.32:6885/6740,v1:10.100.188.32:6890/6740] exists,up 4d09b6c0-c9c0-4043-8f71-d98b538270da osd.571 up in weight 1 up_from 7558 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6849/6629,v1:10.100.190.40:6851/6629] [v2:10.100.188.21:6846/6629,v1:10.100.188.21:6848/6629] exists,up 5ca66366-bc69-4f1f-a3d1-90c1a66bddef osd.572 up in weight 1 up_from 2263 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6832/6793,v1:10.100.190.46:6838/6793] [v2:10.100.188.27:6832/6793,v1:10.100.188.27:6836/6793] exists,up ea75304c-3c6c-4600-b85e-e9daa2e9721a osd.573 up in weight 1 up_from 2263 up_thru 7661 down_at 2096 last_clean_interval [1912,2078) [v2:10.100.190.58:6802/6598,v1:10.100.190.58:6805/6598] [v2:10.100.188.39:6802/6598,v1:10.100.188.39:6803/6598] exists,up d107a7ba-5e59-45ae-9eea-e208ca5e5eec osd.574 up in weight 1 up_from 3659 up_thru 7662 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6873/17120,v1:10.100.190.42:6877/17120] [v2:10.100.188.23:6874/17120,v1:10.100.188.23:6876/17120] exists,up 363f4acc-3e3e-4709-aa24-fad71ef1789e osd.575 up in weight 1 up_from 2940 up_thru 7661 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6820/6541,v1:10.100.190.56:6821/6541] [v2:10.100.188.37:6820/6541,v1:10.100.188.37:6821/6541] exists,up c3fe5eaf-8388-4efe-b060-b314fca43d0d osd.576 up in weight 1 up_from 2264 up_thru 7660 down_at 2109 last_clean_interval [2038,2102) [v2:10.100.190.57:6908/6760,v1:10.100.190.57:6909/6760] [v2:10.100.188.38:6908/6760,v1:10.100.188.38:6909/6760] exists,up f267ec2c-39e9-43d9-ae2c-6b83e7dd0320 osd.577 up in weight 1 up_from 7660 up_thru 7662 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6825/6705,v1:10.100.190.41:6827/6705] [v2:10.100.188.22:6825/6705,v1:10.100.188.22:6827/6705] exists,up dc5f2a5c-ea38-4189-a896-5b2f7b006d12 osd.578 up in weight 1 up_from 2629 up_thru 7662 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6838/6711,v1:10.100.190.53:6843/6711] [v2:10.100.188.34:6838/6711,v1:10.100.188.34:6843/6711] exists,up 9e443d9f-9342-4e3b-ae2f-b372650244de osd.579 up in weight 1 up_from 2262 up_thru 7660 down_at 2238 last_clean_interval [1903,2220) [v2:10.100.190.59:6824/6710,v1:10.100.190.59:6825/6710] [v2:10.100.188.40:6824/6710,v1:10.100.188.40:6825/6710] exists,up 05bd7c10-5078-405b-84c9-8dd41a89b77f osd.580 up in weight 1 up_from 3764 up_thru 7662 down_at 3748 last_clean_interval [3428,3747) [v2:10.100.190.44:6914/14934,v1:10.100.190.44:6916/14934] [v2:10.100.188.25:6914/14934,v1:10.100.188.25:6916/14934] exists,up 32d873cf-7971-4879-a635-1a826155a143 osd.581 up in weight 1 up_from 3231 up_thru 7661 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6888/9272,v1:10.100.190.49:6892/9272] [v2:10.100.188.30:6890/9272,v1:10.100.188.30:6893/9272] exists,up 0a1aff88-8a98-4047-bce6-81b02ebbb9d1 osd.582 up in weight 1 up_from 2262 up_thru 7661 down_at 2255 last_clean_interval [2023,2254) [v2:10.100.190.47:6834/6700,v1:10.100.190.47:6840/6700] [v2:10.100.188.28:6832/6700,v1:10.100.188.28:6840/6700] exists,up dd5140de-3a73-4456-83b3-0bb666e3f8b1 osd.583 up in weight 1 up_from 7547 up_thru 7660 down_at 7396 last_clean_interval [3149,7394) [v2:10.100.190.48:6886/6668,v1:10.100.190.48:6894/6668] [v2:10.100.188.29:6883/6668,v1:10.100.188.29:6892/6668] exists,up bf2e0e25-ffe6-4f38-a0e7-c71b39c524ae osd.584 up in weight 1 up_from 3301 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6812/9554,v1:10.100.190.45:6813/9554] [v2:10.100.188.26:6812/9554,v1:10.100.188.26:6813/9554] exists,up f23eae59-09c6-4796-ad81-061dceb7a6e4 osd.585 up in weight 1 up_from 3745 up_thru 7661 down_at 3728 last_clean_interval [3330,3727) [v2:10.100.190.43:6917/14545,v1:10.100.190.43:6919/14545] [v2:10.100.188.24:6916/14545,v1:10.100.188.24:6918/14545] exists,up 542be9b0-6999-4fcb-8a30-d4c03341d875 osd.586 up in weight 1 up_from 2263 up_thru 7661 down_at 2095 last_clean_interval [2036,2078) [v2:10.100.190.55:6846/6747,v1:10.100.190.55:6849/6747] [v2:10.100.188.36:6846/6747,v1:10.100.188.36:6849/6747] exists,up e0a0f94a-a792-44eb-b07e-f4c3d9a98127 osd.587 up in weight 1 up_from 2263 up_thru 7662 down_at 2078 last_clean_interval [2037,2060) [v2:10.100.190.50:6828/6675,v1:10.100.190.50:6830/6675] [v2:10.100.188.31:6828/6675,v1:10.100.188.31:6830/6675] exists,up 58297f00-9261-4fe3-804c-1867a5ee0850 osd.588 up in weight 1 up_from 2380 up_thru 7662 down_at 2042 last_clean_interval [2038,2041) [v2:10.100.190.52:6816/6761,v1:10.100.190.52:6817/6761] [v2:10.100.188.33:6816/6761,v1:10.100.188.33:6817/6761] exists,up 4a7e69fc-0c6a-43fd-babc-8e18949882b2 osd.589 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6804/6779,v1:10.100.190.46:6805/6779] [v2:10.100.188.27:6804/6779,v1:10.100.188.27:6805/6779] exists,up 7d42a1f6-2342-4fe5-8a40-a580d8996042 osd.590 up in weight 1 up_from 7557 up_thru 7662 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6871/6658,v1:10.100.190.40:6880/6658] [v2:10.100.188.21:6877/6658,v1:10.100.188.21:6882/6658] exists,up 30618bcd-72a6-411a-aee0-8e0e6a0b6343 osd.591 up in weight 1 up_from 2263 up_thru 7661 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6826/6718,v1:10.100.190.51:6829/6718] [v2:10.100.188.32:6826/6718,v1:10.100.188.32:6829/6718] exists,up e250e1ae-687c-4fa6-bcb4-838a84998496 osd.592 up in weight 1 up_from 2260 up_thru 7660 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6816/6755,v1:10.100.190.54:6818/6755] [v2:10.100.188.35:6816/6755,v1:10.100.188.35:6818/6755] exists,up 41a190ea-0449-4ad1-84f0-8dc6026d96ad osd.593 up in weight 1 up_from 2270 up_thru 7661 down_at 2096 last_clean_interval [1914,2078) [v2:10.100.190.58:6924/6594,v1:10.100.190.58:6925/6594] [v2:10.100.188.39:6924/6594,v1:10.100.188.39:6925/6594] exists,up 65306aed-52f2-49c7-b02c-a18c3121f86c osd.594 up in weight 1 up_from 3659 up_thru 7663 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6855/17125,v1:10.100.190.42:6859/17125] [v2:10.100.188.23:6855/17125,v1:10.100.188.23:6859/17125] exists,up cccf4f8f-8625-4072-96fb-030d06266db8 osd.595 up in weight 1 up_from 2940 up_thru 7662 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6834/6526,v1:10.100.190.56:6838/6526] [v2:10.100.188.37:6834/6526,v1:10.100.188.37:6836/6526] exists,up 4cf73d60-8e2c-4241-adeb-ad7b110e1fbf osd.596 up in weight 1 up_from 2260 up_thru 7664 down_at 2109 last_clean_interval [2037,2102) [v2:10.100.190.57:6802/6746,v1:10.100.190.57:6805/6746] [v2:10.100.188.38:6802/6746,v1:10.100.188.38:6804/6746] exists,up 90c03ebe-cee5-47b1-9227-54501f4b96e4 osd.597 up in weight 1 up_from 2630 up_thru 7662 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6903/6784,v1:10.100.190.53:6907/6784] [v2:10.100.188.34:6900/6784,v1:10.100.188.34:6907/6784] exists,up 97306c92-773a-4b35-ae73-70f13ffcc399 osd.598 up in weight 1 up_from 7661 up_thru 7665 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6844/6573,v1:10.100.190.41:6851/6573] [v2:10.100.188.22:6842/6573,v1:10.100.188.22:6850/6573] exists,up cc9b7508-a944-4036-a952-9c49c6a68af7 osd.599 up in weight 1 up_from 2262 up_thru 7664 down_at 2238 last_clean_interval [1898,2220) [v2:10.100.190.59:6868/6617,v1:10.100.190.59:6870/6617] [v2:10.100.188.40:6868/6617,v1:10.100.188.40:6869/6617] exists,up e8975c5e-5b3c-4a29-bbf3-1df3becb62af osd.600 up in weight 1 up_from 3763 up_thru 7661 down_at 3748 last_clean_interval [3425,3748) [v2:10.100.190.44:6867/14710,v1:10.100.190.44:6870/14710] [v2:10.100.188.25:6865/14710,v1:10.100.188.25:6869/14710] exists,up 4edec358-a8e6-444a-9a1a-4611d444745a osd.601 up in weight 1 up_from 3232 up_thru 7662 down_at 2229 last_clean_interval [2023,2209) [v2:10.100.190.49:6820/9303,v1:10.100.190.49:6821/9303] [v2:10.100.188.30:6820/9303,v1:10.100.188.30:6821/9303] exists,up adf00d3a-f178-4d5c-80f3-9481858ca2fe osd.602 up in weight 1 up_from 7547 up_thru 7662 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6887/6691,v1:10.100.190.48:6895/6691] [v2:10.100.188.29:6885/6691,v1:10.100.188.29:6895/6691] exists,up ebcc2c25-8d36-4c4e-b459-f6e4d6486d0d osd.603 up in weight 1 up_from 2264 up_thru 7662 down_at 2263 last_clean_interval [2024,2254) [v2:10.100.190.47:6912/6607,v1:10.100.190.47:6916/6607] [v2:10.100.188.28:6913/6607,v1:10.100.188.28:6916/6607] exists,up a3c0842d-bd01-48d9-aba5-5bbcc35412f3 osd.604 up in weight 1 up_from 2264 up_thru 7662 down_at 2096 last_clean_interval [2036,2078) [v2:10.100.190.55:6911/6665,v1:10.100.190.55:6913/6665] [v2:10.100.188.36:6912/6665,v1:10.100.188.36:6913/6665] exists,up 5d1fcf37-d101-4a52-9417-31b69ec1ad1d osd.605 up in weight 1 up_from 3299 up_thru 7661 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6820/9547,v1:10.100.190.45:6823/9547] [v2:10.100.188.26:6822/9547,v1:10.100.188.26:6823/9547] exists,up d8b5c6fc-84f0-47d0-aa8e-beb38582465e osd.606 up in weight 1 up_from 3745 up_thru 7664 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6902/14506,v1:10.100.190.43:6903/14506] [v2:10.100.188.24:6902/14506,v1:10.100.188.24:6904/14506] exists,up fcecbee6-2e2d-49ab-9b93-6d46373b8e72 osd.607 up in weight 1 up_from 2263 up_thru 7664 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6872/6736,v1:10.100.190.50:6876/6736] [v2:10.100.188.31:6874/6736,v1:10.100.188.31:6880/6736] exists,up b7ce1281-3100-4ba4-ac8e-d395a37534ec osd.608 up in weight 1 up_from 7558 up_thru 7558 down_at 7555 last_clean_interval [2023,7554) [v2:10.100.190.40:6856/6674,v1:10.100.190.40:6859/6674] [v2:10.100.188.21:6855/6674,v1:10.100.188.21:6858/6674] exists,up 6920140f-e44c-4852-94a5-f192304fc035 osd.609 up in weight 1 up_from 2379 up_thru 7660 down_at 2042 last_clean_interval [2037,2041) [v2:10.100.190.52:6824/6652,v1:10.100.190.52:6829/6652] [v2:10.100.188.33:6827/6652,v1:10.100.188.33:6829/6652] exists,up 6b089ddd-3cf2-43bd-b4ad-b49a53a69e3a osd.610 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2024,2257) [v2:10.100.190.46:6808/6790,v1:10.100.190.46:6810/6790] [v2:10.100.188.27:6808/6790,v1:10.100.188.27:6810/6790] exists,up cd6fbe0b-597c-4211-b0d9-8b183ef75562 osd.611 up in weight 1 up_from 2264 up_thru 7663 down_at 2045 last_clean_interval [2036,2044) [v2:10.100.190.51:6853/6681,v1:10.100.190.51:6860/6681] [v2:10.100.188.32:6854/6681,v1:10.100.188.32:6860/6681] exists,up 94bed531-a838-422d-8da1-90389efb4222 osd.612 up in weight 1 up_from 2265 up_thru 7663 down_at 2096 last_clean_interval [1911,2078) [v2:10.100.190.58:6868/6703,v1:10.100.190.58:6870/6703] [v2:10.100.188.39:6868/6703,v1:10.100.188.39:6869/6703] exists,up ade236bd-3833-441f-a898-baa22d97eb8a osd.613 up in weight 1 up_from 2263 up_thru 7664 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6800/6713,v1:10.100.190.54:6801/6713] [v2:10.100.188.35:6800/6713,v1:10.100.188.35:6801/6713] exists,up c8b0fdf9-b647-495d-a9b3-d567eeec9fd0 osd.614 up in weight 1 up_from 3661 up_thru 7664 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6920/17245,v1:10.100.190.42:6921/17245] [v2:10.100.188.23:6920/17245,v1:10.100.188.23:6922/17245] exists,up 23ac17bd-f3ef-4a66-bdb7-69e165729184 osd.615 up in weight 1 up_from 2939 up_thru 7662 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6856/6684,v1:10.100.190.56:6862/6684] [v2:10.100.188.37:6853/6684,v1:10.100.188.37:6857/6684] exists,up db2d9661-2a47-47b4-8da5-cbcd968bb989 osd.616 up in weight 1 up_from 2272 up_thru 7662 down_at 2109 last_clean_interval [2039,2102) [v2:10.100.190.57:6918/6682,v1:10.100.190.57:6920/6682] [v2:10.100.188.38:6919/6682,v1:10.100.188.38:6921/6682] exists,up 32931bab-e3ca-46ed-8956-d794a1ce1836 osd.617 up in weight 1 up_from 2630 up_thru 7662 down_at 2048 last_clean_interval [2036,2047) [v2:10.100.190.53:6800/6731,v1:10.100.190.53:6801/6731] [v2:10.100.188.34:6800/6731,v1:10.100.188.34:6801/6731] exists,up 46112d7e-a494-43fc-8f4d-bfa6bd363ea3 osd.618 up in weight 1 up_from 7661 up_thru 7662 down_at 7564 last_clean_interval [2024,7563) [v2:10.100.190.41:6882/6698,v1:10.100.190.41:6886/6698] [v2:10.100.188.22:6882/6698,v1:10.100.188.22:6884/6698] exists,up fbd5ec38-2487-426d-a687-60090d974381 osd.619 up in weight 1 up_from 2262 up_thru 7662 down_at 2239 last_clean_interval [1903,2220) [v2:10.100.190.59:6848/6691,v1:10.100.190.59:6851/6691] [v2:10.100.188.40:6849/6691,v1:10.100.188.40:6851/6691] exists,up 206e5d99-991a-49a2-a15d-8c11918d2a2c osd.620 up in weight 1 up_from 3764 up_thru 7662 down_at 3748 last_clean_interval [3425,3747) [v2:10.100.190.44:6918/14962,v1:10.100.190.44:6922/14962] [v2:10.100.188.25:6920/14962,v1:10.100.188.25:6925/14962] exists,up 9f47e0f3-16f5-4dd3-be32-d4ee6d06bc8f osd.621 up in weight 1 up_from 3231 up_thru 7661 down_at 2230 last_clean_interval [2023,2209) [v2:10.100.190.49:6897/9337,v1:10.100.190.49:6904/9337] [v2:10.100.188.30:6897/9337,v1:10.100.188.30:6904/9337] exists,up 461fed3b-c63e-4878-9dc0-a53dc71dec0c osd.622 up in weight 1 up_from 7547 up_thru 7661 down_at 7397 last_clean_interval [3149,7394) [v2:10.100.190.48:6835/6775,v1:10.100.190.48:6840/6775] [v2:10.100.188.29:6835/6775,v1:10.100.188.29:6838/6775] exists,up 3d76237b-c56d-413d-927b-6434b10073e8 osd.623 up in weight 1 up_from 2263 up_thru 7662 down_at 2255 last_clean_interval [2024,2254) [v2:10.100.190.47:6905/6601,v1:10.100.190.47:6907/6601] [v2:10.100.188.28:6905/6601,v1:10.100.188.28:6907/6601] exists,up d8fe7fc4-2b1f-41d1-a748-3acf5889e890 osd.624 up in weight 1 up_from 2263 up_thru 7662 down_at 2095 last_clean_interval [2037,2078) [v2:10.100.190.55:6825/6770,v1:10.100.190.55:6831/6770] [v2:10.100.188.36:6829/6770,v1:10.100.188.36:6831/6770] exists,up 821ef093-5af1-4142-b87c-657421910cba osd.625 up in weight 1 up_from 3298 up_thru 7662 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.45:6805/9523,v1:10.100.190.45:6807/9523] [v2:10.100.188.26:6805/9523,v1:10.100.188.26:6807/9523] exists,up aae8d1a1-2557-478d-bd7d-9dea08d6ff88 osd.626 up in weight 1 up_from 3745 up_thru 7660 down_at 3728 last_clean_interval [3331,3727) [v2:10.100.190.43:6916/14568,v1:10.100.190.43:6918/14568] [v2:10.100.188.24:6917/14568,v1:10.100.188.24:6919/14568] exists,up b7ac3e33-32d8-4985-a834-e4f51e061f6e osd.627 up in weight 1 up_from 2263 up_thru 7662 down_at 2078 last_clean_interval [2036,2060) [v2:10.100.190.50:6818/6732,v1:10.100.190.50:6820/6732] [v2:10.100.188.31:6818/6732,v1:10.100.188.31:6820/6732] exists,up e275ecef-2473-4333-bee5-d17dd5c2f71b osd.628 up in weight 1 up_from 7557 up_thru 7661 down_at 7555 last_clean_interval [2024,7554) [v2:10.100.190.40:6800/6721,v1:10.100.190.40:6801/6721] [v2:10.100.188.21:6800/6721,v1:10.100.188.21:6801/6721] exists,up 8a15c6e8-d405-4fa7-b5e0-ae39c895145f osd.629 up in weight 1 up_from 2379 up_thru 7661 down_at 2043 last_clean_interval [2036,2041) [v2:10.100.190.52:6804/6648,v1:10.100.190.52:6806/6648] [v2:10.100.188.33:6804/6648,v1:10.100.188.33:6805/6648] exists,up f4d5f620-3357-47fd-9513-cb9446c3681f osd.630 up in weight 1 up_from 2263 up_thru 7663 down_at 2045 last_clean_interval [2038,2044) [v2:10.100.190.51:6804/6640,v1:10.100.190.51:6805/6640] [v2:10.100.188.32:6804/6640,v1:10.100.188.32:6805/6640] exists,up 2d89dbc2-4667-4b36-a997-c672bb157c35 osd.631 up in weight 1 up_from 2260 up_thru 7662 down_at 2050 last_clean_interval [2036,2049) [v2:10.100.190.54:6887/6626,v1:10.100.190.54:6907/6626] [v2:10.100.188.35:6903/6626,v1:10.100.188.35:6906/6626] exists,up dddfdf5c-b81c-4ab1-8b2c-cb96182ac757 osd.632 up in weight 1 up_from 2263 up_thru 7661 down_at 2262 last_clean_interval [2023,2257) [v2:10.100.190.46:6854/6820,v1:10.100.190.46:6862/6820] [v2:10.100.188.27:6857/6820,v1:10.100.188.27:6862/6820] exists,up 2487c211-9996-47ca-8556-5ba541f79d92 osd.633 up in weight 1 up_from 2263 up_thru 7662 down_at 2095 last_clean_interval [1910,2078) [v2:10.100.190.58:6808/6666,v1:10.100.190.58:6815/6666] [v2:10.100.188.39:6810/6666,v1:10.100.188.39:6814/6666] exists,up ec48b960-a232-40ce-b7e7-08cb4e4cb74b osd.634 up in weight 1 up_from 3661 up_thru 7662 down_at 3640 last_clean_interval [2263,3639) [v2:10.100.190.42:6856/17136,v1:10.100.190.42:6860/17136] [v2:10.100.188.23:6856/17136,v1:10.100.188.23:6860/17136] exists,up 2ddfb33d-2155-49b8-b115-7eeb67a72f48 osd.635 up in weight 1 up_from 2940 up_thru 7558 down_at 2162 last_clean_interval [2037,2149) [v2:10.100.190.56:6896/6562,v1:10.100.190.56:6903/6562] [v2:10.100.188.37:6895/6562,v1:10.100.188.37:6901/6562] exists,up 71ca70e7-41ce-42d1-a114-922315c879a3 osd.636 up in weight 1 up_from 2260 up_thru 7662 down_at 2109 last_clean_interval [2036,2102) [v2:10.100.190.57:6843/6777,v1:10.100.190.57:6846/6777] [v2:10.100.188.38:6842/6777,v1:10.100.188.38:6846/6777] exists,up f9cc687c-4950-4929-8e23-001ba13bed4e osd.637 up in weight 1 up_from 2630 up_thru 7661 down_at 2048 last_clean_interval [2037,2047) [v2:10.100.190.53:6863/6792,v1:10.100.190.53:6867/6792] [v2:10.100.188.34:6865/6792,v1:10.100.188.34:6867/6792] exists,up 4fa832dd-729f-4ab1-af48-cd933b11d0ca osd.638 up in weight 1 up_from 7661 up_thru 7663 down_at 7564 last_clean_interval [2023,7563) [v2:10.100.190.41:6883/6626,v1:10.100.190.41:6884/6626] [v2:10.100.188.22:6881/6626,v1:10.100.188.22:6883/6626] exists,up 3f969d98-f7c3-4031-86b9-6ce871401243 osd.639 up in weight 1 up_from 2264 up_thru 7661 down_at 2238 last_clean_interval [1902,2220) [v2:10.100.190.59:6875/6648,v1:10.100.190.59:6877/6648] [v2:10.100.188.40:6872/6648,v1:10.100.188.40:6875/6648] exists,up b98b0dcc-bed7-46c2-ba7d-72d1def44554 osd.640 up in weight 1 up_from 2266 up_thru 7595 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6884/6789,v1:10.100.190.60:6886/6789] [v2:10.100.188.41:6884/6789,v1:10.100.188.41:6886/6789] exists,up 94f47c66-49dd-4347-8f58-25914d958da2 osd.641 up in weight 1 up_from 2262 up_thru 7663 down_at 2246 last_clean_interval [2034,2244) [v2:10.100.190.61:6832/6711,v1:10.100.190.61:6833/6711] [v2:10.100.188.42:6832/6711,v1:10.100.188.42:6833/6711] exists,up 11d6faee-f80e-4d62-b504-04aa0e285008 osd.642 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6850/6675,v1:10.100.190.62:6854/6675] [v2:10.100.188.43:6850/6675,v1:10.100.188.43:6854/6675] exists,up 9ad5257c-eea1-4cef-9d56-d4647dfbec79 osd.643 up in weight 1 up_from 2264 up_thru 7662 down_at 2223 last_clean_interval [2014,2203) [v2:10.100.190.63:6834/6734,v1:10.100.190.63:6836/6734] [v2:10.100.188.44:6834/6734,v1:10.100.188.44:6836/6734] exists,up 114ab3ee-d146-4e85-8399-8b427434585e osd.644 up in weight 1 up_from 2262 up_thru 7558 down_at 2250 last_clean_interval [2037,2247) [v2:10.100.190.60:6814/6717,v1:10.100.190.60:6816/6717] [v2:10.100.188.41:6813/6717,v1:10.100.188.41:6815/6717] exists,up f92e4e08-1162-44fe-b8d5-90f617f5bad5 osd.645 up in weight 1 up_from 2260 up_thru 7664 down_at 2245 last_clean_interval [2034,2244) [v2:10.100.190.61:6805/6677,v1:10.100.190.61:6808/6677] [v2:10.100.188.42:6806/6677,v1:10.100.188.42:6808/6677] exists,up a7dddc13-b2ab-449f-a224-9b4a2fb6028f osd.646 up in weight 1 up_from 2260 up_thru 7661 down_at 2243 last_clean_interval [2036,2227) [v2:10.100.190.62:6821/6701,v1:10.100.190.62:6829/6701] [v2:10.100.188.43:6822/6701,v1:10.100.188.43:6827/6701] exists,up 440de5cd-14db-46b0-b496-ecd3d7b13878 osd.647 up in weight 1 up_from 2262 up_thru 7662 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6806/6747,v1:10.100.190.63:6808/6747] [v2:10.100.188.44:6806/6747,v1:10.100.188.44:6807/6747] exists,up 9864be45-153b-4f71-8625-8f742f6eca04 osd.648 up in weight 1 up_from 2267 up_thru 7661 down_at 2250 last_clean_interval [2036,2247) [v2:10.100.190.60:6906/6784,v1:10.100.190.60:6908/6784] [v2:10.100.188.41:6906/6784,v1:10.100.188.41:6907/6784] exists,up 0896146c-6b7d-4136-a402-f850402ddde2 osd.649 up in weight 1 up_from 2262 up_thru 7660 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6807/6630,v1:10.100.190.61:6809/6630] [v2:10.100.188.42:6807/6630,v1:10.100.188.42:6809/6630] exists,up 9f1bd5af-e32e-4f08-80bc-f046a4801ca5 osd.650 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2032,2227) [v2:10.100.190.62:6857/6600,v1:10.100.190.62:6866/6600] [v2:10.100.188.43:6859/6600,v1:10.100.188.43:6863/6600] exists,up f34cb138-f3c3-4d32-978b-f215c4f37fc1 osd.651 up in weight 1 up_from 2268 up_thru 7661 down_at 2223 last_clean_interval [2014,2203) [v2:10.100.190.63:6858/6739,v1:10.100.190.63:6860/6739] [v2:10.100.188.44:6859/6739,v1:10.100.188.44:6861/6739] exists,up 116d8ef7-c06f-4d0c-9dcd-482ee8833968 osd.652 up in weight 1 up_from 2266 up_thru 7661 down_at 2249 last_clean_interval [2035,2247) [v2:10.100.190.60:6907/6782,v1:10.100.190.60:6909/6782] [v2:10.100.188.41:6908/6782,v1:10.100.188.41:6909/6782] exists,up 36666848-ec22-45a6-8b01-9a5bcbffe72c osd.653 up in weight 1 up_from 2262 up_thru 7665 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6854/6626,v1:10.100.190.61:6858/6626] [v2:10.100.188.42:6855/6626,v1:10.100.188.42:6860/6626] exists,up c3923e4a-bd23-4d70-90c5-b58eb45e7eaf osd.654 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6868/6604,v1:10.100.190.62:6878/6604] [v2:10.100.188.43:6869/6604,v1:10.100.188.43:6882/6604] exists,up fa7de5d6-376a-47e1-aa25-a15b45b6e353 osd.655 up in weight 1 up_from 2269 up_thru 7665 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6899/6664,v1:10.100.190.63:6909/6664] [v2:10.100.188.44:6905/6664,v1:10.100.188.44:6911/6664] exists,up f93ad02a-39d7-40eb-a9d6-7e9766793533 osd.656 up in weight 1 up_from 2260 up_thru 7661 down_at 2248 last_clean_interval [2037,2247) [v2:10.100.190.60:6840/6793,v1:10.100.190.60:6849/6793] [v2:10.100.188.41:6841/6793,v1:10.100.188.41:6849/6793] exists,up 130c61df-796a-4fc6-950c-20c6c008350b osd.657 up in weight 1 up_from 2260 up_thru 7662 down_at 2246 last_clean_interval [2035,2244) [v2:10.100.190.61:6856/6657,v1:10.100.190.61:6860/6657] [v2:10.100.188.42:6858/6657,v1:10.100.188.42:6861/6657] exists,up 855bbf2c-26d3-44ac-ba2d-684efe0dc0fe osd.658 up in weight 1 up_from 2260 up_thru 7662 down_at 2242 last_clean_interval [2035,2227) [v2:10.100.190.62:6879/6688,v1:10.100.190.62:6887/6688] [v2:10.100.188.43:6874/6688,v1:10.100.188.43:6880/6688] exists,up 33f8504b-e5ff-4168-86ea-b9c52b136966 osd.659 up in weight 1 up_from 2264 up_thru 7662 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6815/6702,v1:10.100.190.63:6818/6702] [v2:10.100.188.44:6815/6702,v1:10.100.188.44:6818/6702] exists,up f7aef1d0-9071-4b34-b03d-534d118103d3 osd.660 up in weight 1 up_from 2266 up_thru 7662 down_at 2250 last_clean_interval [2037,2247) [v2:10.100.190.60:6888/6834,v1:10.100.190.60:6889/6834] [v2:10.100.188.41:6888/6834,v1:10.100.188.41:6889/6834] exists,up 2a33c4f0-fad1-4d5e-bbfc-b4cffb22f520 osd.661 up in weight 1 up_from 2263 up_thru 7661 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6876/6636,v1:10.100.190.61:6877/6636] [v2:10.100.188.42:6876/6636,v1:10.100.188.42:6877/6636] exists,up 5d91c4da-8fea-41a0-a25b-d8a2a2494a66 osd.662 up in weight 1 up_from 2262 up_thru 7664 down_at 2242 last_clean_interval [2033,2227) [v2:10.100.190.62:6870/6606,v1:10.100.190.62:6880/6606] [v2:10.100.188.43:6865/6606,v1:10.100.188.43:6870/6606] exists,up e2e9ba8c-d930-40ce-9d03-dd5db34faa0d osd.663 up in weight 1 up_from 2268 up_thru 7661 down_at 2224 last_clean_interval [2017,2203) [v2:10.100.190.63:6889/6761,v1:10.100.190.63:6896/6761] [v2:10.100.188.44:6892/6761,v1:10.100.188.44:6899/6761] exists,up 3bf7dc8b-9fb3-4577-9573-47bb3d6bb777 osd.664 up in weight 1 up_from 2262 up_thru 7663 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6833/6707,v1:10.100.190.60:6837/6707] [v2:10.100.188.41:6831/6707,v1:10.100.188.41:6834/6707] exists,up 584c377f-50d4-4b97-af3f-3ffe0502848e osd.665 up in weight 1 up_from 2260 up_thru 7662 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6804/6613,v1:10.100.190.61:6806/6613] [v2:10.100.188.42:6804/6613,v1:10.100.188.42:6805/6613] exists,up 02c80859-f551-4b6c-9b7a-c798623f5c4c osd.666 up in weight 1 up_from 2262 up_thru 7660 down_at 2242 last_clean_interval [2034,2227) [v2:10.100.190.62:6814/6592,v1:10.100.190.62:6816/6592] [v2:10.100.188.43:6813/6592,v1:10.100.188.43:6814/6592] exists,up bc390df1-790c-4dfb-b7f9-817c37287571 osd.667 up in weight 1 up_from 2266 up_thru 7664 down_at 2223 last_clean_interval [2016,2203) [v2:10.100.190.63:6852/6784,v1:10.100.190.63:6853/6784] [v2:10.100.188.44:6852/6784,v1:10.100.188.44:6853/6784] exists,up 59c8a59b-26e3-42b0-baac-b4502295097f osd.668 up in weight 1 up_from 2263 up_thru 7663 down_at 2249 last_clean_interval [2037,2247) [v2:10.100.190.60:6815/6699,v1:10.100.190.60:6818/6699] [v2:10.100.188.41:6816/6699,v1:10.100.188.41:6817/6699] exists,up 1d03c4fc-2dc7-4b15-924e-8b8ee4cb84de osd.669 up in weight 1 up_from 2262 up_thru 7662 down_at 2245 last_clean_interval [2036,2244) [v2:10.100.190.61:6825/6723,v1:10.100.190.61:6827/6723] [v2:10.100.188.42:6824/6723,v1:10.100.188.42:6826/6723] exists,up 050fb89a-7460-470d-ba31-404e18afaa98 osd.670 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6834/6589,v1:10.100.190.62:6840/6589] [v2:10.100.188.43:6838/6589,v1:10.100.188.43:6842/6589] exists,up 41c84132-2f29-45e3-8fe0-694269a52879 osd.671 up in weight 1 up_from 2268 up_thru 7665 down_at 2224 last_clean_interval [2015,2203) [v2:10.100.190.63:6887/6705,v1:10.100.190.63:6895/6705] [v2:10.100.188.44:6890/6705,v1:10.100.188.44:6894/6705] exists,up 5e07fa81-6d50-4d4b-a528-84a831140ebf osd.672 up in weight 1 up_from 2262 up_thru 7661 down_at 2250 last_clean_interval [2035,2247) [v2:10.100.190.60:6836/6808,v1:10.100.190.60:6846/6808] [v2:10.100.188.41:6837/6808,v1:10.100.188.41:6844/6808] exists,up 0f50e180-7671-4937-9713-2d4ad647b94e osd.673 up in weight 1 up_from 2262 up_thru 7662 down_at 2245 last_clean_interval [2034,2244) [v2:10.100.190.61:6840/6700,v1:10.100.190.61:6842/6700] [v2:10.100.188.42:6840/6700,v1:10.100.188.42:6842/6700] exists,up ec6912ac-69a9-4825-a0f9-bf389d4aeaf3 osd.674 up in weight 1 up_from 2262 up_thru 7663 down_at 2242 last_clean_interval [2038,2227) [v2:10.100.190.62:6859/6648,v1:10.100.190.62:6861/6648] [v2:10.100.188.43:6858/6648,v1:10.100.188.43:6864/6648] exists,up 8ec109f8-5c25-4a11-9634-33afdec63925 osd.675 up in weight 1 up_from 2266 up_thru 7661 down_at 2223 last_clean_interval [2016,2203) [v2:10.100.190.63:6844/6722,v1:10.100.190.63:6845/6722] [v2:10.100.188.44:6844/6722,v1:10.100.188.44:6845/6722] exists,up 8b08723f-5047-4143-ad21-50ecb9f90eda osd.676 up in weight 1 up_from 2260 up_thru 7664 down_at 2250 last_clean_interval [2037,2247) [v2:10.100.190.60:6800/6734,v1:10.100.190.60:6801/6734] [v2:10.100.188.41:6800/6734,v1:10.100.188.41:6801/6734] exists,up 2549723f-3aac-461c-978f-049f9fe99783 osd.677 up in weight 1 up_from 2262 up_thru 7661 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6868/6718,v1:10.100.190.61:6870/6718] [v2:10.100.188.42:6868/6718,v1:10.100.188.42:6869/6718] exists,up a00795f7-f8b5-4a2a-84d8-89870a548497 osd.678 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2039,2227) [v2:10.100.190.62:6804/6696,v1:10.100.190.62:6805/6696] [v2:10.100.188.43:6804/6696,v1:10.100.188.43:6805/6696] exists,up e7ffac94-510c-47b1-8106-2fca724cec13 osd.679 up in weight 1 up_from 2263 up_thru 7661 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6807/6765,v1:10.100.190.63:6809/6765] [v2:10.100.188.44:6808/6765,v1:10.100.188.44:6809/6765] exists,up 1a0c5a40-43e5-481f-9c9c-437411fc48fb osd.680 up in weight 1 up_from 2262 up_thru 7662 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6819/6766,v1:10.100.190.60:6826/6766] [v2:10.100.188.41:6819/6766,v1:10.100.188.41:6827/6766] exists,up 5b8e7bf8-48bc-46d8-8e42-4b2b9a6a904c osd.681 up in weight 1 up_from 2262 up_thru 7567 down_at 2245 last_clean_interval [2034,2244) [v2:10.100.190.61:6880/6686,v1:10.100.190.61:6883/6686] [v2:10.100.188.42:6881/6686,v1:10.100.188.42:6882/6686] exists,up 819be71a-484f-4133-869f-1b976af6e099 osd.682 up in weight 1 up_from 2262 up_thru 7662 down_at 2243 last_clean_interval [2038,2227) [v2:10.100.190.62:6853/6668,v1:10.100.190.62:6858/6668] [v2:10.100.188.43:6855/6668,v1:10.100.188.43:6862/6668] exists,up f7a121d6-2b34-4866-9a24-158e96f1db01 osd.683 up in weight 1 up_from 2264 up_thru 7661 down_at 2224 last_clean_interval [2016,2203) [v2:10.100.190.63:6824/6758,v1:10.100.190.63:6826/6758] [v2:10.100.188.44:6824/6758,v1:10.100.188.44:6826/6758] exists,up 788ba8d9-d579-451e-bbee-82907a27a69e osd.684 up in weight 1 up_from 2263 up_thru 7661 down_at 2249 last_clean_interval [2037,2247) [v2:10.100.190.60:6820/6828,v1:10.100.190.60:6827/6828] [v2:10.100.188.41:6820/6828,v1:10.100.188.41:6828/6828] exists,up 624c85ff-ce48-40c5-b16f-70c121139dac osd.685 up in weight 1 up_from 2264 up_thru 7663 down_at 2246 last_clean_interval [2035,2244) [v2:10.100.190.61:6915/6696,v1:10.100.190.61:6917/6696] [v2:10.100.188.42:6916/6696,v1:10.100.188.42:6917/6696] exists,up 3d389e60-40f3-427f-a2ea-23a26bca8359 osd.686 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2032,2227) [v2:10.100.190.62:6806/6650,v1:10.100.190.62:6808/6650] [v2:10.100.188.43:6806/6650,v1:10.100.188.43:6807/6650] exists,up e739f86e-d755-4eaa-87db-b540c5fa23c8 osd.687 up in weight 1 up_from 2263 up_thru 7661 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6825/6661,v1:10.100.190.63:6827/6661] [v2:10.100.188.44:6825/6661,v1:10.100.188.44:6827/6661] exists,up 72d666c4-e544-4cd7-8d13-551f29babb79 osd.688 up in weight 1 up_from 2262 up_thru 7661 down_at 2250 last_clean_interval [2037,2247) [v2:10.100.190.60:6823/6723,v1:10.100.190.60:6830/6723] [v2:10.100.188.41:6821/6723,v1:10.100.188.41:6829/6723] exists,up 08c305e9-df0f-4d04-8803-f783f890242a osd.689 up in weight 1 up_from 2264 up_thru 7662 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6924/6633,v1:10.100.190.61:6925/6633] [v2:10.100.188.42:6924/6633,v1:10.100.188.42:6925/6633] exists,up 3c780633-e9f4-408a-b325-cbfd2b3eef91 osd.690 up in weight 1 up_from 2262 up_thru 7662 down_at 2242 last_clean_interval [2032,2227) [v2:10.100.190.62:6874/6585,v1:10.100.190.62:6884/6585] [v2:10.100.188.43:6873/6585,v1:10.100.188.43:6887/6585] exists,up 239aea08-8730-4e44-afc9-33c92ae3a05f osd.691 up in weight 1 up_from 2266 up_thru 7661 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6840/6678,v1:10.100.190.63:6841/6678] [v2:10.100.188.44:6840/6678,v1:10.100.188.44:6841/6678] exists,up 74b0cf52-4657-4965-97d0-ff8ab2865779 osd.692 up in weight 1 up_from 2262 up_thru 7661 down_at 2250 last_clean_interval [2037,2247) [v2:10.100.190.60:6871/6763,v1:10.100.190.60:6875/6763] [v2:10.100.188.41:6872/6763,v1:10.100.188.41:6874/6763] exists,up 47abd9c7-888c-47d9-915e-4c7bebae2617 osd.693 up in weight 1 up_from 2260 up_thru 7661 down_at 2246 last_clean_interval [2034,2244) [v2:10.100.190.61:6836/6610,v1:10.100.190.61:6838/6610] [v2:10.100.188.42:6837/6610,v1:10.100.188.42:6839/6610] exists,up e226add3-232d-4af4-9a28-3636e84ef2c9 osd.694 up in weight 1 up_from 2260 up_thru 7664 down_at 2241 last_clean_interval [2032,2227) [v2:10.100.190.62:6852/6598,v1:10.100.190.62:6856/6598] [v2:10.100.188.43:6851/6598,v1:10.100.188.43:6852/6598] exists,up c0e9d8f1-7c11-4545-a853-6835e25d5865 osd.695 up in weight 1 up_from 2264 up_thru 7662 down_at 2224 last_clean_interval [2017,2203) [v2:10.100.190.63:6800/6795,v1:10.100.190.63:6801/6795] [v2:10.100.188.44:6800/6795,v1:10.100.188.44:6801/6795] exists,up c2574405-837d-402d-9989-a3bf5c9850c9 osd.696 up in weight 1 up_from 2266 up_thru 7660 down_at 2249 last_clean_interval [2037,2247) [v2:10.100.190.60:6913/6696,v1:10.100.190.60:6916/6696] [v2:10.100.188.41:6914/6696,v1:10.100.188.41:6917/6696] exists,up d9d3f5d3-d405-4486-b6a4-e639beefab97 osd.697 up in weight 1 up_from 2262 up_thru 7594 down_at 2246 last_clean_interval [2034,2244) [v2:10.100.190.61:6855/6694,v1:10.100.190.61:6857/6694] [v2:10.100.188.42:6854/6694,v1:10.100.188.42:6857/6694] exists,up d6a51ab6-5210-4ded-9f27-5d7acae3a62a osd.698 up in weight 1 up_from 2260 up_thru 7661 down_at 2242 last_clean_interval [2032,2227) [v2:10.100.190.62:6883/6609,v1:10.100.190.62:6898/6609] [v2:10.100.188.43:6889/6609,v1:10.100.188.43:6893/6609] exists,up cad587b8-2e53-4d51-86e1-44749c34ce21 osd.699 up in weight 1 up_from 2268 up_thru 7662 down_at 2223 last_clean_interval [2016,2203) [v2:10.100.190.63:6884/6711,v1:10.100.190.63:6888/6711] [v2:10.100.188.44:6882/6711,v1:10.100.188.44:6887/6711] exists,up 6e4d617c-824d-4345-a73f-ce2ae8041b60 osd.700 up in weight 1 up_from 2262 up_thru 7660 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6821/6832,v1:10.100.190.60:6828/6832] [v2:10.100.188.41:6823/6832,v1:10.100.188.41:6830/6832] exists,up e9bf3048-62b6-431d-82c4-5b9c24eabfd8 osd.701 up in weight 1 up_from 2263 up_thru 7662 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6900/6644,v1:10.100.190.61:6903/6644] [v2:10.100.188.42:6901/6644,v1:10.100.188.42:6903/6644] exists,up 463ed4a9-dbd8-4825-ae62-7a207cf76ee7 osd.702 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6822/6656,v1:10.100.190.62:6831/6656] [v2:10.100.188.43:6829/6656,v1:10.100.188.43:6833/6656] exists,up aadb9ddd-f4d0-42b6-a359-eaa494201bfe osd.703 up in weight 1 up_from 2268 up_thru 7661 down_at 2223 last_clean_interval [2016,2203) [v2:10.100.190.63:6881/6763,v1:10.100.190.63:6883/6763] [v2:10.100.188.44:6880/6763,v1:10.100.188.44:6884/6763] exists,up 431bd6b0-0bc8-44d4-bd23-50575e24bbc1 osd.704 up in weight 1 up_from 2262 up_thru 7662 down_at 2249 last_clean_interval [2037,2247) [v2:10.100.190.60:6835/6803,v1:10.100.190.60:6843/6803] [v2:10.100.188.41:6836/6803,v1:10.100.188.41:6842/6803] exists,up 9fca9607-a34b-4d5a-af1b-6019c13286e9 osd.705 up in weight 1 up_from 2260 up_thru 7660 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6800/6692,v1:10.100.190.61:6801/6692] [v2:10.100.188.42:6800/6692,v1:10.100.188.42:6801/6692] exists,up e889032a-1d8b-4782-a8e6-a1db406882d1 osd.706 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2035,2227) [v2:10.100.190.62:6876/6612,v1:10.100.190.62:6891/6612] [v2:10.100.188.43:6881/6612,v1:10.100.188.43:6891/6612] exists,up e2477c6b-38d9-4747-9b65-7f20bebf2712 osd.707 up in weight 1 up_from 2268 up_thru 7663 down_at 2224 last_clean_interval [2018,2203) [v2:10.100.190.63:6893/6670,v1:10.100.190.63:6904/6670] [v2:10.100.188.44:6897/6670,v1:10.100.188.44:6902/6670] exists,up 0e181cb7-847b-4bb9-98ea-f1b31d144d96 osd.708 up in weight 1 up_from 2266 up_thru 7661 down_at 2250 last_clean_interval [2036,2247) [v2:10.100.190.60:6918/6756,v1:10.100.190.60:6919/6756] [v2:10.100.188.41:6918/6756,v1:10.100.188.41:6919/6756] exists,up de07d810-79cc-4047-bedb-99ae8b08f024 osd.709 up in weight 1 up_from 2262 up_thru 7664 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6814/6720,v1:10.100.190.61:6818/6720] [v2:10.100.188.42:6815/6720,v1:10.100.188.42:6818/6720] exists,up 468ce64b-c034-4fc9-9d5b-61fe706082da osd.710 up in weight 1 up_from 2262 up_thru 7663 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6860/6596,v1:10.100.190.62:6864/6596] [v2:10.100.188.43:6856/6596,v1:10.100.188.43:6857/6596] exists,up b48b51ba-25e0-4cdb-a453-97a5427847ee osd.711 up in weight 1 up_from 2267 up_thru 7662 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6869/6642,v1:10.100.190.63:6871/6642] [v2:10.100.188.44:6868/6642,v1:10.100.188.44:6870/6642] exists,up c2d41ebc-5c98-4acb-86e8-a6ff1e4ab309 osd.712 up in weight 1 up_from 2266 up_thru 7581 down_at 2250 last_clean_interval [2037,2247) [v2:10.100.190.60:6900/6759,v1:10.100.190.60:6901/6759] [v2:10.100.188.41:6900/6759,v1:10.100.188.41:6901/6759] exists,up 74149ebe-e955-430e-ae7c-1a1d04f5d535 osd.713 up in weight 1 up_from 2262 up_thru 7661 down_at 2246 last_clean_interval [2035,2244) [v2:10.100.190.61:6850/6715,v1:10.100.190.61:6853/6715] [v2:10.100.188.42:6849/6715,v1:10.100.188.42:6852/6715] exists,up 17100419-05f9-47ea-9f5e-314521b1a8d2 osd.714 up in weight 1 up_from 2262 up_thru 7662 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6863/6636,v1:10.100.190.62:6882/6636] [v2:10.100.188.43:6871/6636,v1:10.100.188.43:6876/6636] exists,up 6238cd64-8a41-493f-969e-2cb4043d1bae osd.715 up in weight 1 up_from 2267 up_thru 7661 down_at 2224 last_clean_interval [2015,2203) [v2:10.100.190.63:6900/6742,v1:10.100.190.63:6907/6742] [v2:10.100.188.44:6901/6742,v1:10.100.188.44:6907/6742] exists,up 8645b68b-99bf-4596-b2cb-108325c8d845 osd.716 up in weight 1 up_from 2262 up_thru 7661 down_at 2249 last_clean_interval [2032,2247) [v2:10.100.190.60:6872/6815,v1:10.100.190.60:6873/6815] [v2:10.100.188.41:6870/6815,v1:10.100.188.41:6873/6815] exists,up 1254899c-79b5-423c-9d42-f2bbcd05c325 osd.717 up in weight 1 up_from 2260 up_thru 7662 down_at 2245 last_clean_interval [2034,2244) [v2:10.100.190.61:6869/6651,v1:10.100.190.61:6871/6651] [v2:10.100.188.42:6870/6651,v1:10.100.188.42:6871/6651] exists,up 90208249-6f5e-4929-b346-25bcc4b70d96 osd.718 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6819/6683,v1:10.100.190.62:6824/6683] [v2:10.100.188.43:6816/6683,v1:10.100.188.43:6818/6683] exists,up 51b790ea-b35a-4b14-a316-da659c739be4 osd.719 up in weight 1 up_from 2269 up_thru 7662 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6886/6684,v1:10.100.190.63:6890/6684] [v2:10.100.188.44:6883/6684,v1:10.100.188.44:6888/6684] exists,up bb3644c3-428e-414f-972d-df8e10229fee osd.720 up in weight 1 up_from 2266 up_thru 7662 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6904/6729,v1:10.100.190.60:6905/6729] [v2:10.100.188.41:6904/6729,v1:10.100.188.41:6905/6729] exists,up 69aa0104-7ce0-4d96-bcdc-148b9185bff8 osd.721 up in weight 1 up_from 2263 up_thru 7661 down_at 2245 last_clean_interval [2033,2244) [v2:10.100.190.61:6920/6708,v1:10.100.190.61:6921/6708] [v2:10.100.188.42:6920/6708,v1:10.100.188.42:6921/6708] exists,up 0f89e3d6-800f-453a-bc96-caac85435abd osd.722 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6849/6661,v1:10.100.190.62:6855/6661] [v2:10.100.188.43:6853/6661,v1:10.100.188.43:6860/6661] exists,up 4ac1c588-9f08-4a0b-88b8-858b3142f35a osd.723 up in weight 1 up_from 2268 up_thru 7661 down_at 2223 last_clean_interval [2017,2203) [v2:10.100.190.63:6856/6717,v1:10.100.190.63:6857/6717] [v2:10.100.188.44:6856/6717,v1:10.100.188.44:6857/6717] exists,up 38d21f8a-23d5-443c-9b4b-fb9152923d0d osd.724 up in weight 1 up_from 2260 up_thru 7662 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6817/6812,v1:10.100.190.60:6824/6812] [v2:10.100.188.41:6818/6812,v1:10.100.188.41:6825/6812] exists,up 1296a2ff-79f0-4a49-a9af-1c2904dea318 osd.725 up in weight 1 up_from 2263 up_thru 7661 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6905/6705,v1:10.100.190.61:6908/6705] [v2:10.100.188.42:6905/6705,v1:10.100.188.42:6908/6705] exists,up a1d50c8e-8d0c-4620-817c-fc897ebf04fb osd.726 up in weight 1 up_from 2264 up_thru 7662 down_at 2242 last_clean_interval [2035,2227) [v2:10.100.190.62:6848/6693,v1:10.100.190.62:6851/6693] [v2:10.100.188.43:6848/6693,v1:10.100.188.43:6849/6693] exists,up 6cb2ea1a-9080-4197-888b-4dccc038d162 osd.727 up in weight 1 up_from 2268 up_thru 7664 down_at 2223 last_clean_interval [2014,2203) [v2:10.100.190.63:6892/6650,v1:10.100.190.63:6894/6650] [v2:10.100.188.44:6891/6650,v1:10.100.188.44:6896/6650] exists,up 4fe3adca-50bf-47f3-99ba-2396fda251c9 osd.728 up in weight 1 up_from 2262 up_thru 7661 down_at 2250 last_clean_interval [2036,2247) [v2:10.100.190.60:6839/6821,v1:10.100.190.60:6853/6821] [v2:10.100.188.41:6848/6821,v1:10.100.188.41:6855/6821] exists,up c0cae204-ca87-44ce-9da2-6ab9eebd73dc osd.729 up in weight 1 up_from 2262 up_thru 7661 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6837/6682,v1:10.100.190.61:6839/6682] [v2:10.100.188.42:6836/6682,v1:10.100.188.42:6838/6682] exists,up 9c29b657-4095-416b-ae98-3b54612b2c0b osd.730 up in weight 1 up_from 2260 up_thru 7661 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6873/6639,v1:10.100.190.62:6888/6639] [v2:10.100.188.43:6877/6639,v1:10.100.188.43:6884/6639] exists,up ec2cd933-806d-4c32-85ff-3f2380e252cb osd.731 up in weight 1 up_from 2268 up_thru 7662 down_at 2224 last_clean_interval [2015,2203) [v2:10.100.190.63:6877/6726,v1:10.100.190.63:6879/6726] [v2:10.100.188.44:6878/6726,v1:10.100.188.44:6886/6726] exists,up 3f3a76db-18fa-4274-a794-1c82d828f347 osd.732 up in weight 1 up_from 2262 up_thru 7662 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6808/6703,v1:10.100.190.60:6809/6703] [v2:10.100.188.41:6808/6703,v1:10.100.188.41:6809/6703] exists,up 90f6112e-790b-4acb-874e-face174347d0 osd.733 up in weight 1 up_from 2263 up_thru 7662 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6894/6689,v1:10.100.190.61:6895/6689] [v2:10.100.188.42:6893/6689,v1:10.100.188.42:6894/6689] exists,up ae605ad3-7635-4184-bfb3-2470b3375c4b osd.734 up in weight 1 up_from 2264 up_thru 7662 down_at 2242 last_clean_interval [2035,2227) [v2:10.100.190.62:6893/6642,v1:10.100.190.62:6908/6642] [v2:10.100.188.43:6899/6642,v1:10.100.188.43:6907/6642] exists,up 8af74845-d6f8-4590-8525-e7baa36d2c0e osd.735 up in weight 1 up_from 2268 up_thru 7662 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6924/6778,v1:10.100.190.63:6925/6778] [v2:10.100.188.44:6924/6778,v1:10.100.188.44:6925/6778] exists,up a6af9100-b674-4bc9-9d6e-6324665073d8 osd.736 up in weight 1 up_from 2266 up_thru 7662 down_at 2248 last_clean_interval [2035,2247) [v2:10.100.190.60:6885/6714,v1:10.100.190.60:6887/6714] [v2:10.100.188.41:6885/6714,v1:10.100.188.41:6887/6714] exists,up 7890f1a3-7e28-453e-ab1d-eeb3b454b9b6 osd.737 up in weight 1 up_from 2260 up_thru 7664 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6824/6618,v1:10.100.190.61:6826/6618] [v2:10.100.188.42:6825/6618,v1:10.100.188.42:6827/6618] exists,up 386c10f0-3c75-4c3c-add4-9fb9fd796b2d osd.738 up in weight 1 up_from 2260 up_thru 7662 down_at 2242 last_clean_interval [2035,2227) [v2:10.100.190.62:6885/6680,v1:10.100.190.62:6899/6680] [v2:10.100.188.43:6896/6680,v1:10.100.188.43:6908/6680] exists,up 9ef71631-8bd5-48e9-a7f5-2ec855d47b0b osd.739 up in weight 1 up_from 2263 up_thru 7662 down_at 2224 last_clean_interval [2016,2203) [v2:10.100.190.63:6832/6655,v1:10.100.190.63:6833/6655] [v2:10.100.188.44:6832/6655,v1:10.100.188.44:6833/6655] exists,up 84ed6611-265c-4283-bd39-988583a02ab2 osd.740 up in weight 1 up_from 2262 up_thru 7662 down_at 2249 last_clean_interval [2038,2247) [v2:10.100.190.60:6822/6744,v1:10.100.190.60:6829/6744] [v2:10.100.188.41:6824/6744,v1:10.100.188.41:6832/6744] exists,up 7f486cad-fe18-4b0f-a1b1-e8e220d62ee4 osd.741 up in weight 1 up_from 2262 up_thru 7664 down_at 2245 last_clean_interval [2036,2244) [v2:10.100.190.61:6812/6640,v1:10.100.190.61:6817/6640] [v2:10.100.188.42:6811/6640,v1:10.100.188.42:6814/6640] exists,up db120d2a-f6e4-4e3a-8a5c-c81ff7dec182 osd.742 up in weight 1 up_from 2264 up_thru 7661 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6890/6634,v1:10.100.190.62:6897/6634] [v2:10.100.188.43:6883/6634,v1:10.100.188.43:6888/6634] exists,up db4f7c5e-5bdc-4e5e-8551-3a3c768edd7c osd.743 up in weight 1 up_from 2266 up_thru 7662 down_at 2224 last_clean_interval [2013,2203) [v2:10.100.190.63:6848/6729,v1:10.100.190.63:6849/6729] [v2:10.100.188.44:6848/6729,v1:10.100.188.44:6849/6729] exists,up 055948ee-324e-4dea-b7c5-7eed5a89237c osd.744 up in weight 1 up_from 2260 up_thru 7661 down_at 2248 last_clean_interval [2037,2247) [v2:10.100.190.60:6804/6797,v1:10.100.190.60:6805/6797] [v2:10.100.188.41:6804/6797,v1:10.100.188.41:6805/6797] exists,up 287c7d89-7beb-4e0f-9ea0-7d3841ad5f8f osd.745 up in weight 1 up_from 2264 up_thru 7663 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6888/6665,v1:10.100.190.61:6891/6665] [v2:10.100.188.42:6889/6665,v1:10.100.188.42:6891/6665] exists,up 8e4e73bf-49b3-4f4b-addc-ab0a4c28636b osd.746 up in weight 1 up_from 2263 up_thru 7664 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6807/6627,v1:10.100.190.62:6809/6627] [v2:10.100.188.43:6808/6627,v1:10.100.188.43:6809/6627] exists,up 307f5f84-506c-4d38-80f7-6687c2765465 osd.747 up in weight 1 up_from 2267 up_thru 7630 down_at 2224 last_clean_interval [2015,2203) [v2:10.100.190.63:6866/6790,v1:10.100.190.63:6867/6790] [v2:10.100.188.44:6866/6790,v1:10.100.188.44:6871/6790] exists,up 49c586da-b33a-4985-af9a-fbf1495cbe9c osd.748 up in weight 1 up_from 2267 up_thru 7661 down_at 2250 last_clean_interval [2037,2247) [v2:10.100.190.60:6891/6777,v1:10.100.190.60:6894/6777] [v2:10.100.188.41:6891/6777,v1:10.100.188.41:6893/6777] exists,up 3753d7df-54df-4e5d-a7d0-af543b0e3d17 osd.749 up in weight 1 up_from 2263 up_thru 7662 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6906/6726,v1:10.100.190.61:6910/6726] [v2:10.100.188.42:6907/6726,v1:10.100.188.42:6910/6726] exists,up b0872720-c907-4497-8898-5a17c23d5213 osd.750 up in weight 1 up_from 2262 up_thru 7664 down_at 2242 last_clean_interval [2039,2227) [v2:10.100.190.62:6817/6615,v1:10.100.190.62:6823/6615] [v2:10.100.188.43:6817/6615,v1:10.100.188.43:6820/6615] exists,up c3432141-b219-4dc4-91d9-234a139d1250 osd.751 up in weight 1 up_from 2263 up_thru 7664 down_at 2224 last_clean_interval [2015,2203) [v2:10.100.190.63:6816/6696,v1:10.100.190.63:6819/6696] [v2:10.100.188.44:6816/6696,v1:10.100.188.44:6819/6696] exists,up 7b2fad61-d462-451c-8ea4-1a3ce223ebd1 osd.752 up in weight 1 up_from 2263 up_thru 7665 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6899/6675,v1:10.100.190.61:6902/6675] [v2:10.100.188.42:6898/6675,v1:10.100.188.42:6902/6675] exists,up d608a63c-a48f-4b20-a46a-c4f39948bb68 osd.753 up in weight 1 up_from 2262 up_thru 7661 down_at 2249 last_clean_interval [2037,2247) [v2:10.100.190.60:6870/6773,v1:10.100.190.60:6874/6773] [v2:10.100.188.41:6871/6773,v1:10.100.188.41:6875/6773] exists,up 4f006669-4ac7-41c3-a328-7806371ad544 osd.754 up in weight 1 up_from 2260 up_thru 7664 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6818/6622,v1:10.100.190.62:6826/6622] [v2:10.100.188.43:6819/6622,v1:10.100.188.43:6824/6622] exists,up 460653da-f14d-486d-bed7-c4641bcb353e osd.755 up in weight 1 up_from 2268 up_thru 7661 down_at 2223 last_clean_interval [2013,2203) [v2:10.100.190.63:6880/6692,v1:10.100.190.63:6882/6692] [v2:10.100.188.44:6879/6692,v1:10.100.188.44:6881/6692] exists,up 1da2f8a0-2b2d-4396-b089-63c86f05f95d osd.756 up in weight 1 up_from 2262 up_thru 7660 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6810/6691,v1:10.100.190.60:6812/6691] [v2:10.100.188.41:6810/6691,v1:10.100.188.41:6812/6691] exists,up 965a9ca0-2b78-442c-88e7-3e56eccbf216 osd.757 up in weight 1 up_from 2264 up_thru 7661 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6879/6622,v1:10.100.190.61:6882/6622] [v2:10.100.188.42:6879/6622,v1:10.100.188.42:6883/6622] exists,up 2e9a0baa-d5cb-48b8-b7b5-ec29ce3d1e8d osd.758 up in weight 1 up_from 2262 up_thru 7661 down_at 2242 last_clean_interval [2032,2227) [v2:10.100.190.62:6865/6664,v1:10.100.190.62:6877/6664] [v2:10.100.188.43:6872/6664,v1:10.100.188.43:6885/6664] exists,up 29619a83-e74c-45d3-aa94-48e2afb1f9d5 osd.759 up in weight 1 up_from 2264 up_thru 7664 down_at 2223 last_clean_interval [2015,2203) [v2:10.100.190.63:6804/6771,v1:10.100.190.63:6805/6771] [v2:10.100.188.44:6804/6771,v1:10.100.188.44:6805/6771] exists,up a0a08931-c201-4845-94fe-1d80da740ce9 osd.760 up in weight 1 up_from 2267 up_thru 7661 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6924/6688,v1:10.100.190.60:6925/6688] [v2:10.100.188.41:6924/6688,v1:10.100.188.41:6925/6688] exists,up c4c2a126-6384-4f40-a078-729a272cf60f osd.761 up in weight 1 up_from 2262 up_thru 7664 down_at 2245 last_clean_interval [2033,2244) [v2:10.100.190.61:6841/6679,v1:10.100.190.61:6843/6679] [v2:10.100.188.42:6841/6679,v1:10.100.188.42:6843/6679] exists,up a332514c-88b6-477e-b43e-21f78c8222ef osd.762 up in weight 1 up_from 2263 up_thru 7662 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6820/6602,v1:10.100.190.62:6828/6602] [v2:10.100.188.43:6823/6602,v1:10.100.188.43:6828/6602] exists,up bbd31856-ccc1-4ed9-8c11-58d84e6ffcf0 osd.763 up in weight 1 up_from 2268 up_thru 7661 down_at 2223 last_clean_interval [2016,2203) [v2:10.100.190.63:6876/6676,v1:10.100.190.63:6878/6676] [v2:10.100.188.44:6876/6676,v1:10.100.188.44:6877/6676] exists,up dbe64db1-e288-4b46-bf28-9ba9f8a32ad2 osd.764 up in weight 1 up_from 2262 up_thru 7662 down_at 2249 last_clean_interval [2036,2247) [v2:10.100.190.60:6862/6749,v1:10.100.190.60:6866/6749] [v2:10.100.188.41:6860/6749,v1:10.100.188.41:6868/6749] exists,up c947ba55-dcd7-49a0-bf7a-ce718c124659 osd.765 up in weight 1 up_from 2263 up_thru 7663 down_at 2245 last_clean_interval [2035,2244) [v2:10.100.190.61:6878/6672,v1:10.100.190.61:6881/6672] [v2:10.100.188.42:6878/6672,v1:10.100.188.42:6880/6672] exists,up 13350451-15c0-48e9-8413-1fda9039a776 osd.766 up in weight 1 up_from 2263 up_thru 7664 down_at 2242 last_clean_interval [2036,2227) [v2:10.100.190.62:6800/6631,v1:10.100.190.62:6801/6631] [v2:10.100.188.43:6800/6631,v1:10.100.188.43:6801/6631] exists,up c786b990-eadc-4d94-bd20-bdd9080d32b5 osd.767 up in weight 1 up_from 2267 up_thru 7661 down_at 2224 last_clean_interval [2016,2203) [v2:10.100.190.63:6864/6751,v1:10.100.190.63:6865/6751] [v2:10.100.188.44:6864/6751,v1:10.100.188.44:6865/6751] exists,up 30ddc58f-b550-4347-8af6-0762ec34a994 El 5/5/21 a las 11:12, David Caro escribió:
I think that the recovery might be blocked due to all those PGs in inactive state: https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/4/html/ad...
""" Inactive: Placement groups cannot process reads or writes because they are waiting for an OSD with the most up-to-date data to come back up. """
What is your pool configuration? And other configs?
Can you send the output of "ceph config dump" and "osd pool detail"?
On 05/05 11:00, Andres Rojas Guerrero wrote:
Yes, the principal problem is the MDS start to report slowly and the information is no longer accessible, and the cluster never recover.
# ceph status cluster: id: c74da5b8-3d1b-483e-8b3a-739134db6cf8 health: HEALTH_WARN 2 clients failing to respond to capability release 2 MDSs report slow metadata IOs 1 MDSs report slow requests 2 MDSs behind on trimming Reduced data availability: 238 pgs inactive, 8 pgs down, 230 pgs incomplete Degraded data redundancy: 1400453/220552172 objects degraded (0.635%), 461 pgs degraded, 464 pgs undersized 241 slow ops, oldest one blocked for 638 sec, daemons [osd.101,osd.127,osd.155,osd.166,osd.172,osd.189,osd.200,osd.210,osd.214,osd.233]... have slow ops.
services: mon: 3 daemons, quorum ceph2mon01,ceph2mon02,ceph2mon03 (age 25h) mgr: ceph2mon02(active, since 6d), standbys: ceph2mon01, ceph2mon03 mds: nxtclfs:2 {0=ceph2mon01=up:active,1=ceph2mon02=up:active} 1 up:standby osd: 768 osds: 736 up (since 11m), 736 in (since 95s); 416 remapped pgs
data: pools: 2 pools, 16384 pgs objects: 33.40M objects, 39 TiB usage: 63 TiB used, 2.6 PiB / 2.6 PiB avail pgs: 1.489% pgs not active 1400453/220552172 objects degraded (0.635%) 15676 active+clean 285 active+undersized+degraded+remapped+backfill_wait 230 incomplete 176 active+undersized+degraded+remapped+backfilling 8 down 6 peering 3 active+undersized+remapped
El 5/5/21 a las 10:54, David Caro escribió:
Can you share more information?
The output of 'ceph status' when the osd is down would help, also 'ceph health detail' could be useful.
On 05/05 10:48, Andres Rojas Guerrero wrote:
Hi, I have a Nautilus cluster version 14.2.6 , and I have noted that when some OSD go down the cluster doesn't start recover. I have checked that the option noout is unset.
What could be the reason for this behavior?
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es ******************************************************* _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
-- ******************************************************* Andrés Rojas Guerrero Unidad Sistemas Linux Area Arquitectura Tecnológica Secretaría General Adjunta de Informática Consejo Superior de Investigaciones Científicas (CSIC) Pinar 19 28006 - Madrid Tel: +34 915680059 -- Ext. 990059 email: a.rojas@csic.es ID comunicate.csic.es: @50852720l:matrix.csic.es *******************************************************
participants (7)
-
Andres Rojas Guerrero
-
Burkhard Linke
-
Clyso GmbH - Ceph Foundation Member
-
David Caro
-
Eugen Block
-
Joachim Kraftmayer
-
Robert Sander