[ceph-users] Re: RESEND: Re: PG Balancer Upmap mode not working

Rich, Using your OSDMap, the code in https://github.com/ceph/ceph/pull/31992 and some additional changes to osdmaptool I was able to balance your cluster.  The osdmaptool changes simulate the mgr active balancer behavior.  It never took more than 0.388674 seconds to calculate more upmaps. And that's on a virtual machine used for development.  It took 42 rounds with 10 maximum upmaps created per round.  With the default 1 minute sleeps inside the mgr it would take 42 minutes.  It needed 409 additional upmaps and removed 6. Each pool is balanced individually so the final result is slightly less than perfect (+ or - 1 pg away from weighted target). Final layout: osd.0 pgs 107 osd.1 pgs 106 osd.2 pgs 106 osd.3 pgs 106 osd.4 pgs 106 osd.5 pgs 106 osd.6 pgs 107 osd.7 pgs 105 osd.8 pgs 106 osd.9 pgs 105 osd.10 pgs 105 osd.11 pgs 106 osd.12 pgs 107 osd.13 pgs 107 osd.14 pgs 106 osd.15 pgs 106 osd.16 pgs 107 osd.17 pgs 106 osd.18 pgs 106 osd.19 pgs 105 osd.20 pgs 106 osd.21 pgs 106 osd.22 pgs 106 osd.23 pgs 106 osd.24 pgs 107 osd.25 pgs 106 osd.26 pgs 107 osd.28 pgs 106 osd.29 pgs 106 osd.30 pgs 106 osd.31 pgs 106 osd.32 pgs 106 osd.33 pgs 106 osd.34 pgs 106 osd.35 pgs 106 osd.36 pgs 108 osd.37 pgs 106 osd.38 pgs 107 osd.39 pgs 106 osd.40 pgs 106 osd.41 pgs 106 osd.42 pgs 106 osd.43 pgs 106 osd.44 pgs 106 osd.45 pgs 106 osd.46 pgs 106 osd.47 pgs 106 osd.48 pgs 108 osd.49 pgs 106 osd.50 pgs 107 osd.51 pgs 106 osd.52 pgs 106 osd.53 pgs 106 osd.54 pgs 106 osd.55 pgs 106 osd.56 pgs 106 osd.57 pgs 106 osd.58 pgs 106 osd.59 pgs 106 osd.60 pgs 107 osd.61 pgs 106 osd.62 pgs 106 osd.63 pgs 106 osd.64 pgs 106 osd.65 pgs 106 osd.66 pgs 106 osd.67 pgs 106 osd.68 pgs 106 osd.69 pgs 106 osd.70 pgs 106 osd.71 pgs 106 osd.72 pgs 106 osd.73 pgs 104 osd.74 pgs 106 osd.75 pgs 105 osd.76 pgs 106 osd.77 pgs 106 osd.78 pgs 106 osd.79 pgs 106 osd.80 pgs 105 osd.81 pgs 105 osd.82 pgs 106 osd.83 pgs 106 osd.84 pgs 104 osd.85 pgs 104 osd.86 pgs 106 osd.87 pgs 105 osd.88 pgs 104 osd.89 pgs 106 osd.90 pgs 105 osd.91 pgs 104 osd.92 pgs 105 osd.93 pgs 106 osd.94 pgs 106 osd.95 pgs 106 osd.96 pgs 106 osd.97 pgs 106 osd.98 pgs 106 osd.99 pgs 105 osd.100 pgs 106 osd.101 pgs 106 osd.102 pgs 106 osd.103 pgs 106 osd.104 pgs 106 osd.105 pgs 106 osd.106 pgs 106 osd.107 pgs 106 osd.108 pgs 105 osd.109 pgs 106 osd.110 pgs 105 osd.111 pgs 105 osd.112 pgs 105 osd.113 pgs 105 osd.114 pgs 106 osd.115 pgs 105 osd.116 pgs 105 osd.117 pgs 104 osd.118 pgs 106 osd.119 pgs 105 osd.120 pgs 105 osd.121 pgs 105 osd.122 pgs 106 osd.123 pgs 106 osd.124 pgs 106 osd.125 pgs 105 osd.126 pgs 104 osd.127 pgs 105 osd.128 pgs 106 osd.129 pgs 104 osd.130 pgs 106 osd.131 pgs 106 osd.132 pgs 105 osd.133 pgs 106 osd.134 pgs 105 osd.135 pgs 106 osd.136 pgs 105 osd.137 pgs 105 osd.138 pgs 104 osd.139 pgs 105 osd.140 pgs 105 osd.141 pgs 105 osd.142 pgs 105 osd.143 pgs 105 osd.144 pgs 105 osd.145 pgs 105 osd.146 pgs 105 osd.147 pgs 105 osd.148 pgs 105 osd.149 pgs 105 osd.150 pgs 105 osd.151 pgs 105 osd.152 pgs 105 osd.153 pgs 105 osd.154 pgs 105 osd.155 pgs 105 osd.156 pgs 143 osd.157 pgs 143 osd.158 pgs 143 osd.159 pgs 142 osd.160 pgs 143 osd.161 pgs 142 osd.162 pgs 141 osd.163 pgs 140 osd.164 pgs 140 osd.165 pgs 140 osd.166 pgs 141 osd.167 pgs 141 osd.168 pgs 143 osd.169 pgs 143 osd.170 pgs 143 osd.171 pgs 141 osd.172 pgs 141 osd.173 pgs 142 osd.174 pgs 140 osd.175 pgs 141 osd.176 pgs 141 osd.177 pgs 140 osd.178 pgs 140 osd.179 pgs 140 osd.180 pgs 140 osd.181 pgs 140 osd.182 pgs 140 osd.183 pgs 140 osd.184 pgs 141 osd.185 pgs 141 osd.186 pgs 140 osd.187 pgs 140 osd.188 pgs 140 osd.189 pgs 140 osd.190 pgs 141 osd.191 pgs 140 osd.192 pgs 143 osd.193 pgs 143 osd.194 pgs 143 osd.195 pgs 143 osd.196 pgs 142 osd.197 pgs 142 osd.198 pgs 140 osd.199 pgs 141 osd.200 pgs 140 osd.201 pgs 140 osd.202 pgs 141 osd.203 pgs 141 osd.204 pgs 141 osd.205 pgs 140 osd.206 pgs 140 osd.207 pgs 140 osd.208 pgs 140 osd.209 pgs 140 osd.210 pgs 140 osd.211 pgs 140 osd.212 pgs 140 osd.213 pgs 141 osd.214 pgs 140 osd.215 pgs 140 David On 12/10/19 5:11 PM, Rich Bade wrote: