Hi Frank, Am 10.10.24 um 11:13 schrieb Frank Schilder:
I would like to recommend to look at stretch-mode. There have been discussions on this list about the reliability of 2-DC set-ups and just using crush rules to distribute shards doesn't cut it. There are corner cases that are only handled correctly by stretch mode if the system needs to be up with a DC down. For example, it will make sure that with min_size=2 an ACK is only sent to a client if each DC has a shard. An ordinary crush rule will not do that.
Stretch mode only works for replicated pools. Thanks for pointing out this one, I think Bills idea in point 2 goes into the same direction. To avoid unneccessary network traffic, we definitely need to consider stretch mode.
-- Andre Tann