Hey Frank, Frank Schilder <frans@dtu.dk> writes:
Is the crush map aware about that?
Yes, it correctly shows the osds at serve8 (previously server15).
I didn't ever try that, but don't you need to cursh move it?
I originally imagined this, too. But as soon as the osd starts on a new server it is automatically put into the serve8 bucket.
It does not work like this, unfortunately. If you physically move disks to a new server without "informing ceph" in advance, hat is, crush move the OSD while they are up, ceph looses placement information. You can post-repair such a situation by temporarily "crush moving" (software move, not hardware move) the OSDs back to their previous host buckets, wait for peering to complete, and then "crush move" them to their new location again.
That is good to know. So in theory: - crush move osd to a different server bucket - shutdown osd - move physically to another server - no rebalancing needed Should do the job? It won't accept today's rebalance, but it would be good to have a sane way for the future. Cheers, Nico -- Modern, affordable, Swiss Virtual Machines. Visit www.datacenterlight.ch