I recently set up a 5-node Proxmox/Ceph cluster with 10 OSDs each node for a total for 50 nodes (approximately 135TB). All the nodes have 768GB RAM and a single 72-Core (144 thread) Epyx CPU. I set the ceph pool size to: 3 and the minimum size: 2. The performance seemed good and everything was happy in cephland! The other day I spoke to a ceph consultant and he recommended I change the pool size from 3/2 to 2/1. He cited several valid points: more usable storage space, faster rebuilds, better performance... I followed his advice and changed it. The benchmark performance was about the same, but the recovery time when I took a node down was improved. I really do like the idea of the extra storage space! So now I am confused whether I should leave it or go back to 3 replicas. Anyone have any thoughts or compelling reasons I should leave it or change it back? Shawn Shawn Heil Phone: (608) 836-7041 | Direct: 6084102333 Email: shawn.heil@brucecompany.com<mailto:shawn.heil@brucecompany.com> | Website: www.brucecompany.com<http://www.brucecompany.com> [cid:SocialLink_Facebook_32x32_24bd5ab0-6667-4cda-9838-e5caaf24a024.png]Find us on Facebook<https://www.facebook.com/pages/The-Bruce-Company/113279807065?ref=hl> [cid:BruceCompanyHomepageLogo(2025)_429ac410-efd6-49ca-8739-0317666483cd.jpg]
