Since you mention NextCloud it will probably be RWG deployment. ALso it's not clear why 3 nodes? Is rack-space a premium? Just to compare your suggestion: 3x24 (I guess 4U?) x 8TB with Replication = 576 TB raw storage + 192 TB usable Let's go 6x12 (2U) x 4TB with EC 3+2 = 288 TB raw storage + 172 TB usable. Same rack-space, a little bit less usable storage, smaller drives (means faster recovery). Put a SSD or NVME in each server for the Index pool. Plus maybe 2 NVMEs for the WAL/DB On Tue, 8 Jun 2021 at 21:39, Ml Ml <mliebherr99@googlemail.com> wrote:
Hello List,
i used to build 3 Node Cluster with spinning Rust and later with (Enterprise) SSDs. All i did was to buy a 19" Server with 10/12 Slots, plug in the Disks and i was done. The Requirements were just 10/15TB Disk usage (30-45TB Raw).
Now i was asked if i could also build a cheap 200-500TB Cluster Storage, which should also scale. Just for Data Storage such as NextCloud/OwnCloud.
Buying 3x 24 Slot Server with 8TB Enterprise SSDs ends up at about 3x 45k EUR = 135k EUR. Where the SSDs are 90% of the price. (about 1.700EUR per 8TB SSD)
How do the "big boys" do this? Just throw money at it? Would a mix of OSD SSD Metadata + Spinning Rust do the job?
My experience so far is that each time i had a crash/problem it was always such a pain to wait for the spinning rust.
Do you have any experience/hints on this? Maybe combine 3x 10TB HDDs to a 30TB Raid0/striping Disk => which would speed up the performance, but have a bigger impact on a dying disk.
My requirements are more or less low IO Traffic but loads of disk space usage.
Any hints/ideas/links are welcome.
Cheers, Michael _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io