I did a set of 30GB OSDs before with extra disk space on my SSDs for the
metadata pool on cephfs and my entire cluster locked up about 3 weeks
later. Some metadata operation was happening, filled some of the 30GB disks
to 100%, and all IO was blocked in the cluster. I did some trickery of
deleting 1 copy of a few PGs on each OSD, such that I still had at least 2
copies of each PG, and was able to backfill the pool back onto my HDDs and
restore cluster functionality. I would say that trying to use that space is
definitely not worth it.
In one of my production clusters I occasionally get a warning state that an
omap object is too large in my buckets.index pool. I could very easily
imagine that stalling the entire cluster if my index pool were on such
small OSDs.
On Tue, Oct 22, 2019, 6:55 PM Frank R <frankaritchie(a)gmail.com> wrote:
Hi all,
I have 40 nvme drives with about 20G free space each.
Would creating a 10GB partition/lvm on each of the nvmes for an rgw index
pool be a bad idea?
RGW has about about 5 million objects
I don't think space will be an issue but I am worried about the 10G size,
is it just too small for a bluestore OSD?
thx
Frank
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io