Common problem for FileStore and really no point in debugging this: upgrade everything to a recent version and migrate to BlueStore. 99% of random latency spikes are just fixed by doing that. Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 On Wed, May 27, 2020 at 3:26 PM Bence Szabo <szabo.bence@gmail.com> wrote:
Hi, We experienced random and relative high latency spikes (around 0.5-10 sec) in our ceph cluster which consists 6 osd nodes, all osd nodes have 6 osd-s. One osd built with one spinning disk and two nvme device. We use a bcache device for osd back end (mixed with hdd and an nvme partition as caching device) and one nvme partition for journal. This synthetic command can be use for check io and latency: rados bench -p rbd 10 write -b 4000 -t 64 With this parameters we often got about 1.5 sec or higher for maximum latency. We cannot decide if our cluster is misconfigured or just this is a natural ceph behavior. Any help, suggestion would be appreciated. Regards, Bence
-- --Szabo Bence --<szabo.bence@gmail.com> _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io