Re: another osd_pglog memory usage incident
On Fri, Oct 9, 2020 at 3:12 PM Marc Roos <M.Roos@f1-outsourcing.eu> wrote:
1. The pg log contains 3000 entries by default (on nautilus). These 3000 entries can legitimately consume gigabytes of ram for some use-cases. (I haven't determined exactly which ops triggered this today).
How can I check how much ram my pg_logs are using?
ceph daemon osd.x dump_mempools | jq .mempool.by_pool.osd_pglog
-----Original Message----- Cc: ceph-users Subject: [ceph-users] Re: another osd_pglog memory usage incident
On 09.10.20 13:55, Dan van der Ster wrote: [...]
I also noticed a possible relationship with scrubbing -- One week ago we increased to osd_max_scrubs=5 to clear out a scrubbing backlog; I wonder if the increased read/write ratio somehow led to an exploding buffer_anon. Do things stabilize on your side if you temporarily disable scrubbing?
During the worst periods, we had disabled scrubbing. When we re-enabled, we had our write-job to mitigate the problems. And currently, scrub load is low. So I cannot tell, but it is very plausible.
Cheers Harry _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (1)
-
Dan van der Ster