LARGE_OMAP_OBJECTS 1 large omap objects
Hi, I'm trying to understand the "LARGE_OMAP_OBJECTS 1 large omap objects" warning for out cephfs metadata pool. It seems that pg 5.26 has a large omap object with > 200k keys [WRN] : Large omap object found. Object: 5:654134d2:::mds0_openfiles.0:head PG: 5.4b2c82a6 (5.26) Key count: 286083 Size (bytes): 14043228 I guess this object is related to the open files on the (cephfs mds0_openfiles.0). But what exactly does it tell me? Is the number of keys the number of currently open files? If yes, this is not matching the sum of open files over all clients obtained with lsof (which is less than 1000). So how can I get rid of this? (Reboot the clients?) Thanks for your help Dietmar -- _________________________________________ D i e t m a r R i e d e r, Mag.Dr. Innsbruck Medical University Biocenter - Institute of Bioinformatics Innrain 80, 6020 Innsbruck Email: dietmar.rieder@i-med.ac.at Web: http://www.icbi.at
Safe to ignore/increase the warning threshold. You are seeing this because the warning level was reduced to 200k from 2M recently. The file will be sharded in a newer version which will clean this up Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 On Thu, Apr 2, 2020 at 9:50 AM Dietmar Rieder <dietmar.rieder@i-med.ac.at> wrote:
Hi,
I'm trying to understand the "LARGE_OMAP_OBJECTS 1 large omap objects" warning for out cephfs metadata pool.
It seems that pg 5.26 has a large omap object with > 200k keys
[WRN] : Large omap object found. Object: 5:654134d2:::mds0_openfiles.0:head PG: 5.4b2c82a6 (5.26) Key count: 286083 Size (bytes): 14043228
I guess this object is related to the open files on the (cephfs mds0_openfiles.0). But what exactly does it tell me? Is the number of keys the number of currently open files? If yes, this is not matching the sum of open files over all clients obtained with lsof (which is less than 1000).
So how can I get rid of this? (Reboot the clients?)
Thanks for your help Dietmar
-- _________________________________________ D i e t m a r R i e d e r, Mag.Dr. Innsbruck Medical University Biocenter - Institute of Bioinformatics Innrain 80, 6020 Innsbruck Email: dietmar.rieder@i-med.ac.at Web: http://www.icbi.at _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
On 2020-04-02 12:24, Paul Emmerich wrote:
Safe to ignore/increase the warning threshold. You are seeing this because the warning level was reduced to 200k from 2M recently.
The file will be sharded in a newer version which will clean this up
Thanks Paul, would that "newer version" be nautilus 14.2.8, octopus 15.2+ ? Anyway, do I get this right, that as it is now (14.2.7) the omap object will not get smaller when all files will be closed e.g. when all clients get a reboot? Or if I evict a client? Thanks Dietmar -- _________________________________________ D i e t m a r R i e d e r, Mag.Dr. Innsbruck Medical University Biocenter - Institute of Bioinformatics Innrain 80, 6020 Innsbruck Email: dietmar.rieder@i-med.ac.at Web: http://www.icbi.at
participants (2)
-
Dietmar Rieder
-
Paul Emmerich