On 2020-10-20 23:57, Ing. Luis Felipe DomÃnguez Vega wrote:
Hi, today mi Infra provider has a blackout, then the Ceph was try to recover but are in an inconsistent state because many OSD can recover itself because the kernel kill it by OOM. Even now one OSD that was OK, go down by OOM killed.
Even in a server with 32GB RAM the OSD use ALL that and never recover, i think that can be a memory leak, ceph version octopus 15.2.3
Especially during recovery Ceph can use a lot of memory. How many OSDDs do you have in that server? How many PGs per OSD? The default osd_memory_target is 4 GB, and besides that extra memory is used. You can try to limit the mem target and restart the OSD (for example: ceph config set osd osd_memory_target 2G). Gr. Stefan