Re: [Octopus] Beware the on-disk conversion
Doh, I hope so! On Wed, Apr 1, 2020 at 5:35 PM Marc Roos <M.Roos@f1-outsourcing.eu> wrote:
April fools day!!!!!! :)
-----Original Message----- Sent: 01 April 2020 17:28 To: ceph-users@ceph.io Subject: [ceph-users] [Octopus] Beware the on-disk conversion
Hi,
As the upgrade documentation tells:
Note that the first time each OSD starts, it will do a format conversion to improve the accounting for omap data. This may take a few minutes to as much as a few hours (for an HDD with lots of omap data). You can disable this automatic conversion with:
What the documentation does not say is that this process takes a lot of memory
I am upgrading a rusty cluster from Nautilus, you can check out the ram consumption as attachment
First, we have a 3TB osd conversion: it tooks ~15min, and 19GB of memory
Then, we have a larger 6TB osd conversion: it tooks more than 2 hours, and 35GB of memory
Finally, you have the largest 10TB osd: only 1H15, but 52GB of memory
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
It is not a joke :) First node is upgraded (and converted), my cluster is currently healing its degraded objects On 4/1/20 5:37 PM, Dan van der Ster wrote:
Doh, I hope so!
On Wed, Apr 1, 2020 at 5:35 PM Marc Roos <M.Roos@f1-outsourcing.eu> wrote:
April fools day!!!!!! :)
-----Original Message----- Sent: 01 April 2020 17:28 To: ceph-users@ceph.io Subject: [ceph-users] [Octopus] Beware the on-disk conversion
Hi,
As the upgrade documentation tells:
Note that the first time each OSD starts, it will do a format conversion to improve the accounting for omap data. This may take a few minutes to as much as a few hours (for an HDD with lots of omap data). You can disable this automatic conversion with:
What the documentation does not say is that this process takes a lot of memory
I am upgrading a rusty cluster from Nautilus, you can check out the ram consumption as attachment
First, we have a 3TB osd conversion: it tooks ~15min, and 19GB of memory
Then, we have a larger 6TB osd conversion: it tooks more than 2 hours, and 35GB of memory
Finally, you have the largest 10TB osd: only 1H15, but 52GB of memory
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (2)
-
Dan van der Ster
-
Jack