Hi, the upgrade question pops up quite regularly, the latest I recall was discussed in this thread [1].
We've had a Nautilus [latest releases] cluster for some years now, and are planning the upgrade process - both moving off Centos7 [ideally to a RHEL9 compatible spin like Alma 9 or Rocky 9] and also moving to a newer Ceph release [ideally Pacific or higher to avoid too many later upgrades needed].
It's not supported to upgrade from N to a later release than P(acific).
For Ceph bluestore OSDs, I assume all the relevant metadata is on the OSD disk [or on the separate disk configured for RocksDB etc if you have nvme], and none is on the OS itself? For Mons and Mgrs, what stuff do I need to retain across the OS upgrade to have things "just work" [since they're relatively stateless, I assume mostly the /etc/ceph/ stuff and ceph cluster keys?]
Basically yes, backing up the /etc/ceph directory with some important keyrings (e. g. admin keyring) and maybe the auth keys can't hurt. It's not really necessary since you usually upgrade nodes one by one, in case the upgrade fails on one node all the information is still available. But it can be comforting having the backup. Regards, Eugen [1] https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/N2RPRULADF3M... Zitat von Sam Skipsey <aoanla@gmail.com>:
Hello all,
We've had a Nautilus [latest releases] cluster for some years now, and are planning the upgrade process - both moving off Centos7 [ideally to a RHEL9 compatible spin like Alma 9 or Rocky 9] and also moving to a newer Ceph release [ideally Pacific or higher to avoid too many later upgrades needed].
As far as ceph release upgrades go, I understand the process in general.
What I'm less certain about (and more nervous about from a potential data loss perspective) is the OS upgrade. For Ceph bluestore OSDs, I assume all the relevant metadata is on the OSD disk [or on the separate disk configured for RocksDB etc if you have nvme], and none is on the OS itself? For Mons and Mgrs, what stuff do I need to retain across the OS upgrade to have things "just work" [since they're relatively stateless, I assume mostly the /etc/ceph/ stuff and ceph cluster keys?] For the MDS, I assume it's similar to MGRS? The MDS, IIRC, mainly works as a caching layer so I assume there's not much state that can be lost permanently?
Has anyone gone through this process who would be happy to share their experience? (There's not a lot on this on the wider internet - lots on upgrading ceph, much less on the OS)
Sam _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io