steps 2 to 4 are exactly my idea. In step 1 All I will check is all active (o non inactive or unknown). Clean is not necessary, I can boot VMs with degraded.as long they are active. El jue, 29 ago 2024 a las 8:03, Bogdan Adrian Velica (<vbogdan@gmail.com>) escribió:
Hi,
It's a hacky idea but create a script that checks if the Ceph RBD pool is fully "active+clean" to ensure it's ready before starting Proxmox VMs. Something like this...
1. Bash Script: - Write a script that checks if the Ceph RBD pool is in the "active+clean" state using ceph pg stat or ceph -s. - The script should run until the pool is ready before exiting. A loop or something...
2. Systemd Service for Ceph Readiness: - Create a systemd service unit file (something like: ceph-ready.service) that runs the script at startup. - Ensure the service waits until the Ceph cluster is ready before proceeding.
3. Systemd Service for Proxmox VMs: - Modify an existing Proxmox service or create a new one to depend on the ceph-ready.service. - Use After=ceph-ready.service in the unit file to ensure Proxmox VMs start only after Ceph is ready.
4. Enable and Start the Services: - Enable both systemd services to start at boot with systemctl enable. - Reboot to ensure that Proxmox waits for Ceph before starting VMs.
Just an idea...
Thank you, Bogdan Velica croit.io
On Thu, Aug 29, 2024 at 1:53 PM Alfredo Rezinovsky <alfrenovsky@gmail.com> wrote:
I have a proxmox cluster using an external CEPH cluster.
Sometimes due to blackouts the servers need to restart. If proxmox starts before CEPH is ready the VMs fail to boot.
I want to add a dependency in proxmox to wait for ceph to be ready.
I can work with a HEALTH_WARN as long the RBD pool is usable.
ceph status exit status doesn´t helps
Should I grep for "pgs not active" in ceph status or for "inactive" pgs in ceph health or is there something more direct to know if everything is alright?
-- Alfrenovsky _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Alfrenovsky