Hello ceph community, I'm trying to upgrade a pacific (v16.2.0) cluster to the last version, but the upgrading process seems to be stuck. The mgr log (debug level) does not show any significant message regarding the upgrade, other than when it is started/paused/resumed/stopped. 2021-05-06T14:29:59.294725+0000 mgr.hostc.riclju (mgr.3935983) 35645 : cephadm [INF] Upgrade: Started with target docker.io/ceph/ceph:v16.2.2 2021-05-06T14:49:55.710023+0000 mgr.hostc.riclju (mgr.3935983) 36285 : cephadm [INF] Paused 2021-05-06T14:50:24.444742+0000 mgr.hostc.riclju (mgr.3935983) 36302 : cephadm [INF] Resumed 2021-05-06T14:51:36.888269+0000 mgr.hostc.riclju (mgr.3935983) 36349 : cephadm [INF] Upgrade: Paused upgrade to docker.io/ceph/ceph:v16.2.2 2021-05-06T14:51:50.411779+0000 mgr.hostc.riclju (mgr.3935983) 36357 : cephadm [INF] Upgrade: Resumed upgrade to docker.io/ceph/ceph:v16.2.2 2021-05-06T14:52:01.660682+0000 mgr.hostc.riclju (mgr.3935983) 36365 : cephadm [INF] Upgrade: Stopped It may be worth mentioning that last week I had trouble trying to deploy RGWs. It was not possible to deploy de RGWs using this command ceph orch apply rgw orbyta --realm=realma --zone=zonea --placement="2" So the following were used ceph orch daemon add rgw zonea --placement hostb ceph orch daemon add rgw zonea --placement hosta After those commands were issued the orchestrator would still not deploy the RGWs, unless the current MGR failed over to another standby MGR. After that, the RGWs where depoyed. Another problem I have is the refresh parameter of the orchestrator. The last time the daemons listed in ceph orch ps where refreshed is the last time a MGR was set to failed, and issuing ceph orch ps --refresh does not seem to update It looks like all those symptoms are related somehow, but I don't know how to dig further into the internals of the orchestrator to get more information. I greatly appreciate if you can point me in the right direction. Thank you, kind regards. -- AltaVoz <https://www.altavoz.net/> Fernando Cid Ingeniero de Operaciones www.altavoz.net <https://www.altavoz.net/> Ubicación AltaVoz Viña del Mar: 2 Poniente 355 of 53 <https://www.altavoz.net/altavoz/contacto> | +56 32 276 8060 <tel:+56322768060> Santiago: Antonio Bellet 292 of 701 <https://www.altavoz.net/altavoz/contacto> | +56 2 2585 4264 <tel:+562225854264>