Hi All, I am trying to upgrade ceph 15.2.1 to 15.2.3. I've two node setup on small environment for test only. I ran the following commands: $ ceph mon ok-to-stop mon.vx-rg23-rk65-u43-130

...

 quorum should be preserved (vx-rg23-rk65-u43-130,vx-rg23-rk65-u43-130-1) after stopping [mon.vx-rg23-rk65-u43-130]

$ ceph orch upgrade start --ceph-version 15.2.3 However, Ceph says it is NOT safe to stop mon.vx-rg23-rk65-u43-130. Debug log: 2020-06-01T22:09:21.967310+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [INF] Upgrade: Checking mon daemons... 2020-06-01T22:09:21.967426+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] daemon mon.vx-rg23-rk65-u43-130 not correct (docker.io/ceph/ceph:v15, bc83a388465f0568dab4501fb7684398dca8b50ca12a342a57f21815721723c2, 15.2.1) 2020-06-01T22:09:21.967563+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] Have connection to vx-rg23-rk65-u43-130 2020-06-01T22:09:21.967668+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] None container image docker.io/ceph/ceph:v15.2.3 2020-06-01T22:09:21.967778+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] args: --image docker.io/ceph/ceph:v15.2.3 inspect-image 2020-06-01T22:09:23.400842+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] code: 0 2020-06-01T22:09:23.401062+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] out: {     "ceph_version": "ceph version 15.2.3 (d289bbdec69ed7c1f516e0a093594580a76b78d0) octopus (stable)",     "image_id": "d72755c420bcbdae08d063de6035d060ea0487f8a43f777c75bdbfcd9fd907fa" } 2020-06-01T22:09:23.404700+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] mon_command: 'mon ok-to-stop' -> -16 in 0.002s 2020-06-01T22:09:23.405002+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [INF] Upgrade: It is NOT safe to stop mon.vx-rg23-rk65-u43-130 2020-06-01T22:09:38.416475+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] mon_command: 'mon ok-to-stop' -> -16 in 0.003s 2020-06-01T22:09:38.417296+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [INF] Upgrade: It is NOT safe to stop mon.vx-rg23-rk65-u43-130 2020-06-01T22:09:53.421473+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] mon_command: 'mon ok-to-stop' -> -16 in 0.003s 2020-06-01T22:09:53.422350+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [INF] Upgrade: It is NOT safe to stop mon.vx-rg23-rk65-u43-130 2020-06-01T22:10:08.440422+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [DBG] mon_command: 'mon ok-to-stop' -> -16 in 0.003s 2020-06-01T22:10:08.441122+0000 mgr.vx-rg23-rk65-u43-130-1.pxmyie [INF] Upgrade: It is NOT safe to stop mon.vx-rg23-rk65-u43-130 How can I solve this and upgrade? Thanks, Gencer.