Hello team, I have two clusters in testing environment deployed using ceph-ansible running on ubuntu 20.04 with ceph Pacific version . I am testing mirroring between two clusters , in pool mode . Our production Cluster is for backend storage for openstack. This is how I configured the rbdmirros.yml: ceph_rbd_mirror_configure: true ceph_rbd_mirror_mode: "pool" ceph_rbd_mirror_remote_cluster: "prod" ceph_rbd_mirror_remote_user: "admin" This is my primary cluster "/etc/ceph/ "directory: root@ceph-osd1:/etc/ceph# ls -l total 52 -r-------- 1 root root 151 Feb 13 08:47 bup.client.admin.keyring -rw-r--r-- 1 root root 866 Feb 13 08:45 bup.conf -r-------- 1 ceph ceph 151 Feb 12 13:35 ceph.client.admin.keyring -rw------- 1 ceph ceph 131 Feb 12 13:41 ceph.client.crash.keyring -rw-r--r-- 1 ceph ceph 863 Feb 12 13:35 ceph.conf -rw-rw-r-- 1 ceph ceph 1294 Feb 12 13:40 ceph-dashboard.crt -rw------- 1 ceph ceph 1704 Feb 12 13:40 ceph-dashboard.key -r-------- 1 ceph ceph 140 Feb 12 13:36 ceph.mgr.ceph-osd1.keyring -r-------- 1 ceph ceph 140 Feb 12 13:36 ceph.mgr.ceph-osd2.keyring -r-------- 1 ceph ceph 140 Feb 12 13:36 ceph.mgr.ceph-osd3.keyring -r-------- 1 root root 151 Feb 13 08:38 prod.client.admin.keyring -rw-r--r-- 1 root root 863 Feb 13 08:37 prod.conf -rw-r--r-- 1 root root 92 Aug 29 16:38 rbdmap and this is my secondary "/etc/ceph" directory: root@ceph-osdb1:/etc/ceph# ls -l total 60 -rw------- 1 root root 0 Feb 13 09:26 ansible.1e1q9lzv_ceph-ansible -rw------- 1 root root 0 Feb 13 09:32 ansible.dk1h4kzp_ceph-ansible -r-------- 1 root root 151 Feb 13 09:02 bup.client.admin.keyring -rw-r--r-- 1 root root 866 Feb 13 09:02 bup.conf -r-------- 1 ceph ceph 151 Feb 13 08:23 ceph.client.admin.keyring -rw------- 1 ceph ceph 131 Feb 13 08:29 ceph.client.crash.keyring -rw------- 1 ceph ceph 138 Feb 13 09:19 ceph.client.rbd-mirror.ceph-osdb1.keyring -rw------- 1 ceph ceph 132 Feb 13 09:19 ceph.client.rbd-mirror-peer.keyring -rw-r--r-- 1 ceph ceph 866 Feb 13 08:23 ceph.conf -rw-rw-r-- 1 ceph ceph 1302 Feb 13 08:28 ceph-dashboard.crt -rw------- 1 ceph ceph 1708 Feb 13 08:28 ceph-dashboard.key -r-------- 1 ceph ceph 141 Feb 13 08:24 ceph.mgr.ceph-osdb1.keyring -r-------- 1 ceph ceph 141 Feb 13 08:24 ceph.mgr.ceph-osdb2.keyring -r-------- 1 ceph ceph 141 Feb 13 08:24 ceph.mgr.ceph-osdb3.keyring -r-------- 1 root root 151 Feb 13 09:01 prod.client.admin.keyring -rw-r--r-- 1 root root 863 Feb 13 09:01 prod.conf -rw-r--r-- 1 root root 92 Aug 29 16:38 rbdmap Kindly I need your help if I missing something because while running I am facing the following error: TASK [ceph-rbd-mirror : create a temporary file] ************************************************************************************** Tuesday 13 February 2024 09:58:59 +0000 (0:00:00.349) 0:04:00.698 ****** changed: [ceph-osdb1 -> ceph-osdb1] TASK [ceph-rbd-mirror : write secret to temporary file] ******************************************************************************* Tuesday 13 February 2024 09:58:59 +0000 (0:00:00.533) 0:04:01.232 ****** fatal: [ceph-osdb1 -> {{ groups[mon_group_name][0] }}]: FAILED! => msg: |- The task includes an option with an undefined variable. The error was: 'ceph_rbd_mirror_remote_key' is undefined The error appears to be in '/opt/ceph-ansible/roles/ceph-rbd-mirror/tasks/configure_mirroring.yml': line 150, column 7, but may be elsewhere in the file depending on the exact syntax problem. The offending line appears to be: - name: write secret to temporary file ^ here Kindly help