how to use the SSH orchestrator ?

I'm trying to get the SSH orchestrator running for testing the MDS Autoscaler <https://github.com/ceph/ceph/pull/32731>. I start the vstart cluster with: $ MDS=3 ../src/vstart.sh -d -b -l -n --without-dashboard --cephadm Processes seem to launch without errors until: ... /home/mchangir/work/mchangir-ceph.git/build/bin/ceph -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf -k /home/mchangir/work/mchangir-ceph.git/build/keyring fs volume create a Error EINVAL: Remote method threw exception: TypeError: %d format: a number is required, not NoneType Still digging at it. But no leads so far. Let me know where should I be looking for this one. The mgr plugin and related utilities python code looks okay to me. But I'm not 100% sure. ----- Will this failure get in my way for testing the MDS Autoscaler ? Also, `ceph status` shows the system in HEALTH_WARN state like so: $ ./bin/ceph status 2020-01-28T18:03:48.542+0530 7f4ddb872700 -1 WARNING: all dangerous and experimental features are enabled. 2020-01-28T18:03:48.558+0530 7f4dda610700 -1 WARNING: all dangerous and experimental features are enabled. cluster: id: e717ee71-d1e3-4be4-b771-1fface003e13 health: HEALTH_WARN 1 stray host(s) with 10 service(s) not managed by cephadm 10 stray service(s) not managed by cephadm services: mon: 3 daemons, quorum a,b,c (age 2h) mgr: x(active, since 2h) mds: a:1 {0=a=up:active} 2 up:standby osd: 3 osds: 3 up (since 2h), 3 in (since 2h) data: pools: 2 pools, 64 pgs objects: 22 objects, 2.2 KiB usage: 6.0 GiB used, 297 GiB / 303 GiB avail pgs: 64 active+clean ----- Also, Is this the correct way to remove an mds via the orchestrator: $ ./bin/ceph orchestrator mds rm c Error ENOENT: Unable to find mds.c[-*] daemon(s) but the daemons are indeed running: $ pgrep -a ceph- 1310763 /usr/libexec/platform-python -s /usr/bin/ceph-crash -n client.crash.localhost.localdomain 1624818 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-mon -i a -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf 1624861 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-mon -i b -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf 1624904 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-mon -i c -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf 1626022 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-osd -i 0 -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf 1626376 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-osd -i 1 -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf 1626707 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-osd -i 2 -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf 1626895 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-mds -i a -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf 1626950 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-mds -i b -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf 1627005 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-mds -i c -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf 1676260 /home/mchangir/work/mchangir-ceph.git/build/bin/ceph-mgr -i x -c /home/mchangir/work/mchangir-ceph.git/build/ceph.conf ----- Is the exception (in red) caused because of a missing placement spec ? Ideally I'd like to launch a standby MDS without any affinity to a filesystem or an OSD. Any help to get this correctly implemented/tested will be appreciated. -- Milind