1. Hi, 2. I've installed ceph mon and mgr as cluster on 3 nodes, 3. I have this errors on status and log of standby mgr: ubuntu 20.04 ceph version: 15.2.5 1. ● ceph-mgr@dev13.service - Ceph cluster manager daemon 2. Loaded: loaded (/lib/systemd/system/ceph-mgr@.service; enabled; vendor preset: enabled) 3. Active: active (running) since Sat 2020-11-14 14:00:57 +0330; 40min ago 4. Main PID: 13485 (ceph-mgr) 5. Tasks: 20 (limit: 9451) 6. Memory: 233.2M 7. CGroup: /system.slice/system-ceph\x2dmgr.slice/ceph-mgr@dev13.service 8. └─13485 /usr/bin/ceph-mgr -f --cluster ceph --id dev13 --setuser ceph --setgroup ceph 9. 10. Nov 14 14:01:03 dev13 ceph-mgr[13485]: File "/lib/python3/dist-packages/numpy/core/__init__.py", line 17, in <module> 11. Nov 14 14:01:03 dev13 ceph-mgr[13485]: from . import multiarray 12. Nov 14 14:01:03 dev13 ceph-mgr[13485]: File "/lib/python3/dist-packages/numpy/core/multiarray.py", line 14, in <module> 13. Nov 14 14:01:03 dev13 ceph-mgr[13485]: from . import overrides 14. Nov 14 14:01:03 dev13 ceph-mgr[13485]: File "/lib/python3/dist-packages/numpy/core/overrides.py", line 16, in <module> 15. Nov 14 14:01:03 dev13 ceph-mgr[13485]: add_docstring( 16. Nov 14 14:01:03 dev13 ceph-mgr[13485]: RuntimeError: implement_array_function method already has a docstring 17. Nov 14 14:01:03 dev13 ceph-mgr[13485]: 2020-11-14T14:01:03.034+0330 7eff2173b040 -1 mgr[py] Class not found in module 'rook' 18. Nov 14 14:01:03 dev13 ceph-mgr[13485]: 2020-11-14T14:01:03.034+0330 7eff2173b040 -1 mgr[py] Error loading module 'rook': (2) No such file or directory 19. Nov 14 14:01:04 dev13 ceph-mgr[13485]: 2020-11-14T14:01:04.478+0330 7eff2173b040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: rook 20. 21. test@dev12:/etc/ceph$ sudo journalctl -xe 22. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/usr/share/ceph/mgr/rook/module.py", line 17, in <module> 23. Nov 14 13:27:06 dev12 ceph-mgr[15041]: from kubernetes import client, config 24. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/kubernetes/__init__.py", line 22, in <module> 25. Nov 14 13:27:06 dev12 ceph-mgr[15041]: import kubernetes.stream 26. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/kubernetes/stream/__init__.py", line 15, in <module> 27. Nov 14 13:27:06 dev12 ceph-mgr[15041]: from .stream import stream 28. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/kubernetes/stream/stream.py", line 13, in <module> 29. Nov 14 13:27:06 dev12 ceph-mgr[15041]: from . import ws_client 30. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/kubernetes/stream/ws_client.py", line 19, in <module> 31. Nov 14 13:27:06 dev12 ceph-mgr[15041]: from websocket import WebSocket, ABNF, enableTrace 32. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/websocket/__init__.py", line 22, in <module> 33. Nov 14 13:27:06 dev12 ceph-mgr[15041]: from ._abnf import * 34. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/websocket/_abnf.py", line 34, in <module> 35. Nov 14 13:27:06 dev12 ceph-mgr[15041]: import numpy 36. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/numpy/__init__.py", line 142, in <module> 37. Nov 14 13:27:06 dev12 ceph-mgr[15041]: from . import core 38. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/numpy/core/__init__.py", line 17, in <module> 39. Nov 14 13:27:06 dev12 ceph-mgr[15041]: from . import multiarray 40. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/numpy/core/multiarray.py", line 14, in <module> 41. Nov 14 13:27:06 dev12 ceph-mgr[15041]: from . import overrides 42. Nov 14 13:27:06 dev12 ceph-mgr[15041]: File "/lib/python3/dist-packages/numpy/core/overrides.py", line 16, in <module> 43. Nov 14 13:27:06 dev12 ceph-mgr[15041]: add_docstring( 44. Nov 14 13:27:06 dev12 ceph-mgr[15041]: RuntimeError: implement_array_function method already has a docstring 45. Nov 14 13:27:06 dev12 ceph-mgr[15041]: 2020-11-14T13:27:06.159+0330 7fdeafd88040 -1 mgr[py] Class not found in module 'rook' 46. Nov 14 13:27:06 dev12 ceph-mgr[15041]: 2020-11-14T13:27:06.159+0330 7fdeafd88040 -1 mgr[py] Error loading module 'rook': (2) No such file or directory 47. Nov 14 13:27:07 dev12 ceph-mgr[15041]: 2020-11-14T13:27:07.547+0330 7fdeafd88040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: rook 48. 2020-11-14T13:27:06.431+0330 7fdeafd88040 1 mgr[py] Loading python module 'telegraf' 49. 2020-11-14T13:27:06.667+0330 7fdeafd88040 1 mgr[py] Loading python module 'telemetry' 50. 2020-11-14T13:27:06.987+0330 7fdeafd88040 1 mgr[py] Loading python module 'test_orchestrator' 51. 2020-11-14T13:27:07.187+0330 7fdeafd88040 1 mgr[py] Loading python module 'volumes' 52. 2020-11-14T13:27:07.459+0330 7fdeafd88040 1 mgr[py] Loading python module 'zabbix' 53. 2020-11-14T13:27:07.547+0330 7fdeafd88040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: rook 54. 2020-11-14T13:27:07.551+0330 7fdeaad22700 0 ms_deliver_dispatch: unhandled message 0x55dcf177e2c0 mon_map magic: 0 v1 from mon.2 v2:192.168.200.23:3300/0 55. 2020-11-14T13:27:07.555+0330 7fdeaad22700 0 ms_deliver_dispatch: unhandled message 0x55dcf177fa20 mon_map magic: 0 v1 from mon.2 v2:192.168.200.23:3300/0 56. 2020-11-14T13:42:07.558+0330 7fdeaad22700 0 client.0 ms_handle_reset on v2:192.168.200.21:6800/6434 57. 2020-11-14T13:57:07.569+0330 7fdeaad22700 0 client.0 ms_handle_reset on v2:192.168.200.21:6800/6434 58. 59.