Hi, according to a discussion on Slack this is being worked on [0]. It seems to have worked on 19.2.2 (I don't use Rocky), so maybe you could bootstrap with 19.2.2 and wait for 19.2.4 to be released, or you wait for Tentacle and see if it works there. Regards, Eugen [0] https://github.com/ceph/ceph/pull/64780 Zitat von wodel youchi <wodel.youchi@gmail.com>:
Hi,
I am having issues trying to deploy ceph 19.2.3 on rocky linux 9.
1 - I cannot install ceph-common : it needs openssl 3.4, rocky 9 offers only openssl 3.2 2 - I bootstraped my cluster like this :
cephadm bootstrap \ --mon-ip 10.200.15.10 \ --cluster-network 10.210.0.0/16 \ --initial-dashboard-user admin \ --initial-dashboard-password 'admin' \ --ssh-private-key /root/.ssh/id_rsa \ --ssh-public-key /root/.ssh/id_rsa.pub
it did bootstrap, but when I try adding other hosts, I cannot, it has something to do with ssh.
I did copy id.rsa.pub on the other nodes via ssh-copy-id, and I can ssh without password to them. but I cannot ssh to them via cephadm shell.
and when i try to add a host I get :
Aug 11 15:29:06 hyper01 ceph-mgr[35633]: [cephadm ERROR cephadm.ssh] Traceback (most recent call last): File "/lib/python3.9/site-packages/asyncssh/connection.py", line 440, in _connect await options.waiter asyncio.exceptions.CancelledError
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/lib64/python3.9/asyncio/tasks.py", line 490, in wait_for return fut.result() asyncio.exceptions.CancelledError
The above exception was the direct cause of the following exception:
Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 197, in redirect_log yield File "/usr/share/ceph/mgr/cephadm/ssh.py", line 174, in _remote_connection conn = await asyncssh.connect(addr, username=self.mgr.ssh_user, client_keys=[ self.mgr.tkey.name], File "/lib/python3.9/site-packages/asyncssh/connection.py", line 8170, in connect return await asyncio.wait_for( File "/lib64/python3.9/asyncio/tasks.py", line 492, in wait_for raise exceptions.TimeoutError() from exc asyncio.exceptions.TimeoutError Aug 11 15:29:06 hyper01 ceph-mgr[35633]: log_channel(cephadm) log [ERR] : Traceback (most recent call last): File "/lib/python3.9/site-packages/asyncssh/connection.py", line 440, in _connect await options.waiter asyncio.exceptions.CancelledError
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/lib64/python3.9/asyncio/tasks.py", line 490, in wait_for return fut.result() asyncio.exceptions.CancelledError
The above exception was the direct cause of the following exception:
Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 197, in redirect_log yield File "/usr/share/ceph/mgr/cephadm/ssh.py", line 174, in _remote_connection conn = await asyncssh.connect(addr, username=self.mgr.ssh_user, client_keys=[ self.mgr.tkey.name], File "/lib/python3.9/site-packages/asyncssh/connection.py", line 8170, in connect return await asyncio.wait_for( File "/lib64/python3.9/asyncio/tasks.py", line 492, in wait_for raise exceptions.TimeoutError() from exc asyncio.exceptions.TimeoutError Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: 2025-08-11T14:29:06.509+0000 7f27b44ed640 -1 log_channel(cephadm) log [ERR] : Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: Traceback (most recent call last): Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: File "/lib/python3.9/site-packages/asyncssh/connection.py", line 440, in _connect Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: await options.waiter Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: asyncio.exceptions.CancelledError Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: During handling of the above exception, another exception occurred: Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: Traceback (most recent call last): Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: File "/lib64/python3.9/asyncio/tasks.py", line 490, in wait_for Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: return fut.result() Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: asyncio.exceptions.CancelledError Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: The above exception was the direct cause of the following exception: Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: Traceback (most recent call last): Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 197, in redirect_log Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: yield Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 174, in _remote_connection Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: conn = await asyncssh.connect(addr, username=self.mgr.ssh_user, client_keys=[self.mgr.tkey.name], Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: File "/lib/python3.9/site-packages/asyncssh/connection.py", line 8170, in connect Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: return await asyncio.wait_for( Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: File "/lib64/python3.9/asyncio/tasks.py", line 492, in wait_for Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: raise exceptions.TimeoutError() from exc Aug 11 15:29:06 hyper01 ceph-42cab8b0-76bc-11f0-b9ed-7cc255beecde-mgr-hyper01-rzwgry[35624]: asyncio.exceptions.TimeoutError Aug 11 15:29:06 hyper01 ceph-mgr[35633]: [cephadm ERROR orchestrator._interface] Failed to connect to hyper02 (10.200.15.11): TimeoutError() Log: Opening SSH connection to 10.200.15.11, port 22 [conn=7] Connected to SSH server at 10.200.15.11, port 22 [conn=7] Local address: 10.200.15.10, port 53326 [conn=7] Peer address: 10.200.15.11, port 22 [conn=6, chan=10] Requesting new SSH session [conn=6, chan=10] Command: which python3 [conn=6, chan=10] Received exit status 0 [conn=6, chan=10] Received channel close [conn=6, chan=10] Channel closed [conn=6, chan=11] Requesting new SSH session [conn=6, chan=11] Command: /usr/bin/python3 /var/lib/ceph/42cab8b0-76bc-11f0-b9ed-7cc255beecde/cephadm.1a8853661a9c1798390b8e8d13c27688c1b1327a075745af2ee40ac466f0ac36 --timeout 895 gather-facts [conn=6, chan=11] Received exit status 0 [conn=6, chan=11] Received channel close [conn=6, chan=11] Channel closed [conn=6, chan=12] Requesting new SSH session [conn=6, chan=12] Command: ls /etc/sysctl.d [conn=6, chan=12] Received exit status 0 [conn=6, chan=12] Received channel close [conn=6, chan=12] Channel closed [conn=7] Aborting connection [conn=7] Connection closed Traceback (most recent call last): File "/lib/python3.9/site-packages/asyncssh/connection.py", line 440, in _connect await options.waiter asyncio.exceptions.CancelledError
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/lib64/python3.9/asyncio/tasks.py", line 490, in wait_for return fut.result() asyncio.exceptions.CancelledError
The above exception was the direct cause of the following exception:
Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 197, in redirect_log yield File "/usr/share/ceph/mgr/cephadm/ssh.py", line 174, in _remote_connection conn = await asyncssh.connect(addr, username=self.mgr.ssh_user, client_keys=[ self.mgr.tkey.name], File "/lib/python3.9/site-packages/asyncssh/connection.py", line 8170, in connect return await asyncio.wait_for( File "/lib64/python3.9/asyncio/tasks.py", line 492, in wait_for raise exceptions.TimeoutError() from exc asyncio.exceptions.TimeoutError
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/module.py", line 1775, in _check_valid_addr out, err, code = self.wait_async(CephadmServe(self)._run_cephadm( File "/usr/share/ceph/mgr/cephadm/module.py", line 815, in wait_async return self.event_loop.get_result(coro, timeout) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result return future.result(timeout) File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result return self.__get_result() File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result raise self._exception File "/usr/share/ceph/mgr/cephadm/serve.py", line 1595, in _run_cephadm await self.mgr.ssh._remote_connection(host, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 182, in _remote_connection raise File "/lib64/python3.9/contextlib.py", line 137, in __exit__ self.gen.throw(typ, value, traceback) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 214, in redirect_log raise HostConnectionError( cephadm.ssh.HostConnectionError: Failed to connect to hyper02 (10.200.15.11): TimeoutError() Log: Opening SSH connection to 10.200.15.11, port 22 [conn=7] Connected to SSH server at 10.200.15.11, port 22 [conn=7] Local address: 10.200.15.10, port 53326 [conn=7] Peer address: 10.200.15.11, port 22 [conn=6, chan=10] Requesting new SSH session [conn=6, chan=10] Command: which python3 [conn=6, chan=10] Received exit status 0 [conn=6, chan=10] Received channel close [conn=6, chan=10] Channel closed [conn=6, chan=11] Requesting new SSH session [conn=6, chan=11] Command: /usr/bin/python3 /var/lib/ceph/42cab8b0-76bc-11f0-b9ed-7cc255beecde/cephadm.1a8853661a9c1798390b8e8d13c27688c1b1327a075745af2ee40ac466f0ac36 --timeout 895 gather-facts [conn=6, chan=11] Received exit status 0 [conn=6, chan=11] Received channel close [conn=6, chan=11] Channel closed [conn=6, chan=12] Requesting new SSH session [conn=6, chan=12] Command: ls /etc/sysctl.d [conn=6, chan=12] Received exit status 0 [conn=6, chan=12] Received channel close [conn=6, chan=12] Channel closed [conn=7] Aborting connection [conn=7] Connection closed
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 138, in wrapper return OrchResult(f(*args, **kwargs)) File "/usr/share/ceph/mgr/cephadm/module.py", line 3502, in apply
results.append(self._apply(spec)) File "/usr/share/ceph/mgr/cephadm/module.py", line 3251, in _apply return self._add_host(cast(HostSpec, spec)) File "/usr/share/ceph/mgr/cephadm/module.py", line 1800, in _add_host ip_addr = self._check_valid_addr(spec.hostname, spec.addr) File "/usr/share/ceph/mgr/cephadm/module.py", line 1789, in _check_valid_addr raise OrchestratorError(str(e))
orchestrator._interface.OrchestratorError: Failed to connect to hyper02 (10.200.15.11): TimeoutError() Log: Opening SSH connection to 10.200.15.11, port 22 [conn=7] Connected to SSH server at 10.200.15.11, port 22 [conn=7] Local address: 10.200.15.10, port 53326 [conn=7] Peer address: 10.200.15.11, port 22 [conn=6, chan=10] Requesting new SSH session [conn=6, chan=10] Command: which python3 [conn=6, chan=10] Received exit status 0 [conn=6, chan=10] Received channel close [conn=6, chan=10] Channel closed [conn=6, chan=11] Requesting new SSH session [conn=6, chan=11] Command: /usr/bin/python3 /var/lib/ceph/42cab8b0-76bc-11f0-b9ed-7cc255beecde/cephadm.1a8853661a9c1798390b8e8d13c27688c1b1327a075745af2ee40ac466f0ac36 --timeout 895 gather-facts [conn=6, chan=11] Received exit status 0 [conn=6, chan=11] Received channel close [conn=6, chan=11] Channel closed [conn=6, chan=12] Requesting new SSH session [conn=6, chan=12] Command: ls /etc/sysctl.d [conn=6, chan=12] Received exit status 0 [conn=6, chan=12] Received channel close [conn=6, chan=12] Channel closed [conn=7] Aborting connection [conn=7] Connection closed Aug 11 15:29:06 hyper01 ceph-mgr[35633]: log_channel(cephadm) log [ERR] : Failed to connect to hyper02 (10.200.15.11): TimeoutError() Log: Opening SSH connection to 10.200.15.11, port 22 [conn=7] Connected to SSH server at 10.200.15.11, port 22 [conn=7] Local address: 10.200.15.10, port 53326 [conn=7] Peer address: 10.200.15.11, port 22 [conn=6, chan=10] Requesting new SSH session [conn=6, chan=10] Command: which python3 [conn=6, chan=10] Received exit status 0 [conn=6, chan=10] Received channel close [conn=6, chan=10] Channel closed [conn=6, chan=11] Requesting new SSH session [conn=6, chan=11] Command: /usr/bin/python3 /var/lib/ceph/42cab8b0-76bc-11f0-b9ed-7cc255beecde/cephadm.1a8853661a9c1798390b8e8d13c27688c1b1327a075745af2ee40ac466f0ac36 --timeout 895 gather-facts [conn=6, chan=11] Received exit status 0 [conn=6, chan=11] Received channel close [conn=6, chan=11] Channel closed [conn=6, chan=12] Requesting new SSH session [conn=6, chan=12] Command: ls /etc/sysctl.d [conn=6, chan=12] Received exit status 0 [conn=6, chan=12] Received channel close [conn=6, chan=12] Channel closed [conn=7] Aborting connection [conn=7] Connection closed Traceback (most recent call last): File "/lib/python3.9/site-packages/asyncssh/connection.py", line 440, in _connect await options.waiter asyncio.exceptions.CancelledError
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/lib64/python3.9/asyncio/tasks.py", line 490, in wait_for return fut.result() asyncio.exceptions.CancelledError
The above exception was the direct cause of the following exception:
Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 197, in redirect_log yield File "/usr/share/ceph/mgr/cephadm/ssh.py", line 174, in _remote_connection conn = await asyncssh.connect(addr, username=self.mgr.ssh_user, client_keys=[ self.mgr.tkey.name], File "/lib/python3.9/site-packages/asyncssh/connection.py", line 8170, in connect return await asyncio.wait_for( File "/lib64/python3.9/asyncio/tasks.py", line 492, in wait_for raise exceptions.TimeoutError() from exc asyncio.exceptions.TimeoutError
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/module.py", line 1775, in _check_valid_addr out, err, code = self.wait_async(CephadmServe(self)._run_cephadm( File "/usr/share/ceph/mgr/cephadm/module.py", line 815, in wait_async return self.event_loop.get_result(coro, timeout) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result return future.result(timeout) File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result return self.__get_result() File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result raise self._exception File "/usr/share/ceph/mgr/cephadm/serve.py", line 1595, in _run_cephadm await self.mgr.ssh._remote_connection(host, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 182, in _remote_connection raise File "/lib64/python3.9/contextlib.py", line 137, in __exit__ self.gen.throw(typ, value, traceback) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 214, in redirect_log raise HostConnectionError( cephadm.ssh.HostConnectionError: Failed to connect to hyper02 (10.200.15.11): TimeoutError() Log: Opening SSH connection to 10.200.15.11, port 22 [conn=7] Connected to SSH server at 10.200.15.11, port 22 [conn=7] Local address: 10.200.15.10, port 53326 [conn=7] Peer address: 10.200.15.11, port 22 [conn=6, chan=10] Requesting new SSH session [conn=6, chan=10] Command: which python3 [conn=6, chan=10] Received exit status 0 [conn=6, chan=10] Received channel close [conn=6, chan=10] Channel closed [conn=6, chan=11] Requesting new SSH session [conn=6, chan=11] Command: /usr/bin/python3 /var/lib/ceph/42cab8b0-76bc-11f0-b9ed-7cc255beecde/cephadm.1a8853661a9c1798390b8e8d13c27688c1b1327a075745af2ee40ac466f0ac36 --timeout 895 gather-facts [conn=6, chan=11] Received exit status 0 [conn=6, chan=11] Received channel close [conn=6, chan=11] Channel closed [conn=6, chan=12] Requesting new SSH session [conn=6, chan=12] Command: ls /etc/sysctl.d [conn=6, chan=12] Received exit status 0 [conn=6, chan=12] Received channel close [conn=6, chan=12] Channel closed [conn=7] Aborting connection [conn=7] Connection closed
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 138, in wrapper return OrchResult(f(*args, **kwargs)) File "/usr/share/ceph/mgr/cephadm/module.py", line 3502, in apply
results.append(self._apply(spec)) File "/usr/share/ceph/mgr/cephadm/module.py", line 3251, in _apply return self._add_host(cast(HostSpec, spec)) File "/usr/share/ceph/mgr/cephadm/module.py", line 1800, in _add_host ip_addr = self._check_valid_addr(spec.hostname, spec.addr) File "/usr/share/ceph/mgr/cephadm/module.py", line 1789, in _check_valid_addr raise OrchestratorError(str(e))
orchestrator._interface.OrchestratorError: Failed to connect to hyper02 (10.200.15.11): TimeoutError() Log: Opening SSH connection to 10.200.15.11, port 22 [conn=7] Connected to SSH server at 10.200.15.11, port 22 [conn=7] Local address: 10.200.15.10, port 53326 [conn=7] Peer address: 10.200.15.11, port 22 [conn=6, chan=10] Requesting new SSH session [conn=6, chan=10] Command: which python3 [conn=6, chan=10] Received exit status 0 [conn=6, chan=10] Received channel close [conn=6, chan=10] Channel closed [conn=6, chan=11] Requesting new SSH session [conn=6, chan=11] Command: /usr/bin/python3 /var/lib/ceph/42cab8b0-76bc-11f0-b9ed-7cc255beecde/cephadm.1a8853661a9c1798390b8e8d13c27688c1b1327a075745af2ee40ac466f0ac36 --timeout 895 gather-facts [conn=6, chan=11] Received exit status 0 [conn=6, chan=11] Received channel close [conn=6, chan=11] Channel closed [conn=6, chan=12] Requesting new SSH session [conn=6, chan=12] Command: ls /etc/sysctl.d [conn=6, chan=12] Received exit status 0 [conn=6, chan=12] Received channel close [conn=6, chan=12] Channel closed [conn=7] Aborting connection [conn=7] Connection closed
Regards. _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io