Hi, I just retried without the single-host option and it worked. Also everything under /tmp/var belongs to root in my case. Unfortunately, I can't use the curl-based cephadm but the contents are identical, I compared. Not sure what it could be at the moment. Zitat von Ben <ruidong.gao@gmail.com>:
Hi, It is uos v20(with kernel 4.19), one linux distribution among others. no matter since cephadm deploys things in containers by default. cephadm is pulled by curl from Quincy branch of github.
I think you could see some sort of errors if you remove parameter --single-host-defaults.
More investigation shows it looks like a bug with cephadm. during the deploying procedure ,/tmp/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/cephadm.059bfc99f5cf36ed881f2494b104711faf4cbf5fc86a9594423cc105cafd9b4e.new is created through sudo ssh session remotely(with owner of root) and /tmp/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/ is changed to owner of ssh user deployer. The correct thing to do instead is, /tmp/var/ be changed to the owner deployer recursively so that following scp can have access permission. I will see if having time to wire up a PR to fix it.
Thanks for help on this. Ben
Eugen Block <eblock@nde.ag> 于2023年5月8日周一 21:01写道:
Hi,
could you provide some more details about your host OS? Which cephadm version is it? I was able to bootstrap a one-node cluster with both 17.2.5 and 17.2.6 with a non-root user with no such error on openSUSE Leap 15.4:
quincy:~ # rpm -qa | grep cephadm cephadm-17.2.6.248+gad656d572cb-lp154.2.1.noarch
deployer@quincy:~> sudo cephadm --image quay.io/ceph/ceph:v17.2.5 bootstrap --mon-ip 172.17.2.3 --skip-monitoring-stack --ssh-user deployer --single-host-defaults Verifying ssh connectivity ... Adding key to deployer@localhost authorized_keys... Verifying podman|docker is present... Verifying lvm2 is present... Verifying time synchronization is in place... Unit chronyd.service is enabled and running Repeating the final host check... podman (/usr/bin/podman) version 4.4.4 is present [...] Ceph version: ceph version 17.2.5 (98318ae89f1a893a6ded3a640405cdbb33e08757) quincy (stable) Extracting ceph user uid/gid from container image... Creating initial keys... Creating initial monmap... Creating mon... Waiting for mon to start... Waiting for mon... mon is available [...] Adding key to deployer@localhost authorized_keys... Adding host quincy... Deploying mon service with default placement... Deploying mgr service with default placement... [...] Bootstrap complete.
Zitat von Ben <ruidong.gao@gmail.com>:
Hi,
with following command:
sudo cephadm --docker bootstrap --mon-ip 10.1.32.33 --skip-monitoring-stack --ssh-user deployer the user deployer has passwordless sudo configuration. I can see the error below:
debug 2023-05-04T12:46:43.268+0000 7fc5ddc2e700 0 [cephadm ERROR cephadm.ssh] Unable to write
szhyf-xx1d002-hx15w:/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/cephadm.059bfc99f5cf36ed881f2494b104711faf4cbf5fc86a9594423cc105cafd9b4e:
scp:
/tmp/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/cephadm.059bfc99f5cf36ed881f2494b104711faf4cbf5fc86a9594423cc105cafd9b4e.new:
Permission denied
Traceback (most recent call last):
File "/usr/share/ceph/mgr/cephadm/ssh.py", line 222, in _write_remote_file
await asyncssh.scp(f.name, (conn, tmp_path))
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 922, in scp
await source.run(srcpath)
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 458, in run
self.handle_error(exc)
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in handle_error
raise exc from None
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 456, in run
await self._send_files(path, b'')
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 438, in _send_files
self.handle_error(exc)
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in handle_error
raise exc from None
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 434, in _send_files
await self._send_file(srcpath, dstpath, attrs)
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 365, in _send_file
await self._make_cd_request(b'C', attrs, size, srcpath)
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 343, in _make_cd_request
self._fs.basename(path))
File "/lib/python3.6/site-packages/asyncssh/scp.py", line 224, in make_request
raise exc
Any ideas on this?
Thanks, Ben _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io