14 Apr
2020
14 Apr
'20
8 a.m.
My cluster on 15.2.1 versions.
I use ceph-volume raw to add new osd but it has error :
ceph-volume raw prepare --bluestore --data /dev/vdb
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring
/var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new
b3b79678-c40d-4a84-9c47-84c4d7234407
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0
Running command: /usr/bin/chown -R ceph:ceph /dev/vdb
Running command: /usr/bin/ln -s /dev/vdb /var/lib/ceph/osd/ceph-0/block
Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring
/var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o
/var/lib/ceph/osd/ceph-0/activate.monmap
stderr: 2020-04-14T09:36:40.234+0700 7ff302248700 -1 auth: unable to find a keyring on
/etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bi
n,: (2) No such file or directory
2020-04-14T09:36:40.234+0700 7ff302248700 -1 AuthRegistry(0x7ff2fc058388) no keyring found
at
/etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyr
ing.bin,, disabling cephx
stderr: got monmap epoch 1
Running command: /usr/bin/ceph-authtool /var/lib/ceph/osd/ceph-0/keyring --create-keyring
--name osd.0 --add-key AQC3IZVe+ZSrChAAhGUXJ5Nkg8K6UB9tiNaFxQ==
stdout: creating /var/lib/ceph/osd/ceph-0/keyring
added entity osd.0 auth(key=AQC3IZVe+ZSrChAAhGUXJ5Nkg8K6UB9tiNaFxQ==)
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/keyring
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/
Running command: /usr/bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 0
--monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --osd-data
/var/lib/ceph/osd/ceph-0/ --os
d-uuid b3b79678-c40d-4a84-9c47-84c4d7234407 --setuser ceph --setgroup ceph
stderr: 2020-04-14T09:36:40.742+0700 7f83483c4bc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/)
_read_fsid unparsable uuid
stderr: 2020-04-14T09:36:40.742+0700 7f83483c4bc0 -1 bdev(0x556ebee86c00
/var/lib/ceph/osd/ceph-0//block) _lock flock failed on /var/lib/ceph/osd/ceph-0//block
stderr: 2020-04-14T09:36:40.742+0700 7f83483c4bc0 -1 bdev(0x556ebee86c00
/var/lib/ceph/osd/ceph-0//block) open failed to lock /var/lib/ceph/osd/ceph-0//block: (11)
Resource temporarily unavail
able
stderr: 2020-04-14T09:36:40.743+0700 7f83483c4bc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/)
mkfs failed, (11) Resource temporarily unavailable
stderr: 2020-04-14T09:36:40.743+0700 7f83483c4bc0 -1 OSD::mkfs: ObjectStore::mkfs failed
with error (11) Resource temporarily unavailable
stderr: 2020-04-14T09:36:40.744+0700 7f83483c4bc0 -1 ** ERROR: error creating empty
object store in /var/lib/ceph/osd/ceph-0/: (11) Resource temporarily unavailable
--> Was unable to complete a new OSD, will rollback changes
Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring
/var/lib/ceph/bootstrap-osd/ceph.keyring osd purge-new osd.0 --yes-i-really-mean-it
stderr: 2020-04-14T09:36:40.959+0700 7f0b569c3700 -1 auth: unable to find a keyring on
/etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bi
n,: (2) No such file or directory
2020-04-14T09:36:40.959+0700 7f0b569c3700 -1 AuthRegistry(0x7f0b50058388) no keyring found
at
/etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyr
ing.bin,, disabling cephx
stderr: purged osd.0
--> RuntimeError: Command failed with exit code 250: /usr/bin/ceph-osd --cluster ceph
--osd-objectstore bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap
--keyfile - --os
d-data /var/lib/ceph/osd/ceph-0/ --osd-uuid b3b79678-c40d-4a84-9c47-84c4d7234407 --setuser
ceph --setgroup ceph
After that i create new parition of /dev/vdb it create osd successfully.
then
ceph-volume raw activate --device /dev/sdb1
--> systemd support not yet implemented