Could you share the output of lsblk -o name,rota,size,type from the affected osd node? My spec file is for a tiny lab cluster, in your case the db drive size should be something like '5T:6T' to specify a range. How large are the HDDs? Also maybe you should use the option 'filter_logic: AND', but I'm not sure if that's already the default, I remember that there were issues in Nautilus because the default was OR. I tried this just recently with a version similar to this, I believe it was 15.2.8 and it worked for me, but again, it's just a tiny virtual lab cluster. Zitat von Kai Stian Olstad <ceph+list@olstad.com>:
On 26.05.2021 11:16, Eugen Block wrote:
Yes, the LVs are not removed automatically, you need to free up the VG, there are a couple of ways to do so, for example remotely:
pacific1:~ # ceph orch device zap pacific4 /dev/vdb --force
or directly on the host with:
pacific1:~ # cephadm ceph-volume lvm zap --destroy /dev/<CEPH_VG>/<DB_LV>
Thanks,
I used the cephadm command and deleted the LV and the VG now has free space
# vgs | egrep "VG|dbs" VG #PV #LV #SN Attr VSize VFree ceph-block-dbs-563432b7-f52d-4cfe-b952-11542594843b 3 14 0 wz--n- <5.24t 357.74g
But it doesn't seams to be able to use it, because it can find anyting
# ceph orch apply osd -i hdd.yml --dry-run ################ OSDSPEC PREVIEWS ################ +---------+------+-------------+----------+----+-----+ |SERVICE |NAME |HOST |DATA |DB |WAL | +---------+------+-------------+----------+----+-----+ +---------+------+-------------+----------+----+-----+
I tried adding size as you have in your configuration db_devices: rotational: 0 size: '30G:'
Still it was unable to create the OSD.
If I removed the : so it is 30GB exact size, it did find the disk, but DB is not placed on a SSD since I do not have one with 30 GB exact size ################ OSDSPEC PREVIEWS ################ +---------+------+-------------+----------+----+-----+ |SERVICE |NAME |HOST |DATA |DB |WAL | +---------+------+-------------+----------+----+-----+ |osd |hdd |pech-hd-7 |/dev/sdt |- |- | +---------+------+-------------+----------+----+-----+
To me I looks like Cephadm can't use/find the free space on the VG and use that as a new LV for the OSD.
-- Kai Stian Olstad _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io