Hi. I have the same situation. Running 15.2.8 I created a specification that looked just like it. With rotational in the data and non-rotational in the db. First use applied fine. Afterwards it only uses the hdd, and not the ssd. Also, is there a way to remove an unused osd service. I manages to create osd.all-available-devices, when I tried to stop the autocreation of OSD's. Using ceph orch apply osd --all-available-devices --unmanaged=true I created the original OSD using the web interface. Regards Jens -----Original Message----- From: Eugen Block <eblock@nde.ag> Sent: 3. februar 2021 11:40 To: Tony Liu <tonyliu0592@hotmail.com> Cc: ceph-users@ceph.io Subject: [ceph-users] Re: db_devices doesn't show up in exported osd service spec How do you manage the db_sizes of your SSDs? Is that managed automatically by ceph-volume? You could try to add another config and see what it does, maybe try to add block_db_size? Zitat von Tony Liu <tonyliu0592@hotmail.com>:
All mon, mgr, crash and osd are upgraded to 15.2.8. It actually fixed another issue (no device listed after adding host). But this issue remains. ``` # cat osd-spec.yaml service_type: osd service_id: osd-spec placement: host_pattern: ceph-osd-[1-3] data_devices: rotational: 1 db_devices: rotational: 0
# ceph orch apply osd -i osd-spec.yaml Scheduled osd.osd-spec update...
# ceph orch ls --service_name osd.osd-spec --export service_type: osd service_id: osd-spec service_name: osd.osd-spec placement: host_pattern: ceph-osd-[1-3] spec: data_devices: rotational: 1 filter_logic: AND objectstore: bluestore ``` db_devices still doesn't show up. Keep scratching my head...
Thanks! Tony
-----Original Message----- From: Eugen Block <eblock@nde.ag> Sent: Tuesday, February 2, 2021 2:20 AM To: ceph-users@ceph.io Subject: [ceph-users] Re: db_devices doesn't show up in exported osd service spec
Hi,
I would recommend to update (again), here's my output from a 15.2.8 test cluster:
host1:~ # ceph orch ls --service_name osd.default --export service_type: osd service_id: default service_name: osd.default placement: hosts: - host4 - host3 - host1 - host2 spec: block_db_size: 4G data_devices: rotational: 1 size: '20G:' db_devices: size: '10G:' filter_logic: AND objectstore: bluestore
Regards, Eugen
Zitat von Tony Liu <tonyliu0592@hotmail.com>:
Hi,
When build cluster Octopus 15.2.5 initially, here is the OSD service spec file applied. ``` service_type: osd service_id: osd-spec placement: host_pattern: ceph-osd-[1-3] data_devices: rotational: 1 db_devices: rotational: 0 ``` After applying it, all HDDs were added and DB of each hdd is created on SSD.
Here is the export of OSD service spec. ``` # ceph orch ls --service_name osd.osd-spec --export service_type: osd service_id: osd-spec service_name: osd.osd-spec placement: host_pattern: ceph-osd-[1-3] spec: data_devices: rotational: 1 filter_logic: AND objectstore: bluestore ``` Why db_devices doesn't show up there?
When I replace a disk recently, when the new disk was installed and zapped, OSD was automatically re-created, but DB was created on HDD, not SSD. I assume this is because of that missing db_devices?
I tried to update service spec, the same result, db_devices doesn't show up when export it.
Is this some known issue or something I am missing?
Thanks! Tony _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io