Hi All, Just successfully(?) completed a "live" update of the first node of a Ceph Quincy cluster from RL8 to RL9. Everything "seems" to be working - EXCEPT the iSCSI Gateway on that box. During the update the ceph-iscsi package was removed (ie `ceph-iscsi-3.6-2.g97f5b02.el8.noarch.rpm` - this is the latest package available from the Ceph Repos). So, obviously, I reinstalled the package. However, `dnf` is throwing errors (unsurprisingly, as that package is an el8 package and this box is now running el9): that package requires python 3.6 and el9 runs with python 3.8 (I believe). So my question(s) is: Can I simply "downgrade" python to 3.6, or is there an el9-compatible version of `ceph-iscsi` somewhere, and/or is there some process I need to follow to get the iSCSI Gateway back up and running? Some further info: The next step in my "happy-happy-fun-time-holiday-ICT-maintenance" was to upgrade the current Ceph Cluster to use `cephadm` and to go from Ceph-Quincy to Ceph-Reef - is this my ultimate upgrade path to get the iSCSI G/W back? BTW the Ceph Cluster is used *only* to provide iSCSI LUNS to an oVirt (KVM) Cluster front-end. Because it is the holidays I can take the entire network down (ie shutdown all the VMs) to facilitate this update process, which also means that I can use some other way (ie a non-iSCSI way - I think) to connect the Ceph SAN Cluster to the oVirt VM-Hosting Cluster - if *this* is the solution (ie no iSCSI) does someone have any experience in running oVirt off of Ceph in a non-iSCSI way - and could you be so kind as to provide some pointers/documentation/help? And before anyone says it, let me: "I broke, now I own it" :-) Thanks in advance, and everyone have a Merry Christmas, Heavenly Hanukkah, Quality Kwanzaa, Really-good (upcoming) Ramadan, and/or a Happy Holidays. Cheers Dulux-Oz
Hi All, A follow up: So, I've got all the Ceph Nodes running Reef v18.2.1 on RL9.3, and everything is working - YAH! Except... The Ceph Dashboard shows 0 of 3 iSCSI Gateways working, and when I click on that panel it returns a "Page not Found" message - so I *assume* those are the three "original" iSCSI Gateways I had set up under Quincy/RL8. How do I get rid of them? I think I've removed all references to them (ie tcmu-runner, rbd-target-api, rbd-target-gw) but obviously, something has been missed - could someone please point me in the correct direction to finish "cleaning them up" - thanks. I've also created (via the Web GUI) three new iSCSI Services, which the GUI says are running. `ceph -s`, however, doesn't show them at all - is this normal? Also, it is not clear (to me) from the Reef doco if there is anything else that needs to be done to get iSCSI up and running (on the server side - obviously I need to create/update the initiators on the client side). Under the "old manual" way of doing it (ie https://docs.ceph.com/en/reef/rbd/iscsi-target-cli/) there was "extra stuff to do" - does that not apply any more? And finally, during my investigations I discovered a systemd service for osd.21 loaded but failed - there is no osd.21, so I must have made a typo somewhere in the past (there are only 21 osds in the cluster, so the last one is osd.20). The trouble is I can't seem to find *where* this is defined (ie non of the typical commands, etc (eg `ceph osd destroy osd.21`) csn seem to find it and/or get rid of it) - could someone please help me out with this as well - thanks. Anything else anyone want to know please ask Cheers Dulux-oz
Hi, I'm not sure for how long your iscsi gateways will work as it has been deprecated [1]:
The iSCSI gateway is in maintenance as of November 2022. This means that it is no longer in active development and will not be updated to add new features.
Some more information were provided in [2]. To remove an iscsi-gateway you could check the current list: $ ceph dashboard iscsi-gateway-list {"gateways": {"test-gateway.my.domain": {"service_url": "http://{USER}:{PASSWORD}@{IP_ADDRESS}:5000"}}} and then remove them if you can confirm that those are the old ones: $ ceph dashboard iscsi-gateway-rm test-gateway.my.domain Success Regards, Eugen [1] https://docs.ceph.com/en/quincy/rbd/iscsi-overview/#ceph-iscsi [2] https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/GDJJL7VSDUJ... Zitat von duluxoz <duluxoz@gmail.com>:
Hi All,
A follow up: So, I've got all the Ceph Nodes running Reef v18.2.1 on RL9.3, and everything is working - YAH!
Except...
The Ceph Dashboard shows 0 of 3 iSCSI Gateways working, and when I click on that panel it returns a "Page not Found" message - so I *assume* those are the three "original" iSCSI Gateways I had set up under Quincy/RL8.
How do I get rid of them? I think I've removed all references to them (ie tcmu-runner, rbd-target-api, rbd-target-gw) but obviously, something has been missed - could someone please point me in the correct direction to finish "cleaning them up" - thanks.
I've also created (via the Web GUI) three new iSCSI Services, which the GUI says are running. `ceph -s`, however, doesn't show them at all - is this normal?
Also, it is not clear (to me) from the Reef doco if there is anything else that needs to be done to get iSCSI up and running (on the server side - obviously I need to create/update the initiators on the client side). Under the "old manual" way of doing it (ie https://docs.ceph.com/en/reef/rbd/iscsi-target-cli/) there was "extra stuff to do" - does that not apply any more?
And finally, during my investigations I discovered a systemd service for osd.21 loaded but failed - there is no osd.21, so I must have made a typo somewhere in the past (there are only 21 osds in the cluster, so the last one is osd.20). The trouble is I can't seem to find *where* this is defined (ie non of the typical commands, etc (eg `ceph osd destroy osd.21`) csn seem to find it and/or get rid of it) - could someone please help me out with this as well - thanks.
Anything else anyone want to know please ask
Cheers
Dulux-oz _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (2)
-
duluxoz
-
Eugen Block