On Fri, Sep 4, 2020 at 11:54 AM <DHilsbos@performair.com> wrote:
All;
We've used iSCSI to support virtualization for a while, and have used multi-pathing almost the entire time. Now, I'm looking to move from our single box iSCSI hosts to iSCSI on Ceph.
We have 2 independent, non-routed, subnets assigned to iSCSI (let's call them 192.168.250.0/24 and 192.168.251.0/24). These subnets are hosted in VLANs 250 and 251, respectively, on our switches. Currently; each target and each initiator have a dedicated network port for each subnet (i.e. 2 NIC per target & 2 NIC per initiator).
I have 2 server prepared to setup as Ceph iSCSI targets (let's call them ceph-iscsi1 & cpeh-iscsi2), and I'm wondering about their network configurations. My initial plan is to configure one on the 250 network, and the other on the 251 network.
Would it be possible to have both servers on both networks? In other words, can I give ceph-iscsi1 both 192.168.250.200 and 192.168.251.200, and ceph-iscsi2 192.168.250.201 and 192.168.251.201?
When defining the gateways via gwcli or the dashboard, you should be able to specify a comma-separated list of portal IP addresses.
If that works, I would expect the initiators to see 4 paths to each portal, correct?
Correct: $ gwcli /iscsi-target...ample:target1> ls o- iqn.2020-01.com.example:target1 ....................................................................... [Auth: None, Gateways: 2] o- disks .............................................................................................................. [Disks: 1] | o- rbd/image1 ..................................................................................... [Owner: ceph-iscsi0, Lun: 0] o- gateways ................................................................................................ [Up: 2/2, Portals: 2] | o- ceph-iscsi0 ............................................................................ [192.168.42.30,192.168.121.192 (UP)] | o- ceph-iscsi1 ............................................................................. [192.168.121.23,192.168.42.31 (UP)] o- host-groups ...................................................................................................... [Groups : 0] o- hosts ........................................................................................... [Auth: ACL_ENABLED, Hosts: 1] o- iqn.2020-01.com.example:client1 .................................................................. [Auth: CHAP, Disks: 1(1G)] o- lun 0 ................................................................................ [rbd/image1(1G), Owner: ceph-iscsi0] $ iscsiadm -m discovery -t st -p 192.168.42.30 192.168.42.30:3260,1 iqn.2020-01.com.example:target1 192.168.121.192:3260,1 iqn.2020-01.com.example:target1 192.168.121.23:3260,2 iqn.2020-01.com.example:target1 192.168.42.31:3260,2 iqn.2020-01.com.example:target1 $ iscsiadm -m node -T iqn.2020-01.com.example:target1 -l Logging in to [iface: default, target: iqn.2020-01.com.example:target1, portal: 192.168.42.30,3260] Logging in to [iface: default, target: iqn.2020-01.com.example:target1, portal: 192.168.121.192,3260] Logging in to [iface: default, target: iqn.2020-01.com.example:target1, portal: 192.168.121.23,3260] Logging in to [iface: default, target: iqn.2020-01.com.example:target1, portal: 192.168.42.31,3260] Login to [iface: default, target: iqn.2020-01.com.example:target1, portal: 192.168.42.30,3260] successful. Login to [iface: default, target: iqn.2020-01.com.example:target1, portal: 192.168.121.192,3260] successful. Login to [iface: default, target: iqn.2020-01.com.example:target1, portal: 192.168.121.23,3260] successful. Login to [iface: default, target: iqn.2020-01.com.example:target1, portal: 192.168.42.31,3260] successful. $ multipath -ll Sep 04 17:37:02 | device config in /etc/multipath.conf missing vendor or product parameter mpatha (36001405974841ad4e2746f5bdd96c743) dm-0 LIO-ORG,TCMU device size=1.0G features='0' hwhandler='1 alua' wp=rw |-+- policy='service-time 0' prio=50 status=active | `- 2:0:0:0 sdc 8:32 active ready running |-+- policy='service-time 0' prio=50 status=enabled | `- 3:0:0:0 sda 8:0 active ready running |-+- policy='service-time 0' prio=10 status=enabled | `- 5:0:0:0 sdd 8:48 active ready running `-+- policy='service-time 0' prio=10 status=enabled `- 4:0:0:0 sdb 8:16 active ready running
Thank you,
Dominic L. Hilsbos, MBA Director - Information Technology Perform Air International Inc. DHilsbos@PerformAir.com www.PerformAir.com
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Jason