4 Sep
2020
4 Sep
'20
6:39 p.m.
On Fri, Sep 4, 2020 at 11:54 AM <DHilsbos(a)performair.com> wrote:
All;
We've used iSCSI to support virtualization for a while, and have used multi-pathing
almost the entire time. Now, I'm looking to move from our single box iSCSI hosts to
iSCSI on Ceph.
We have 2 independent, non-routed, subnets assigned to iSCSI (let's call them
192.168.250.0/24 and 192.168.251.0/24). These subnets are hosted in VLANs 250 and 251,
respectively, on our switches. Currently; each target and each initiator have a dedicated
network port for each subnet (i.e. 2 NIC per target & 2 NIC per initiator).
I have 2 server prepared to setup as Ceph iSCSI targets (let's call them ceph-iscsi1
& cpeh-iscsi2), and I'm wondering about their network configurations. My initial
plan is to configure one on the 250 network, and the other on the 251 network.
Would it be possible to have both servers on both networks? In other words, can I give
ceph-iscsi1 both 192.168.250.200 and 192.168.251.200, and ceph-iscsi2 192.168.250.201 and
192.168.251.201?
When defining the gateways via gwcli or the dashboard, you should be
able to specify a comma-separated list of portal IP addresses.
If that works, I would expect the initiators to see 4
paths to each portal, correct?
Correct:
$ gwcli
/iscsi-target...ample:target1> ls
o- iqn.2020-01.com.example:target1
.......................................................................
[Auth: None, Gateways: 2]
o- disks
..............................................................................................................
[Disks: 1]
| o- rbd/image1
.....................................................................................
[Owner: ceph-iscsi0, Lun: 0]
o- gateways
................................................................................................
[Up: 2/2, Portals: 2]
| o- ceph-iscsi0
............................................................................
[192.168.42.30,192.168.121.192 (UP)]
| o- ceph-iscsi1
.............................................................................
[192.168.121.23,192.168.42.31 (UP)]
o- host-groups
......................................................................................................
[Groups : 0]
o- hosts
...........................................................................................
[Auth: ACL_ENABLED, Hosts: 1]
o- iqn.2020-01.com.example:client1
..................................................................
[Auth: CHAP, Disks: 1(1G)]
o- lun 0
................................................................................
[rbd/image1(1G), Owner: ceph-iscsi0]
$ iscsiadm -m discovery -t st -p 192.168.42.30
192.168.42.30:3260,1 iqn.2020-01.com.example:target1
192.168.121.192:3260,1 iqn.2020-01.com.example:target1
192.168.121.23:3260,2 iqn.2020-01.com.example:target1
192.168.42.31:3260,2 iqn.2020-01.com.example:target1
$ iscsiadm -m node -T iqn.2020-01.com.example:target1 -l
Logging in to [iface: default, target:
iqn.2020-01.com.example:target1, portal: 192.168.42.30,3260]
Logging in to [iface: default, target:
iqn.2020-01.com.example:target1, portal: 192.168.121.192,3260]
Logging in to [iface: default, target:
iqn.2020-01.com.example:target1, portal: 192.168.121.23,3260]
Logging in to [iface: default, target:
iqn.2020-01.com.example:target1, portal: 192.168.42.31,3260]
Login to [iface: default, target: iqn.2020-01.com.example:target1,
portal: 192.168.42.30,3260] successful.
Login to [iface: default, target: iqn.2020-01.com.example:target1,
portal: 192.168.121.192,3260] successful.
Login to [iface: default, target: iqn.2020-01.com.example:target1,
portal: 192.168.121.23,3260] successful.
Login to [iface: default, target: iqn.2020-01.com.example:target1,
portal: 192.168.42.31,3260] successful.
$ multipath -ll
Sep 04 17:37:02 | device config in /etc/multipath.conf missing vendor
or product parameter
mpatha (36001405974841ad4e2746f5bdd96c743) dm-0 LIO-ORG,TCMU device
size=1.0G features='0' hwhandler='1 alua' wp=rw
|-+- policy='service-time 0' prio=50 status=active
| `- 2:0:0:0 sdc 8:32 active ready running
|-+- policy='service-time 0' prio=50 status=enabled
| `- 3:0:0:0 sda 8:0 active ready running
|-+- policy='service-time 0' prio=10 status=enabled
| `- 5:0:0:0 sdd 8:48 active ready running
`-+- policy='service-time 0' prio=10 status=enabled
`- 4:0:0:0 sdb 8:16 active ready running
Thank you,
Dominic L. Hilsbos, MBA
Director - Information Technology
Perform Air International Inc.
DHilsbos(a)PerformAir.com
www.PerformAir.com
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
--
Jason