Hi Samuel, I resent my reply since CC will not be accepted by this mailing list. I'm using Octopus. If it is the release problem, why it is successful with only ms_async_rdma_device_name and ms_async_rdma_gid_idx? Best regards. On Sat, Sep 19, 2020 at 3:33 PM huxiaoyu@horebdata.cn <huxiaoyu@horebdata.cn> wrote:
Which Ceph version are you using? Just wondering Ceph RDMA support is officially announced, or still on development?
best regards,
samuel
------------------------------ huxiaoyu@horebdata.cn
*From:* Lazuardi Nasution <mrxlazuardin@gmail.com> *Date:* 2020-09-18 19:21 *To:* ceph-users <ceph-users@ceph.io> *Subject:* [ceph-users] Ceph RDMA GID Selection Problem Hi,
I have something weird about GID selection for Ceph with RDMA. When I do configuration with ms_async_rdma_device_name and ms_async_rdma_gid_idx, Ceph with RDMA running successfully. But, when I do configuration with ms_async_rdma_device_name, ms_async_rdma_local_gid and ms_async_rdma_roce_ver, Ceph with RDMA is not working, OSDs are down in seconds after they up. The GID index which is used on the first attempt is associated with the GID and RoCE version which are used on the second attempt. Is this the string matter (maybe because GID is using colon characters) or something else? Using the GID index sometimes gives me problems due to it not persisting and changes happen every time I do network reconfiguration (for example: adding/removing VLAN), or even rebooting.
Best regards,