The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches. On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes <gesiel.bernardes(a)gmail.com> wrote: generated when trying to add the new gateway: local version. Correct and retry request -- Jason

Jason,

You might need to reset the target API service. You can compare what the two REST APIs think the config is by running: $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi1:5000/api/sysinfo/checkconf $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi3:5000/api/sysinfo/checkconf

(tweak username, password, http/https, and port as appropriate as per your configs) On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes &lt;gesiel.bernardes(a)gmail.com&gt; wrote: /etc/ceph/iscsi-gateway.cfg /etc/ceph/iscsi-gateway.cfg escreveu: is generated when trying to add the new gateway: the local version. Correct and retry request -- Jason

On Tue, Dec 3, 2019 at 12:58 PM Gesiel Galvão Bernardes &lt;gesiel.bernardes(a)gmail.com&gt; wrote: to be the same? Yes, they should be the same since those are the hashes of the config. ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be the problem? The Ceph version shouldn't matter. Perhaps you are running different ceph-iscsi versions and a setting's default value unexpectedly changed? escreveu: /etc/ceph/iscsi-gateway.cfg /etc/ceph/iscsi-gateway.cfg jdillama(a)redhat.com&gt; escreveu: error is generated when trying to add the new gateway: the local version. Correct and retry request -- Jason

You haven't answered whether or not you tried restarting the API daemons yet AFAICT. On Tue, Dec 3, 2019 at 5:53 PM Gesiel Galvão Bernardes &lt;gesiel.bernardes(a)gmail.com&gt; wrote:

I updated and restarted rbd-target-api, and this error appearly resolved. Now, I have other problem: A gateway that I losed: s> create ceph-iscsi3 192.168.201.3 Adding gateway, sync'ing 3 disk(s) and 2 client(s) Failed : Gateway creation failed, gateway(s) unavailable:ceph-iscsi2(UNKNOWN state) If i try delete: /iscsi-target...-igw/gateways> delete ceph-iscsi2 Deleting gateway, ceph-iscsi2 Failed : Gateway deletion failed, gateway(s) unavailable:ceph-iscsi2(UNKNOWN state) How to delete a losed gateway? Gesiel Em ter., 3 de dez. de 2019 às 23:46, Mike Christie &lt;mchristi(a)redhat.com&gt; escreveu: > > Also, I do not think we saw if the ceph-iscsi versions are the same. We > saw the ceph versions are different which is ok. If you were using a old > ceph-iscsi version which has different settings/values with a newer > version then you could see this error. > > On 12/03/2019 06:47 PM, Jason Dillaman wrote: > > You haven't answered whether or not you tried restarting the API > > daemons yet AFAICT. > > > > On Tue, Dec 3, 2019 at 5:53 PM Gesiel Galvão Bernardes > > &lt;gesiel.bernardes(a)gmail.com&gt; wrote: > >> > >> I copied the /etc/ceph folder from one to the other, restarted rbd-target-api but the error continues. > >> > >> Any tips on which direction I can look? > >> > >> Em ter., 3 de dez. de 2019 às 15:10, Jason Dillaman &lt;jdillama(a)redhat.com&gt; escreveu: > >>> > >>> On Tue, Dec 3, 2019 at 12:58 PM Gesiel Galvão Bernardes > >>> &lt;gesiel.bernardes(a)gmail.com&gt; wrote: > >>>>> > >>>>> Jason, > >>>> > >>>> > >>>> Returned a json with "data" and a different strnig. Were they supposed to be the same? > >>> > >>> Yes, they should be the same since those are the hashes of the config. > >>> > >>>> Now I checked that ceph version is different in the gateways: ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be the problem? > >>> > >>> The Ceph version shouldn't matter. Perhaps you are running different > >>> ceph-iscsi versions and a setting's default value unexpectedly > >>> changed? > >>> > >>>> Gesiel > >>>> Em ter., 3 de dez. de 2019 às 14:43, Jason Dillaman &lt;jdillama(a)redhat.com&gt; escreveu: > >>>>> > >>>>> You might need to reset the target API service. You can compare what > >>>>> the two REST APIs think the config is by running: > >>>>> > >>>>> $ curl --insecure --user <username>:<password> -X GET > >>>>> http://ceph-iscsi1:5000/api/sysinfo/checkconf > >>>>> $ curl --insecure --user <username>:<password> -X GET > >>>>> http://ceph-iscsi3:5000/api/sysinfo/checkconf > >>>> > >>>> > >>>>> > >>>>> (tweak username, password, http/https, and port as appropriate as per > >>>>> your configs) > >>>>> > >>>>> On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes > >>>>> &lt;gesiel.bernardes(a)gmail.com&gt; wrote: > >>>>>> > >>>>>> Are exactly the same: > >>>>>> > >>>>>> [root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg > >>>>>> 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg > >>>>>> > >>>>>> [root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg > >>>>>> 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg > >>>>>> > >>>>>> Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman &lt;jdillama(a)redhat.com&gt; escreveu: > >>>>>>> > >>>>>>> The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are > >>>>>>> running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches. > >>>>>>> > >>>>>>> On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes > >>>>>>> &lt;gesiel.bernardes(a)gmail.com&gt; wrote: > >>>>>>>> > >>>>>>>> Hi everyone, > >>>>>>>> > >>>>>>>> I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway: > >>>>>>>> > >>>>>>>> iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 > >>>>>>>> Adding gateway, sync'ing 3 disk(s) and 2 client(s) > >>>>>>>> Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request > >>>>>>>> > >>>>>>>> But the file iscsi-gateway.cfg is exactly the same in all gateways. > >>>>>>>> Selinux is disabled, permissios are OK too. > >>>>>>>> > >>>>>>>> I using ceph 13.2.6. Can anyone help-me? > >>>>>>>> > >>>>>>>> Regards > >>>>>>>> Gesiel > >>>>>>>> > >>>>>>>> _______________________________________________ > >>>>>>>> ceph-users mailing list -- ceph-users(a)ceph.io > >>>>>>>> To unsubscribe send an email to ceph-users-leave(a)ceph.io > >>>>>>> > >>>>>>> > >>>>>>> > >>>>>>> -- > >>>>>>> Jason > >>>>>>> > >>>>> > >>>>> > >>>>> -- > >>>>> Jason > >>>>> > >>> > >>> > >>> -- > >>> Jason > >>> > > > > >