Error in add new ISCSI gateway
Hi everyone, I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway: iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 Adding gateway, sync'ing 3 disk(s) and 2 client(s) Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request But the file iscsi-gateway.cfg is exactly the same in all gateways. Selinux is disabled, permissios are OK too. I using ceph 13.2.6. Can anyone help-me? Regards Gesiel
The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches. On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Hi everyone,
I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway:
iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 Adding gateway, sync'ing 3 disk(s) and 2 client(s) Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request
But the file iscsi-gateway.cfg is exactly the same in all gateways. Selinux is disabled, permissios are OK too.
I using ceph 13.2.6. Can anyone help-me?
Regards Gesiel
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Jason
Are exactly the same: [root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg [root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman <jdillama@redhat.com> escreveu:
The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches.
On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Hi everyone,
I have a problem trying to add an ISCSI gateway. The following error is
generated when trying to add the new gateway:
iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 Adding gateway, sync'ing 3 disk(s) and 2 client(s) Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the
local version. Correct and retry request
But the file iscsi-gateway.cfg is exactly the same in all gateways. Selinux is disabled, permissios are OK too.
I using ceph 13.2.6. Can anyone help-me?
Regards Gesiel
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Jason
You might need to reset the target API service. You can compare what the two REST APIs think the config is by running: $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi1:5000/api/sysinfo/checkconf $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi3:5000/api/sysinfo/checkconf (tweak username, password, http/https, and port as appropriate as per your configs) On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Are exactly the same:
[root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg
[root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg
Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman <jdillama@redhat.com> escreveu:
The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches.
On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Hi everyone,
I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway:
iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 Adding gateway, sync'ing 3 disk(s) and 2 client(s) Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request
But the file iscsi-gateway.cfg is exactly the same in all gateways. Selinux is disabled, permissios are OK too.
I using ceph 13.2.6. Can anyone help-me?
Regards Gesiel
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Jason
-- Jason
Jason,
Returned a json with "data" and a different strnig. Were they supposed to be the same? Now I checked that ceph version is different in the gateways: ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be the problem? Gesiel Em ter., 3 de dez. de 2019 às 14:43, Jason Dillaman <jdillama@redhat.com> escreveu:
You might need to reset the target API service. You can compare what the two REST APIs think the config is by running:
$ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi1:5000/api/sysinfo/checkconf $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi3:5000/api/sysinfo/checkconf
(tweak username, password, http/https, and port as appropriate as per your configs)
On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Are exactly the same:
[root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a
/etc/ceph/iscsi-gateway.cfg
[root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a
/etc/ceph/iscsi-gateway.cfg
Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman <jdillama@redhat.com>
The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches.
On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Hi everyone,
I have a problem trying to add an ISCSI gateway. The following error
is generated when trying to add the new gateway:
iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 Adding gateway, sync'ing 3 disk(s) and 2 client(s) Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match
escreveu: the local version. Correct and retry request
But the file iscsi-gateway.cfg is exactly the same in all gateways. Selinux is disabled, permissios are OK too.
I using ceph 13.2.6. Can anyone help-me?
Regards Gesiel
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Jason
-- Jason
On Tue, Dec 3, 2019 at 12:58 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Jason,
Returned a json with "data" and a different strnig. Were they supposed to be the same?
Yes, they should be the same since those are the hashes of the config.
Now I checked that ceph version is different in the gateways: ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be the problem?
The Ceph version shouldn't matter. Perhaps you are running different ceph-iscsi versions and a setting's default value unexpectedly changed?
Gesiel Em ter., 3 de dez. de 2019 às 14:43, Jason Dillaman <jdillama@redhat.com> escreveu:
You might need to reset the target API service. You can compare what the two REST APIs think the config is by running:
$ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi1:5000/api/sysinfo/checkconf $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi3:5000/api/sysinfo/checkconf
(tweak username, password, http/https, and port as appropriate as per your configs)
On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Are exactly the same:
[root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg
[root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg
Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman <jdillama@redhat.com> escreveu:
The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches.
On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Hi everyone,
I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway:
iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 Adding gateway, sync'ing 3 disk(s) and 2 client(s) Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request
But the file iscsi-gateway.cfg is exactly the same in all gateways. Selinux is disabled, permissios are OK too.
I using ceph 13.2.6. Can anyone help-me?
Regards Gesiel
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Jason
-- Jason
-- Jason
I copied the /etc/ceph folder from one to the other, restarted rbd-target-api but the error continues. Any tips on which direction I can look? Em ter., 3 de dez. de 2019 às 15:10, Jason Dillaman <jdillama@redhat.com> escreveu:
On Tue, Dec 3, 2019 at 12:58 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Jason,
Returned a json with "data" and a different strnig. Were they supposed to be the same?
Yes, they should be the same since those are the hashes of the config.
Now I checked that ceph version is different in the gateways: ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be the problem?
The Ceph version shouldn't matter. Perhaps you are running different ceph-iscsi versions and a setting's default value unexpectedly changed?
Gesiel Em ter., 3 de dez. de 2019 às 14:43, Jason Dillaman <jdillama@redhat.com> escreveu:
You might need to reset the target API service. You can compare what the two REST APIs think the config is by running:
$ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi1:5000/api/sysinfo/checkconf $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi3:5000/api/sysinfo/checkconf
(tweak username, password, http/https, and port as appropriate as per your configs)
On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Are exactly the same:
[root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a
[root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a
/etc/ceph/iscsi-gateway.cfg
Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman <
jdillama@redhat.com> escreveu:
The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches.
On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Hi everyone,
I have a problem trying to add an ISCSI gateway. The following
error is generated when trying to add the new gateway:
iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 Adding gateway, sync'ing 3 disk(s) and 2 client(s) Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match
/etc/ceph/iscsi-gateway.cfg the local version. Correct and retry request
But the file iscsi-gateway.cfg is exactly the same in all gateways. Selinux is disabled, permissios are OK too.
I using ceph 13.2.6. Can anyone help-me?
Regards Gesiel
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Jason
-- Jason
-- Jason
You haven't answered whether or not you tried restarting the API daemons yet AFAICT. On Tue, Dec 3, 2019 at 5:53 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
I copied the /etc/ceph folder from one to the other, restarted rbd-target-api but the error continues.
Any tips on which direction I can look?
Em ter., 3 de dez. de 2019 às 15:10, Jason Dillaman <jdillama@redhat.com> escreveu:
On Tue, Dec 3, 2019 at 12:58 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Jason,
Returned a json with "data" and a different strnig. Were they supposed to be the same?
Yes, they should be the same since those are the hashes of the config.
Now I checked that ceph version is different in the gateways: ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be the problem?
The Ceph version shouldn't matter. Perhaps you are running different ceph-iscsi versions and a setting's default value unexpectedly changed?
Gesiel Em ter., 3 de dez. de 2019 às 14:43, Jason Dillaman <jdillama@redhat.com> escreveu:
You might need to reset the target API service. You can compare what the two REST APIs think the config is by running:
$ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi1:5000/api/sysinfo/checkconf $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi3:5000/api/sysinfo/checkconf
(tweak username, password, http/https, and port as appropriate as per your configs)
On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Are exactly the same:
[root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg
[root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg
Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman <jdillama@redhat.com> escreveu:
The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches.
On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote: > > Hi everyone, > > I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway: > > iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 > Adding gateway, sync'ing 3 disk(s) and 2 client(s) > Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request > > But the file iscsi-gateway.cfg is exactly the same in all gateways. > Selinux is disabled, permissios are OK too. > > I using ceph 13.2.6. Can anyone help-me? > > Regards > Gesiel > > _______________________________________________ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-leave@ceph.io
-- Jason
-- Jason
-- Jason
-- Jason
Also, I do not think we saw if the ceph-iscsi versions are the same. We saw the ceph versions are different which is ok. If you were using a old ceph-iscsi version which has different settings/values with a newer version then you could see this error. On 12/03/2019 06:47 PM, Jason Dillaman wrote:
You haven't answered whether or not you tried restarting the API daemons yet AFAICT.
On Tue, Dec 3, 2019 at 5:53 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
I copied the /etc/ceph folder from one to the other, restarted rbd-target-api but the error continues.
Any tips on which direction I can look?
Em ter., 3 de dez. de 2019 às 15:10, Jason Dillaman <jdillama@redhat.com> escreveu:
On Tue, Dec 3, 2019 at 12:58 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Jason,
Returned a json with "data" and a different strnig. Were they supposed to be the same?
Yes, they should be the same since those are the hashes of the config.
Now I checked that ceph version is different in the gateways: ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be the problem?
The Ceph version shouldn't matter. Perhaps you are running different ceph-iscsi versions and a setting's default value unexpectedly changed?
Gesiel Em ter., 3 de dez. de 2019 às 14:43, Jason Dillaman <jdillama@redhat.com> escreveu:
You might need to reset the target API service. You can compare what the two REST APIs think the config is by running:
$ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi1:5000/api/sysinfo/checkconf $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi3:5000/api/sysinfo/checkconf
(tweak username, password, http/https, and port as appropriate as per your configs)
On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Are exactly the same:
[root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg
[root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg
Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman <jdillama@redhat.com> escreveu: > > The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are > running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches. > > On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes > <gesiel.bernardes@gmail.com> wrote: >> >> Hi everyone, >> >> I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway: >> >> iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 >> Adding gateway, sync'ing 3 disk(s) and 2 client(s) >> Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request >> >> But the file iscsi-gateway.cfg is exactly the same in all gateways. >> Selinux is disabled, permissios are OK too. >> >> I using ceph 13.2.6. Can anyone help-me? >> >> Regards >> Gesiel >> >> _______________________________________________ >> ceph-users mailing list -- ceph-users@ceph.io >> To unsubscribe send an email to ceph-users-leave@ceph.io > > > > -- > Jason >
-- Jason
-- Jason
I updated and restarted rbd-target-api, and this error appearly resolved. Now, I have other problem: A gateway that I losed: s> create ceph-iscsi3 192.168.201.3*Adding gateway, sync'ing 3 disk(s) and 2 client(s)**Failed : Gateway creation failed, gateway(s) unavailable:ceph-iscsi2(UNKNOWN state)* If i try delete: /iscsi-target...-igw/gateways> delete ceph-iscsi2*Deleting gateway, ceph-iscsi2**Failed : Gateway deletion failed, gateway(s) unavailable:ceph-iscsi2(UNKNOWN state)* How to delete a losed gateway? Gesiel Em ter., 3 de dez. de 2019 às 23:46, Mike Christie <mchristi@redhat.com> escreveu:
Also, I do not think we saw if the ceph-iscsi versions are the same. We saw the ceph versions are different which is ok. If you were using a old ceph-iscsi version which has different settings/values with a newer version then you could see this error.
You haven't answered whether or not you tried restarting the API daemons yet AFAICT.
On Tue, Dec 3, 2019 at 5:53 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
I copied the /etc/ceph folder from one to the other, restarted
rbd-target-api but the error continues.
Any tips on which direction I can look?
Em ter., 3 de dez. de 2019 às 15:10, Jason Dillaman <
jdillama@redhat.com> escreveu:
On Tue, Dec 3, 2019 at 12:58 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
Jason,
Returned a json with "data" and a different strnig. Were they
supposed to be the same?
Yes, they should be the same since those are the hashes of the config.
Now I checked that ceph version is different in the gateways:
ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be
On 12/03/2019 06:47 PM, Jason Dillaman wrote: the problem?
The Ceph version shouldn't matter. Perhaps you are running different ceph-iscsi versions and a setting's default value unexpectedly changed?
Gesiel Em ter., 3 de dez. de 2019 às 14:43, Jason Dillaman <
jdillama@redhat.com> escreveu:
You might need to reset the target API service. You can compare what the two REST APIs think the config is by running:
$ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi1:5000/api/sysinfo/checkconf $ curl --insecure --user <username>:<password> -X GET http://ceph-iscsi3:5000/api/sysinfo/checkconf
(tweak username, password, http/https, and port as appropriate as per your configs)
On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote: > > Are exactly the same: > > [root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg > 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a
/etc/ceph/iscsi-gateway.cfg
> > [root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg > 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg > > Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman < jdillama@redhat.com> escreveu: >> >> The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are >> running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches. >> >> On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes >> <gesiel.bernardes@gmail.com> wrote: >>> >>> Hi everyone, >>> >>> I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway: >>> >>> iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 >>> Adding gateway, sync'ing 3 disk(s) and 2 client(s) >>> Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request >>> >>> But the file iscsi-gateway.cfg is exactly the same in all gateways. >>> Selinux is disabled, permissios are OK too. >>> >>> I using ceph 13.2.6. Can anyone help-me? >>> >>> Regards >>> Gesiel >>> >>> _______________________________________________ >>> ceph-users mailing list -- ceph-users@ceph.io >>> To unsubscribe send an email to ceph-users-leave@ceph.io >> >> >> >> -- >> Jason >>
-- Jason
-- Jason
See the thread "iSCSI Gateway reboots and permanent loss" from yesterday -- it's not currently possible to remove a gateway that no longer exists. On Wed, Dec 4, 2019 at 3:49 AM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
I updated and restarted rbd-target-api, and this error appearly resolved. Now, I have other problem: A gateway that I losed:
s> create ceph-iscsi3 192.168.201.3 Adding gateway, sync'ing 3 disk(s) and 2 client(s) Failed : Gateway creation failed, gateway(s) unavailable:ceph-iscsi2(UNKNOWN state)
If i try delete: /iscsi-target...-igw/gateways> delete ceph-iscsi2 Deleting gateway, ceph-iscsi2 Failed : Gateway deletion failed, gateway(s) unavailable:ceph-iscsi2(UNKNOWN state)
How to delete a losed gateway?
Gesiel
Em ter., 3 de dez. de 2019 às 23:46, Mike Christie <mchristi@redhat.com> escreveu:
Also, I do not think we saw if the ceph-iscsi versions are the same. We saw the ceph versions are different which is ok. If you were using a old ceph-iscsi version which has different settings/values with a newer version then you could see this error.
On 12/03/2019 06:47 PM, Jason Dillaman wrote:
You haven't answered whether or not you tried restarting the API daemons yet AFAICT.
On Tue, Dec 3, 2019 at 5:53 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
I copied the /etc/ceph folder from one to the other, restarted rbd-target-api but the error continues.
Any tips on which direction I can look?
Em ter., 3 de dez. de 2019 às 15:10, Jason Dillaman <jdillama@redhat.com> escreveu:
On Tue, Dec 3, 2019 at 12:58 PM Gesiel Galvão Bernardes <gesiel.bernardes@gmail.com> wrote:
> > Jason,
Returned a json with "data" and a different strnig. Were they supposed to be the same?
Yes, they should be the same since those are the hashes of the config.
Now I checked that ceph version is different in the gateways: ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be the problem?
The Ceph version shouldn't matter. Perhaps you are running different ceph-iscsi versions and a setting's default value unexpectedly changed?
Gesiel Em ter., 3 de dez. de 2019 às 14:43, Jason Dillaman <jdillama@redhat.com> escreveu: > > You might need to reset the target API service. You can compare what > the two REST APIs think the config is by running: > > $ curl --insecure --user <username>:<password> -X GET > http://ceph-iscsi1:5000/api/sysinfo/checkconf > $ curl --insecure --user <username>:<password> -X GET > http://ceph-iscsi3:5000/api/sysinfo/checkconf
> > (tweak username, password, http/https, and port as appropriate as per > your configs) > > On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes > <gesiel.bernardes@gmail.com> wrote: >> >> Are exactly the same: >> >> [root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg >> 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg >> >> [root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg >> 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg >> >> Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman <jdillama@redhat.com> escreveu: >>> >>> The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are >>> running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches. >>> >>> On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes >>> <gesiel.bernardes@gmail.com> wrote: >>>> >>>> Hi everyone, >>>> >>>> I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway: >>>> >>>> iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 >>>> Adding gateway, sync'ing 3 disk(s) and 2 client(s) >>>> Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request >>>> >>>> But the file iscsi-gateway.cfg is exactly the same in all gateways. >>>> Selinux is disabled, permissios are OK too. >>>> >>>> I using ceph 13.2.6. Can anyone help-me? >>>> >>>> Regards >>>> Gesiel >>>> >>>> _______________________________________________ >>>> ceph-users mailing list -- ceph-users@ceph.io >>>> To unsubscribe send an email to ceph-users-leave@ceph.io >>> >>> >>> >>> -- >>> Jason >>> > > > -- > Jason >
-- Jason
-- Jason
participants (3)
-
Gesiel Galvão Bernardes
-
Jason Dillaman
-
Mike Christie