Re: Removing Rados Gateway in ceph cluster
Please send responses to the mailing-list. If the orchestrator is available, please share also this output (mask sensitive data): ceph orch ls rgw --export --format yaml Which ceph version is this? The command 'ceph dashboard get-rgw-api-host' was removed between Octopus and Pacific, that's why I asked for your ceph version. I also forgot that mgr/dashboard/RGW_API_HOST was used until Octopus, in Pacific it's not applied anymore. I'll need to check how it is determined now. Zitat von Michel Niyoyita <micou12@gmail.com>:
Hello Eugen,
Thanks for your reply ,
I am trying the shared command but no output .
root@ceph-mon1:~# ceph config dump | grep mgr/dashboard/RGW_API_HOST root@ceph-mon1:~# ceph config dump | grep mgr/dashboard/ mgr advanced mgr/dashboard/ALERTMANAGER_API_HOST http://10.10.110.196:9093 * mgr advanced mgr/dashboard/GRAFANA_API_PASSWORD XXXX
* mgr advanced mgr/dashboard/GRAFANA_API_SSL_VERIFY false
* mgr advanced mgr/dashboard/GRAFANA_API_URL https://10.10.110.198:3000 * mgr advanced mgr/dashboard/GRAFANA_API_USERNAME admin
* mgr advanced mgr/dashboard/PROMETHEUS_API_HOST http://10.10.110.196:9092 * mgr advanced mgr/dashboard/RGW_API_ACCESS_KEY XXXX * mgr advanced mgr/dashboard/RGW_API_SECRET_KEY XXXX * mgr advanced mgr/dashboard/RGW_API_SSL_VERIFY false
* mgr advanced mgr/dashboard/ceph-mon1/server_addr 10.10.110.196
* mgr advanced mgr/dashboard/ceph-mon2/server_addr 10.10.110.197
* mgr advanced mgr/dashboard/ceph-mon3/server_addr 10.10.110.198
* mgr advanced mgr/dashboard/motd {"message": "WELCOME TO AOS ZONE 3 STORAGE CLUSTER", "md5": "87149a6798ce42a7e990bc8584a232cd", "severity": "info", "expires": ""} * mgr advanced mgr/dashboard/server_port 8443
* mgr advanced mgr/dashboard/ssl true
* mgr advanced mgr/dashboard/ssl_server_port 8443
for the second one it seems is not valid
root@ceph-mon1:~# ceph dashboard get-rgw-api-host no valid command found; 10 closest matches: dashboard set-jwt-token-ttl <seconds:int> dashboard get-jwt-token-ttl dashboard create-self-signed-cert dashboard grafana dashboards update dashboard get-account-lockout-attempts dashboard set-account-lockout-attempts <value> dashboard reset-account-lockout-attempts dashboard get-alertmanager-api-host dashboard set-alertmanager-api-host <value> dashboard reset-alertmanager-api-host Error EINVAL: invalid command root@ceph-mon1:~#
Kindly check the output .
Best Regards
Michel *
On Mon, Feb 6, 2023 at 2:06 PM Eugen Block <eblock@nde.ag> wrote:
Hi,
can you paste the output of:
ceph config dump | grep mgr/dashboard/RGW_API_HOST
Does it match your desired setup? Depending on the ceph version (and how ceph-ansible deploys the services) you could also check:
ceph dashboard get-rgw-api-host
I'm not familiar with ceph-ansible, but if you shared your rgw definitions and the respective ceph output we might be able to assist resolving this.
Regards, Eugen
Zitat von Michel Niyoyita <micou12@gmail.com>:
Hello team,
I have a ceph cluster deployed using ceph-ansible , running on ubuntu 20.04 OS which have 6 hosts , 3 hosts for OSD and 3 hosts used as monitors and managers , I have deployed RGW on all those hosts and RGWLOADBALENCER on top of them , for testing purpose , I have switched off one OSD , to check if the rest can work properly , The test went well as expected, unfortunately while coming back an OSD , the RGW failed to connect through the dashboard. below is the message : The Object Gateway Service is not configuredError connecting to Object GatewayPlease consult the documentation < https://docs.ceph.com/en/latest/mgr/dashboard/#enabling-the-object-gateway-m...
on how to configure and enable the Object Gateway management functionality.
would like to ask how to solve that issue or how can I proceed to remove completely RGW and redeploy it after .
root@ceph-mon1:~# ceph -s cluster: id: cb0caedc-eb5b-42d1-a34f-96facfda8c27 health: HEALTH_OK
services: mon: 3 daemons, quorum ceph-mon1,ceph-mon2,ceph-mon3 (age 72m) mgr: ceph-mon2(active, since 71m), standbys: ceph-mon3, ceph-mon1 osd: 48 osds: 48 up (since 79m), 48 in (since 3d) rgw: 6 daemons active (6 hosts, 1 zones)
data: pools: 9 pools, 257 pgs objects: 59.49k objects, 314 GiB usage: 85 TiB used, 348 TiB / 433 TiB avail pgs: 257 active+clean
io: client: 2.0 KiB/s wr, 0 op/s rd, 0 op/s wr
Kindly help
Best Regards
Michel _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hello Eugen, below is the Version of Ceph I am running root@ceph-mon1:~# ceph -v ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable) root@ceph-mon1:~# ceph orch ls rgw --export --format yaml Error ENOENT: No orchestrator configured (try `ceph orch set backend`) root@ceph-mon1:~# tried ceph orch set backend , but nothing changed also. Best Regards On Mon, Feb 6, 2023 at 2:37 PM Eugen Block <eblock@nde.ag> wrote:
Please send responses to the mailing-list.
If the orchestrator is available, please share also this output (mask sensitive data):
ceph orch ls rgw --export --format yaml
Which ceph version is this? The command 'ceph dashboard get-rgw-api-host' was removed between Octopus and Pacific, that's why I asked for your ceph version.
I also forgot that mgr/dashboard/RGW_API_HOST was used until Octopus, in Pacific it's not applied anymore. I'll need to check how it is determined now.
Zitat von Michel Niyoyita <micou12@gmail.com>:
Hello Eugen,
Thanks for your reply ,
I am trying the shared command but no output .
root@ceph-mon1:~# ceph config dump | grep mgr/dashboard/RGW_API_HOST root@ceph-mon1:~# ceph config dump | grep mgr/dashboard/ mgr advanced mgr/dashboard/ALERTMANAGER_API_HOST http://10.10.110.196:9093 * mgr advanced mgr/dashboard/GRAFANA_API_PASSWORD XXXX
* mgr advanced mgr/dashboard/GRAFANA_API_SSL_VERIFY false
* mgr advanced mgr/dashboard/GRAFANA_API_URL https://10.10.110.198:3000 * mgr advanced mgr/dashboard/GRAFANA_API_USERNAME admin
* mgr advanced mgr/dashboard/PROMETHEUS_API_HOST http://10.10.110.196:9092 * mgr advanced mgr/dashboard/RGW_API_ACCESS_KEY XXXX * mgr advanced mgr/dashboard/RGW_API_SECRET_KEY XXXX * mgr advanced mgr/dashboard/RGW_API_SSL_VERIFY false
* mgr advanced mgr/dashboard/ceph-mon1/server_addr 10.10.110.196
* mgr advanced mgr/dashboard/ceph-mon2/server_addr 10.10.110.197
* mgr advanced mgr/dashboard/ceph-mon3/server_addr 10.10.110.198
* mgr advanced mgr/dashboard/motd {"message": "WELCOME TO AOS ZONE 3 STORAGE CLUSTER", "md5": "87149a6798ce42a7e990bc8584a232cd", "severity": "info", "expires": ""} * mgr advanced mgr/dashboard/server_port 8443
* mgr advanced mgr/dashboard/ssl true
* mgr advanced mgr/dashboard/ssl_server_port 8443
for the second one it seems is not valid
root@ceph-mon1:~# ceph dashboard get-rgw-api-host no valid command found; 10 closest matches: dashboard set-jwt-token-ttl <seconds:int> dashboard get-jwt-token-ttl dashboard create-self-signed-cert dashboard grafana dashboards update dashboard get-account-lockout-attempts dashboard set-account-lockout-attempts <value> dashboard reset-account-lockout-attempts dashboard get-alertmanager-api-host dashboard set-alertmanager-api-host <value> dashboard reset-alertmanager-api-host Error EINVAL: invalid command root@ceph-mon1:~#
Kindly check the output .
Best Regards
Michel *
On Mon, Feb 6, 2023 at 2:06 PM Eugen Block <eblock@nde.ag> wrote:
Hi,
can you paste the output of:
ceph config dump | grep mgr/dashboard/RGW_API_HOST
Does it match your desired setup? Depending on the ceph version (and how ceph-ansible deploys the services) you could also check:
ceph dashboard get-rgw-api-host
I'm not familiar with ceph-ansible, but if you shared your rgw definitions and the respective ceph output we might be able to assist resolving this.
Regards, Eugen
Zitat von Michel Niyoyita <micou12@gmail.com>:
Hello team,
I have a ceph cluster deployed using ceph-ansible , running on ubuntu 20.04 OS which have 6 hosts , 3 hosts for OSD and 3 hosts used as monitors and managers , I have deployed RGW on all those hosts and RGWLOADBALENCER on top of them , for testing purpose , I have switched off one OSD , to check if the rest can work properly , The test went well as expected, unfortunately while coming back an OSD , the RGW failed to connect through the dashboard. below is the message : The Object Gateway Service is not configuredError connecting to Object GatewayPlease consult the documentation <
https://docs.ceph.com/en/latest/mgr/dashboard/#enabling-the-object-gateway-m...
on how to configure and enable the Object Gateway management
functionality.
would like to ask how to solve that issue or how can I proceed to
remove
completely RGW and redeploy it after .
root@ceph-mon1:~# ceph -s cluster: id: cb0caedc-eb5b-42d1-a34f-96facfda8c27 health: HEALTH_OK
services: mon: 3 daemons, quorum ceph-mon1,ceph-mon2,ceph-mon3 (age 72m) mgr: ceph-mon2(active, since 71m), standbys: ceph-mon3, ceph-mon1 osd: 48 osds: 48 up (since 79m), 48 in (since 3d) rgw: 6 daemons active (6 hosts, 1 zones)
data: pools: 9 pools, 257 pgs objects: 59.49k objects, 314 GiB usage: 85 TiB used, 348 TiB / 433 TiB avail pgs: 257 active+clean
io: client: 2.0 KiB/s wr, 0 op/s rd, 0 op/s wr
Kindly help
Best Regards
Michel _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
On 06.02.23 13:48, Michel Niyoyita wrote:
root@ceph-mon1:~# ceph -v ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)
This is the version of the command line tool "ceph". Please run "ceph versions" to show the version of the running Ceph daemons. Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030-405051-43 Fax: 030-405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin
Hello Robert below is the output of ceph versions command root@ceph-mon1:~# ceph versions { "mon": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "mgr": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "osd": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 48 }, "mds": {}, "rgw": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 6 }, "overall": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 60 } } root@ceph-mon1:~# Best Regards Michel On Mon, Feb 6, 2023 at 2:57 PM Robert Sander <r.sander@heinlein-support.de> wrote:
On 06.02.23 13:48, Michel Niyoyita wrote:
root@ceph-mon1:~# ceph -v ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)
This is the version of the command line tool "ceph".
Please run "ceph versions" to show the version of the running Ceph daemons.
Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de
Tel: 030-405051-43 Fax: 030-405051-19
Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
What does the active mgr log when you try to access the dashboard? Please paste your rgw config settings as well. Zitat von Michel Niyoyita <micou12@gmail.com>:
Hello Robert
below is the output of ceph versions command
root@ceph-mon1:~# ceph versions { "mon": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "mgr": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "osd": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 48 }, "mds": {}, "rgw": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 6 }, "overall": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 60 } } root@ceph-mon1:~#
Best Regards
Michel
On Mon, Feb 6, 2023 at 2:57 PM Robert Sander <r.sander@heinlein-support.de> wrote:
On 06.02.23 13:48, Michel Niyoyita wrote:
root@ceph-mon1:~# ceph -v ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)
This is the version of the command line tool "ceph".
Please run "ceph versions" to show the version of the running Ceph daemons.
Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de
Tel: 030-405051-43 Fax: 030-405051-19
Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Just a quick edit: what does the active mgr log when you try to access the rgw page in the dashboard? With 'ceph service dump' you can see the rgw daemons that are registered to the mgr. If the daemons are not shown in the dashboard you'll have to check the active mgr logs for errors or hints. Zitat von Eugen Block <eblock@nde.ag>:
What does the active mgr log when you try to access the dashboard? Please paste your rgw config settings as well.
Zitat von Michel Niyoyita <micou12@gmail.com>:
Hello Robert
below is the output of ceph versions command
root@ceph-mon1:~# ceph versions { "mon": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "mgr": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "osd": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 48 }, "mds": {}, "rgw": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 6 }, "overall": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 60 } } root@ceph-mon1:~#
Best Regards
Michel
On Mon, Feb 6, 2023 at 2:57 PM Robert Sander <r.sander@heinlein-support.de> wrote:
On 06.02.23 13:48, Michel Niyoyita wrote:
root@ceph-mon1:~# ceph -v ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)
This is the version of the command line tool "ceph".
Please run "ceph versions" to show the version of the running Ceph daemons.
Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de
Tel: 030-405051-43 Fax: 030-405051-19
Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hello Eugen Below are rgw configs and logs while I am accessing the dashboard : root@ceph-mon1:/var/log/ceph# tail -f /var/log/ceph/ceph-mgr.ceph-mon1.log 2023-02-06T15:25:30.037+0200 7f68b15cd700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:25:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:25:45.033+0200 7f68b0dcc700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:25:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:25:45.033+0200 7f68b1dce700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:25:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:25:45.037+0200 7f68b35d1700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:25:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:00.033+0200 7f68b3dd2700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:26:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:00.033+0200 7f68b25cf700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:26:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:00.037+0200 7f68b2dd0700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:26:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:15.033+0200 7f68afdca700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:26:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:15.033+0200 7f68b45d3700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:26:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:15.037+0200 7f68b05cb700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:26:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:30.033+0200 7f68b15cd700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:26:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:30.033+0200 7f68b0dcc700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:26:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:30.037+0200 7f68b1dce700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:26:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:45.033+0200 7f68b35d1700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:26:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:45.033+0200 7f68b3dd2700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:26:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:45.037+0200 7f68b25cf700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:26:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" [mons] ceph-mon1 ceph-mon2 ceph-mon3 [osds] ceph-osd1 ceph-osd2 ceph-osd3 [mgrs] ceph-mon1 ceph-mon2 ceph-mon3 [grafana-server] ceph-mon1 ceph-mon2 ceph-mon3 [rgws] ceph-osd1 ceph-osd2 ceph-osd3 ceph-mon1 ceph-mon2 ceph-mon3 [rgwloadbalancers] ceph-osd1 ceph-osd2 ceph-osd3 ceph-mon1 ceph-mon2 ceph-mon3 ceph.conf: [client] rbd_default_features = 1 [client.rgw.ceph-mon1.rgw0] host = ceph-mon1 keyring = /var/lib/ceph/radosgw/ceph-rgw.ceph-mon1.rgw0/keyring log file = /var/log/ceph/ceph-rgw-ceph-mon1.rgw0.log rgw frontends = beast endpoint=10.10.110.198:8080 rgw frontends = beast endpoint=10.10.110.196:8080 rgw thread pool size = 512 [client.rgw.ceph-osd1] rgw_dns_name = ceph-osd1 [client.rgw.ceph-osd2] rgw_dns_name = ceph-osd2 [client.rgw.ceph-osd3] rgw_dns_name = ceph-osd3 # Please do not change this file directly since it is managed by Ansible and will be overwritten [global] auth_client_required = cephx auth_cluster_required = cephx auth_service_required = cephx cluster network = 10.10.110.128/26 fsid = cb0caedc-eb5b-42d1-a34f-96facfda8c27 mon host = mon initial members = ceph-mon1,ceph-mon2,ceph-mon3 mon_allow_pool_delete = True mon_max_pg_per_osd = 400 osd pool default crush rule = -1 osd_pool_default_min_size = 2 osd_pool_default_size = 3 public network = Best Regards On Mon, Feb 6, 2023 at 3:13 PM Eugen Block <eblock@nde.ag> wrote:
What does the active mgr log when you try to access the dashboard? Please paste your rgw config settings as well.
Zitat von Michel Niyoyita <micou12@gmail.com>:
Hello Robert
below is the output of ceph versions command
root@ceph-mon1:~# ceph versions { "mon": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "mgr": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "osd": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 48 }, "mds": {}, "rgw": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 6 }, "overall": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 60 } } root@ceph-mon1:~#
Best Regards
Michel
On Mon, Feb 6, 2023 at 2:57 PM Robert Sander < r.sander@heinlein-support.de> wrote:
On 06.02.23 13:48, Michel Niyoyita wrote:
root@ceph-mon1:~# ceph -v ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)
This is the version of the command line tool "ceph".
Please run "ceph versions" to show the version of the running Ceph daemons.
Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de
Tel: 030-405051-43 Fax: 030-405051-19
Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hello Eugen, The output shows that all daemon are configured , would like to know also if there is a possibility of removing those RGW and redeploy them to see if there will be changes. root@ceph-mon1:~# ceph service dump { "epoch": 1740, "modified": "2023-02-06T15:21:42.235595+0200", "services": { "rgw": { "daemons": { "summary": "", "479626": { "start_epoch": 1265, "start_stamp": "2023-02-03T11:41:58.680359+0200", "gid": 479626, "addr": "10.10.110.199:0/1880864062", "metadata": { "arch": "x86_64", "ceph_release": "pacific", "ceph_version": "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)", "ceph_version_short": "16.2.11", "cpu": "Intel(R) Xeon(R) Gold 5215 CPU @ 2.50GHz", "distro": "ubuntu", "distro_description": "Ubuntu 20.04.5 LTS", "distro_version": "20.04", "frontend_config#0": "beast endpoint= 10.10.110.199:8080", "frontend_type#0": "beast", "hostname": "ceph-osd1", "id": "ceph-osd1.rgw0", "kernel_description": "#154-Ubuntu SMP Thu Jan 5 17:03:22 UTC 2023", "kernel_version": "5.4.0-137-generic", "mem_swap_kb": "8388604", "mem_total_kb": "263556752", "num_handles": "1", "os": "Linux", "pid": "47369", "realm_id": "", "realm_name": "", "zone_id": "689f9b30-4380-439e-8e7c-3c2046079a2b", "zone_name": "default", "zonegroup_id": "c2d060fe-bd6c-4bfb-a0cd-596124765015", "zonegroup_name": "default" }, "task_status": {} }, "489542": { "start_epoch": 1267, "start_stamp": "2023-02-03T11:42:30.711278+0200", "gid": 489542, "addr": "10.10.110.200:0/3909810130", "metadata": { "arch": "x86_64", "ceph_release": "pacific", "ceph_version": "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)", "ceph_version_short": "16.2.11", "cpu": "Intel(R) Xeon(R) Gold 5215 CPU @ 2.50GHz", "distro": "ubuntu", "distro_description": "Ubuntu 20.04.5 LTS", "distro_version": "20.04", "frontend_config#0": "beast endpoint= 10.10.110.200:8080", "frontend_type#0": "beast", "hostname": "ceph-osd2", "id": "ceph-osd2.rgw0", "kernel_description": "#154-Ubuntu SMP Thu Jan 5 17:03:22 UTC 2023", "kernel_version": "5.4.0-137-generic", "mem_swap_kb": "8388604", "mem_total_kb": "263556752", "num_handles": "1", "os": "Linux", "pid": "392257", "realm_id": "", "realm_name": "", "zone_id": "689f9b30-4380-439e-8e7c-3c2046079a2b", "zone_name": "default", "zonegroup_id": "c2d060fe-bd6c-4bfb-a0cd-596124765015", "zonegroup_name": "default" }, "task_status": {} }, "489605": { "start_epoch": 1268, "start_stamp": "2023-02-03T11:42:58.724973+0200", "gid": 489605, "addr": "10.10.110.201:0/59797695", "metadata": { "arch": "x86_64", "ceph_release": "pacific", "ceph_version": "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)", "ceph_version_short": "16.2.11", "cpu": "Intel(R) Xeon(R) Gold 5215 CPU @ 2.50GHz", "distro": "ubuntu", "distro_description": "Ubuntu 20.04.5 LTS", "distro_version": "20.04", "frontend_config#0": "beast endpoint= 10.10.110.201:8080", "frontend_type#0": "beast", "hostname": "ceph-osd3", "id": "ceph-osd3.rgw0", "kernel_description": "#154-Ubuntu SMP Thu Jan 5 17:03:22 UTC 2023", "kernel_version": "5.4.0-137-generic", "mem_swap_kb": "8388604", "mem_total_kb": "263556752", "num_handles": "1", "os": "Linux", "pid": "389458", "realm_id": "", "realm_name": "", "zone_id": "689f9b30-4380-439e-8e7c-3c2046079a2b", "zone_name": "default", "zonegroup_id": "c2d060fe-bd6c-4bfb-a0cd-596124765015", "zonegroup_name": "default" }, "task_status": {} }, "724322": { "start_epoch": 1628, "start_stamp": "2023-02-06T08:53:50.544397+0200", "gid": 724322, "addr": "10.10.110.198:0/3339657222", "metadata": { "arch": "x86_64", "ceph_release": "pacific", "ceph_version": "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)", "ceph_version_short": "16.2.11", "cpu": "Intel(R) Xeon(R) Gold 6240 CPU @ 2.60GHz", "distro": "ubuntu", "distro_description": "Ubuntu 20.04.5 LTS", "distro_version": "20.04", "frontend_config#0": "beast endpoint= 10.10.110.198:8080", "frontend_type#0": "beast", "hostname": "ceph-mon3", "id": "ceph-mon3.rgw0", "kernel_description": "#154-Ubuntu SMP Thu Jan 5 17:03:22 UTC 2023", "kernel_version": "5.4.0-137-generic", "mem_swap_kb": "8388604", "mem_total_kb": "97474404", "num_handles": "1", "os": "Linux", "pid": "51926", "realm_id": "", "realm_name": "", "zone_id": "689f9b30-4380-439e-8e7c-3c2046079a2b", "zone_name": "default", "zonegroup_id": "c2d060fe-bd6c-4bfb-a0cd-596124765015", "zonegroup_name": "default" }, "task_status": {} }, "774174": { "start_epoch": 1711, "start_stamp": "2023-02-06T09:35:03.106044+0200", "gid": 774174, "addr": "10.10.110.196:0/3043825332", "metadata": { "arch": "x86_64", "ceph_release": "pacific", "ceph_version": "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)", "ceph_version_short": "16.2.11", "cpu": "Intel(R) Xeon(R) Gold 6240 CPU @ 2.60GHz", "distro": "ubuntu", "distro_description": "Ubuntu 20.04.5 LTS", "distro_version": "20.04", "frontend_config#0": "beast endpoint= 10.10.110.196:8080", "frontend_type#0": "beast", "hostname": "ceph-mon1", "id": "ceph-mon1.rgw0", "kernel_description": "#154-Ubuntu SMP Thu Jan 5 17:03:22 UTC 2023", "kernel_version": "5.4.0-137-generic", "mem_swap_kb": "8388604", "mem_total_kb": "97474404", "num_handles": "1", "os": "Linux", "pid": "53265", "realm_id": "", "realm_name": "", "zone_id": "689f9b30-4380-439e-8e7c-3c2046079a2b", "zone_name": "default", "zonegroup_id": "c2d060fe-bd6c-4bfb-a0cd-596124765015", "zonegroup_name": "default" }, "task_status": {} }, "784198": { "start_epoch": 1714, "start_stamp": "2023-02-06T09:35:23.974089+0200", "gid": 784198, "addr": "10.10.110.197:0/2503354619", "metadata": { "arch": "x86_64", "ceph_release": "pacific", "ceph_version": "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)", "ceph_version_short": "16.2.11", "cpu": "Intel(R) Xeon(R) Gold 6240 CPU @ 2.60GHz", "distro": "ubuntu", "distro_description": "Ubuntu 20.04.5 LTS", "distro_version": "20.04", "frontend_config#0": "beast endpoint= 10.10.110.197:8080", "frontend_type#0": "beast", "hostname": "ceph-mon2", "id": "ceph-mon2.rgw0", "kernel_description": "#154-Ubuntu SMP Thu Jan 5 17:03:22 UTC 2023", "kernel_version": "5.4.0-137-generic", "mem_swap_kb": "8388604", "mem_total_kb": "97474408", "num_handles": "1", "os": "Linux", "pid": "152772", "realm_id": "", "realm_name": "", "zone_id": "689f9b30-4380-439e-8e7c-3c2046079a2b", "zone_name": "default", "zonegroup_id": "c2d060fe-bd6c-4bfb-a0cd-596124765015", "zonegroup_name": "default" }, "task_status": {} } } } } } root@ceph-mon1:~# Michel On Mon, Feb 6, 2023 at 3:32 PM Michel Niyoyita <micou12@gmail.com> wrote:
Hello Eugen
Below are rgw configs and logs while I am accessing the dashboard :
root@ceph-mon1:/var/log/ceph# tail -f /var/log/ceph/ceph-mgr.ceph-mon1.log 2023-02-06T15:25:30.037+0200 7f68b15cd700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:25:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:25:45.033+0200 7f68b0dcc700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:25:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:25:45.033+0200 7f68b1dce700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:25:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:25:45.037+0200 7f68b35d1700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:25:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:00.033+0200 7f68b3dd2700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:26:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:00.033+0200 7f68b25cf700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:26:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:00.037+0200 7f68b2dd0700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:26:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:15.033+0200 7f68afdca700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:26:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:15.033+0200 7f68b45d3700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:26:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:15.037+0200 7f68b05cb700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:26:15] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:30.033+0200 7f68b15cd700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:26:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:30.033+0200 7f68b0dcc700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:26:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:30.037+0200 7f68b1dce700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:26:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:45.033+0200 7f68b35d1700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:127.0.0.1 - - [06/Feb/2023:15:26:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:45.033+0200 7f68b3dd2700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.133 - - [06/Feb/2023:15:26:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2" 2023-02-06T15:26:45.037+0200 7f68b25cf700 0 [prometheus INFO cherrypy.access.140087714875184] ::ffff:10.10.110.134 - - [06/Feb/2023:15:26:45] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.7.2"
[mons] ceph-mon1 ceph-mon2 ceph-mon3
[osds] ceph-osd1 ceph-osd2 ceph-osd3
[mgrs] ceph-mon1 ceph-mon2 ceph-mon3
[grafana-server] ceph-mon1 ceph-mon2 ceph-mon3
[rgws] ceph-osd1 ceph-osd2 ceph-osd3 ceph-mon1 ceph-mon2 ceph-mon3
[rgwloadbalancers] ceph-osd1 ceph-osd2 ceph-osd3 ceph-mon1 ceph-mon2 ceph-mon3
ceph.conf:
[client] rbd_default_features = 1
[client.rgw.ceph-mon1.rgw0] host = ceph-mon1 keyring = /var/lib/ceph/radosgw/ceph-rgw.ceph-mon1.rgw0/keyring log file = /var/log/ceph/ceph-rgw-ceph-mon1.rgw0.log rgw frontends = beast endpoint=10.10.110.198:8080 rgw frontends = beast endpoint=10.10.110.196:8080 rgw thread pool size = 512
[client.rgw.ceph-osd1] rgw_dns_name = ceph-osd1
[client.rgw.ceph-osd2] rgw_dns_name = ceph-osd2
[client.rgw.ceph-osd3] rgw_dns_name = ceph-osd3
# Please do not change this file directly since it is managed by Ansible and will be overwritten [global] auth_client_required = cephx auth_cluster_required = cephx auth_service_required = cephx cluster network = 10.10.110.128/26 fsid = cb0caedc-eb5b-42d1-a34f-96facfda8c27 mon host = mon initial members = ceph-mon1,ceph-mon2,ceph-mon3 mon_allow_pool_delete = True mon_max_pg_per_osd = 400 osd pool default crush rule = -1 osd_pool_default_min_size = 2 osd_pool_default_size = 3 public network =
Best Regards
On Mon, Feb 6, 2023 at 3:13 PM Eugen Block <eblock@nde.ag> wrote:
What does the active mgr log when you try to access the dashboard? Please paste your rgw config settings as well.
Zitat von Michel Niyoyita <micou12@gmail.com>:
Hello Robert
below is the output of ceph versions command
root@ceph-mon1:~# ceph versions { "mon": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "mgr": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 3 }, "osd": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 48 }, "mds": {}, "rgw": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 6 }, "overall": { "ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)": 60 } } root@ceph-mon1:~#
Best Regards
Michel
On Mon, Feb 6, 2023 at 2:57 PM Robert Sander < r.sander@heinlein-support.de> wrote:
On 06.02.23 13:48, Michel Niyoyita wrote:
root@ceph-mon1:~# ceph -v ceph version 16.2.11 (3cf40e2dca667f68c6ce3ff5cd94f01e711af894) pacific (stable)
This is the version of the command line tool "ceph".
Please run "ceph versions" to show the version of the running Ceph daemons.
Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de
Tel: 030-405051-43 Fax: 030-405051-19
Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Le 2023-02-06 14:11, Eugen Block a écrit :
What does the active mgr log when you try to access the dashboard? Please paste your rgw config settings as well.
Ah, Sorry to hijack, but I also can't access Object Storage menus in the Dashboard since upgrading from 16.2.10 to 16.2.11. Here are the MGR logs : fcadmin@fidcllabs-oct-01:~$ sudo grep 8080 /var/log/ceph/ceph-mgr.fidcllabs-oct-01.log 2023-02-06T08:12:58.179+0000 7ffad4910700 0 [dashboard INFO rgw_client] Found RGW daemon with configuration: host=fidcllabs-oct-03, port=8080, ssl=False 2023-02-06T08:12:58.179+0000 7ffad4910700 0 [dashboard INFO rgw_client] Found RGW daemon with configuration: host=fidcllabs-oct-01, port=8080, ssl=False 2023-02-06T08:12:58.179+0000 7ffad4910700 0 [dashboard INFO rgw_client] Found RGW daemon with configuration: host=fidcllabs-oct-02, port=8080, ssl=False 2023-02-06T08:12:58.275+0000 7ffad4910700 0 [dashboard ERROR rest_client] RGW REST API failed GET, connection error (url=http://fidcllabs-oct-03:8080/admin/metadata/user?myself): [errno: 111] Connection refused urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='fidcllabs-oct-03', port=8080): Max retries exceeded with url: /admin/metadata/user?myself (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffac1e75160>: Failed to establish a new connection: [Errno 111] Connection refused',)) requests.exceptions.ConnectionError: HTTPConnectionPool(host='fidcllabs-oct-03', port=8080): Max retries exceeded with url: /admin/metadata/user?myself (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffac1e75160>: Failed to establish a new connection: [Errno 111] Connection refused',)) The hostname is resolvable, but not on the same IP (management network) than my RGW endpoints (public network). In other cluster still on 16.2.10, I can see IPs in the corresponding logs, not the hostname. -- Gilles
Hi, I don't really know how the IP address is determined by the mgr, I only remember that there was a change introduced in 16.2.11 [1] to use the hostname instead of an IP address. In a 16.2.9 cluster I have all storage nodes (including rgw) configured with multiple ip addresses, and it chooses the right one although the only information pointing to that is in the zonegroup endpoints. I'm wondering if an upgrade to 16.2.11 would break that in this cluster, too.
The output shows that all daemon are configured , would like to know also if there is a possibility of removing those RGW and redeploy them to see if there will be changes.
I don't know how to do that with ansible, but I'm sure there are plenty of ansible users here who could chime in. But I would assume that it's in the ceph-ansible docs somewhere. Regards, Eugen [1] https://tracker.ceph.com/issues/56970 Zitat von Gilles Mocellin <gilles.mocellin@nuagelibre.org>:
Le 2023-02-06 14:11, Eugen Block a écrit :
What does the active mgr log when you try to access the dashboard? Please paste your rgw config settings as well.
Ah, Sorry to hijack, but I also can't access Object Storage menus in the Dashboard since upgrading from 16.2.10 to 16.2.11.
Here are the MGR logs :
fcadmin@fidcllabs-oct-01:~$ sudo grep 8080 /var/log/ceph/ceph-mgr.fidcllabs-oct-01.log 2023-02-06T08:12:58.179+0000 7ffad4910700 0 [dashboard INFO rgw_client] Found RGW daemon with configuration: host=fidcllabs-oct-03, port=8080, ssl=False 2023-02-06T08:12:58.179+0000 7ffad4910700 0 [dashboard INFO rgw_client] Found RGW daemon with configuration: host=fidcllabs-oct-01, port=8080, ssl=False 2023-02-06T08:12:58.179+0000 7ffad4910700 0 [dashboard INFO rgw_client] Found RGW daemon with configuration: host=fidcllabs-oct-02, port=8080, ssl=False 2023-02-06T08:12:58.275+0000 7ffad4910700 0 [dashboard ERROR rest_client] RGW REST API failed GET, connection error (url=http://fidcllabs-oct-03:8080/admin/metadata/user?myself): [errno: 111] Connection refused urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='fidcllabs-oct-03', port=8080): Max retries exceeded with url: /admin/metadata/user?myself (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffac1e75160>: Failed to establish a new connection: [Errno 111] Connection refused',)) requests.exceptions.ConnectionError: HTTPConnectionPool(host='fidcllabs-oct-03', port=8080): Max retries exceeded with url: /admin/metadata/user?myself (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffac1e75160>: Failed to establish a new connection: [Errno 111] Connection refused',))
The hostname is resolvable, but not on the same IP (management network) than my RGW endpoints (public network). In other cluster still on 16.2.10, I can see IPs in the corresponding logs, not the hostname.
-- Gilles _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (4)
-
Eugen Block
-
Gilles Mocellin
-
Michel Niyoyita
-
Robert Sander