Octopus dashboard: rbd-mirror page shows error for primary site
Hi *, I was just testing rbd-mirror on ceph version 15.2.4-864-g0f510cb110 (0f510cb1101879a5941dfa1fa824bf97db6c3d08) octopus (stable) and noticed mgr errors on the primary site (also in version 15.2.2): ---snip--- 2020-09-10T11:20:01.724+0200 7f1c1b46a700 0 [dashboard ERROR controllers.rbd_mirror] Failed to list mirror image status rbd-pool1 Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c1b46a700 0 [dashboard ERROR viewcache] Error while calling fn=<function _get_pool_datum at 0x7f1c5ac58f28> ex='description' Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c1ec71700 0 [dashboard ERROR viewcache] Error while calling fn=<function _get_content_data at 0x7f1c5ac610d0> ex='description' Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 283, in _get_content_data _, pool = _get_pool_datum(pool_name) File "/usr/share/ceph/mgr/dashboard/tools.py", line 254, in wrapper return rvc.run(fn, args, kwargs) File "/usr/share/ceph/mgr/dashboard/tools.py", line 236, in run raise self.exception File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c23ebb700 0 [dashboard ERROR request] [X.X.X.X:42050] [GET] [500] [0.020s] [admin] [513.0B] /api/block/mirroring/summary 2020-09-10T11:20:01.728+0200 7f1c23ebb700 0 [dashboard ERROR request] [b'{"status": "500 Internal Server Error", "detail": "The server encountered an unexpected condition which prevented it from fulfilling the request.", "request_id": "64ea5407-171b-4f6c-862e-fc881e68fec0"} ---snip--- The mirroring itself seems to work fine, I haven't noticed issues with the image on the secondary site. I also uploaded a screenshot of the dashboard [1], the installation is on openSUSE Leap 15.2. I couldn't find a tracker issue or a report in bugzilla.opensuse.org, but before creating a ticket I wanted to ask if this is a known issue. The rbd-mirror panel works fine on the secondary site, I assume because there is actually an rbd-mirror daemon running. Or maybe I just misunderstand the purpose, but if there is no mirror daemon on site A there shouldn't be an error message, should it? Regards, Eugen [1] https://paste.opensuse.org/36442780
On Thu, Sep 10, 2020 at 7:36 AM Eugen Block <eblock@nde.ag> wrote:
Hi *,
I was just testing rbd-mirror on ceph version 15.2.4-864-g0f510cb110 (0f510cb1101879a5941dfa1fa824bf97db6c3d08) octopus (stable) and noticed mgr errors on the primary site (also in version 15.2.2):
---snip--- 2020-09-10T11:20:01.724+0200 7f1c1b46a700 0 [dashboard ERROR controllers.rbd_mirror] Failed to list mirror image status rbd-pool1 Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c1b46a700 0 [dashboard ERROR viewcache] Error while calling fn=<function _get_pool_datum at 0x7f1c5ac58f28> ex='description' Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c1ec71700 0 [dashboard ERROR viewcache] Error while calling fn=<function _get_content_data at 0x7f1c5ac610d0> ex='description' Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 283, in _get_content_data _, pool = _get_pool_datum(pool_name) File "/usr/share/ceph/mgr/dashboard/tools.py", line 254, in wrapper return rvc.run(fn, args, kwargs) File "/usr/share/ceph/mgr/dashboard/tools.py", line 236, in run raise self.exception File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c23ebb700 0 [dashboard ERROR request] [X.X.X.X:42050] [GET] [500] [0.020s] [admin] [513.0B] /api/block/mirroring/summary 2020-09-10T11:20:01.728+0200 7f1c23ebb700 0 [dashboard ERROR request] [b'{"status": "500 Internal Server Error", "detail": "The server encountered an unexpected condition which prevented it from fulfilling the request.", "request_id": "64ea5407-171b-4f6c-862e-fc881e68fec0"} ---snip---
The mirroring itself seems to work fine, I haven't noticed issues with the image on the secondary site. I also uploaded a screenshot of the dashboard [1], the installation is on openSUSE Leap 15.2.
I couldn't find a tracker issue or a report in bugzilla.opensuse.org, but before creating a ticket I wanted to ask if this is a known issue. The rbd-mirror panel works fine on the secondary site, I assume because there is actually an rbd-mirror daemon running. Or maybe I just misunderstand the purpose, but if there is no mirror daemon on site A there shouldn't be an error message, should it?
Can you create a new tracker ticket at [1]? It looks like librbd is not returning a default "unknown" status for the local site if you aren't running "rbd-mirror" daemons. The dashboard is a little behind in supporting all the latest RBD mirroring changes, in this case the ability to see the global mirroring status from any site (local or remote).
Regards, Eugen
[1] https://paste.opensuse.org/36442780 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
[1] http://tracker.ceph.com/issues/rbd -- Jason
Thank you, Jason. The report can be found at https://tracker.ceph.com/issues/47390 By the way, I think your link to the rbd issues should be the other way around, http://tracker.ceph.com/issues/rbd gives me a 404. ;-) This is better: https://tracker.ceph.com/projects/rbd/issues Regards, Eugen Zitat von Jason Dillaman <jdillama@redhat.com>:
On Thu, Sep 10, 2020 at 7:36 AM Eugen Block <eblock@nde.ag> wrote:
Hi *,
I was just testing rbd-mirror on ceph version 15.2.4-864-g0f510cb110 (0f510cb1101879a5941dfa1fa824bf97db6c3d08) octopus (stable) and noticed mgr errors on the primary site (also in version 15.2.2):
---snip--- 2020-09-10T11:20:01.724+0200 7f1c1b46a700 0 [dashboard ERROR controllers.rbd_mirror] Failed to list mirror image status rbd-pool1 Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c1b46a700 0 [dashboard ERROR viewcache] Error while calling fn=<function _get_pool_datum at 0x7f1c5ac58f28> ex='description' Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c1ec71700 0 [dashboard ERROR viewcache] Error while calling fn=<function _get_content_data at 0x7f1c5ac610d0> ex='description' Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 283, in _get_content_data _, pool = _get_pool_datum(pool_name) File "/usr/share/ceph/mgr/dashboard/tools.py", line 254, in wrapper return rvc.run(fn, args, kwargs) File "/usr/share/ceph/mgr/dashboard/tools.py", line 236, in run raise self.exception File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c23ebb700 0 [dashboard ERROR request] [X.X.X.X:42050] [GET] [500] [0.020s] [admin] [513.0B] /api/block/mirroring/summary 2020-09-10T11:20:01.728+0200 7f1c23ebb700 0 [dashboard ERROR request] [b'{"status": "500 Internal Server Error", "detail": "The server encountered an unexpected condition which prevented it from fulfilling the request.", "request_id": "64ea5407-171b-4f6c-862e-fc881e68fec0"} ---snip---
The mirroring itself seems to work fine, I haven't noticed issues with the image on the secondary site. I also uploaded a screenshot of the dashboard [1], the installation is on openSUSE Leap 15.2.
I couldn't find a tracker issue or a report in bugzilla.opensuse.org, but before creating a ticket I wanted to ask if this is a known issue. The rbd-mirror panel works fine on the secondary site, I assume because there is actually an rbd-mirror daemon running. Or maybe I just misunderstand the purpose, but if there is no mirror daemon on site A there shouldn't be an error message, should it?
Can you create a new tracker ticket at [1]? It looks like librbd is not returning a default "unknown" status for the local site if you aren't running "rbd-mirror" daemons. The dashboard is a little behind in supporting all the latest RBD mirroring changes, in this case the ability to see the global mirroring status from any site (local or remote).
Regards, Eugen
[1] https://paste.opensuse.org/36442780 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
[1] http://tracker.ceph.com/issues/rbd
-- Jason
On Thu, Sep 10, 2020 at 10:05 AM Eugen Block <eblock@nde.ag> wrote:
Thank you, Jason. The report can be found at https://tracker.ceph.com/issues/47390
By the way, I think your link to the rbd issues should be the other way around, http://tracker.ceph.com/issues/rbd gives me a 404. ;-) This is better: https://tracker.ceph.com/projects/rbd/issues
Indeed -- thanks!
Regards, Eugen
Zitat von Jason Dillaman <jdillama@redhat.com>:
On Thu, Sep 10, 2020 at 7:36 AM Eugen Block <eblock@nde.ag> wrote:
Hi *,
I was just testing rbd-mirror on ceph version 15.2.4-864-g0f510cb110 (0f510cb1101879a5941dfa1fa824bf97db6c3d08) octopus (stable) and noticed mgr errors on the primary site (also in version 15.2.2):
---snip--- 2020-09-10T11:20:01.724+0200 7f1c1b46a700 0 [dashboard ERROR controllers.rbd_mirror] Failed to list mirror image status rbd-pool1 Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c1b46a700 0 [dashboard ERROR viewcache] Error while calling fn=<function _get_pool_datum at 0x7f1c5ac58f28> ex='description' Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c1ec71700 0 [dashboard ERROR viewcache] Error while calling fn=<function _get_content_data at 0x7f1c5ac610d0> ex='description' Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 283, in _get_content_data _, pool = _get_pool_datum(pool_name) File "/usr/share/ceph/mgr/dashboard/tools.py", line 254, in wrapper return rvc.run(fn, args, kwargs) File "/usr/share/ceph/mgr/dashboard/tools.py", line 236, in run raise self.exception File "/usr/share/ceph/mgr/dashboard/tools.py", line 156, in run val = self.fn(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in _get_pool_datum for image in mirror_image_status File "/usr/share/ceph/mgr/dashboard/controllers/rbd_mirroring.py", line 259, in <listcomp> for image in mirror_image_status KeyError: 'description' 2020-09-10T11:20:01.724+0200 7f1c23ebb700 0 [dashboard ERROR request] [X.X.X.X:42050] [GET] [500] [0.020s] [admin] [513.0B] /api/block/mirroring/summary 2020-09-10T11:20:01.728+0200 7f1c23ebb700 0 [dashboard ERROR request] [b'{"status": "500 Internal Server Error", "detail": "The server encountered an unexpected condition which prevented it from fulfilling the request.", "request_id": "64ea5407-171b-4f6c-862e-fc881e68fec0"} ---snip---
The mirroring itself seems to work fine, I haven't noticed issues with the image on the secondary site. I also uploaded a screenshot of the dashboard [1], the installation is on openSUSE Leap 15.2.
I couldn't find a tracker issue or a report in bugzilla.opensuse.org, but before creating a ticket I wanted to ask if this is a known issue. The rbd-mirror panel works fine on the secondary site, I assume because there is actually an rbd-mirror daemon running. Or maybe I just misunderstand the purpose, but if there is no mirror daemon on site A there shouldn't be an error message, should it?
Can you create a new tracker ticket at [1]? It looks like librbd is not returning a default "unknown" status for the local site if you aren't running "rbd-mirror" daemons. The dashboard is a little behind in supporting all the latest RBD mirroring changes, in this case the ability to see the global mirroring status from any site (local or remote).
Regards, Eugen
[1] https://paste.opensuse.org/36442780 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
[1] http://tracker.ceph.com/issues/rbd
-- Jason
-- Jason
participants (2)
-
Eugen Block
-
Jason Dillaman