Since I use keepalived, I can affirm with virtual certainty that keepalived could do stuff like that. Although it may involve using special IP address that keepalived would aim at the preferred server instance. But that's not the problem here, as "404" means that the server is up, but it sneers at what you are pushing at it. If Prometheus could, for example, log WHAT is being pushed at it, it would go a long way. Tim On Mon, 2024-08-19 at 08:40 -0400, Daniel Brown wrote:
I’ve seen similar.
Have been wondering if it would be possible to either setup a LoadBalancer or something like “keeepalived” to provide a “VIP” which could move between nodes to support the dashboard (and prometheus, Grafana, etc).
I do see notes about HA Proxy in the docs, but haven’t gotten to trying that setup:
https://docs.ceph.com/en/quincy/mgr/dashboard/#haproxy-example-configuration
In my opinion, a VIP for the dashboard (etc.) could and maybe should be and out of the box config.
On Aug 19, 2024, at 8:23 AM, Tim Holloway <timh@mousetech.com> wrote:
Although I'm seeing this in Pacific, it appears to be a perennial issue with no well-documented solution. The dashboard home screen is flooded with popups saying "404 - Not Found
Could not reach Prometheus's API on http://ceph1234.mydomain.com:9095/api/v1 "
If I was a slack-jawed PHB casually wandering into the operations center and saw that, I'd probably doubt that Ceph was a good product decision.
The "404" indicates that the Prometheus server is running and accepting requests, but all the "404" says is that whatever requests it's receiving are meaningless to it. Presumably either some handler needs to be jacked into Prometheus or the sender needs to be notified to desist.
Unfortunately, "404" doesn't provide any clues. Ideally, ceph should log something more specific by default, but failing that, if anyone knows how to shut it up (cleanly), I'd appreciate knowing!
Tim _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io