Since upgrading a test cluster and a small production cluster from Tentacle to Umbrella, I have no OSD stats (latencies, distribution of PGs per OSD, onode hit ratios) are all empty. The read/write profile is populated however. Other things such as Pools, Hosts, Block Images, etc are showing correctly. The OSD stats were largely there on Tentacle. I have noticed a couple of things in the logs but I suspect they are irrelevant: * Prometheus: Periodic connection refused to tcp/8765 (service discovery) on each of the non-active-mgr nodes. This wasn't there on Tentacle. It is however connecting ok to the active mgr host. * Node-exporter: Periodic err="failed to retrieve XFS stats: strconv.ParseUint: parsing \"xpc\": invalid syntax". This was there on Tentacle. * Active MGR: /lib/python3.12/site-packages/urllib3/connectionpool.py:1075: InsecureRequestWarning: Unverified HTTPS request is being made to host 'ceph4.xxx'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings. [ceph4 is the host running the monitoring stack. Happens once when I enter any of the performance tabs in the dashboard, including those that appear to be working] Before I start digging into an area I'm not familiar with, does this ring a bell with anyone? Thanks, Chris
participants (1)
-
Chris Palmer