The upgrade suites look mostly good to me, except for one tracker I think would be in @Adam King <adking@redhat.com>'s realm to look at. If the new grafana issue below is deemed okay, then we can proceed with approving the upgrade suite. *This issue stood out to me, where the cluster had trouble pulling the grafana image locally to redeploy it. *@Adam King <adking@redhat.com>* can you take a look?* - *https://tracker.ceph.com/issues/67583 <https://tracker.ceph.com/issues/67583> - upgrade:quincy-x/stress-split: Cluster fails to redeploy grafana daemon after image is unable to be found locally* Otherwise, tests failed from cluster log warnings that are expected during upgrade tests. Many of these warnings have already been fixed and are in the stages of getting backported. I checked for each test that the cluster had upgraded all daemons to 19.1.1, and that was the case. - https://tracker.ceph.com/issues/66602 - rados/upgrade: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) - https://tracker.ceph.com/issues/65422 - upgrade/quincy-x: "1 pg degraded (PG_DEGRADED)" in cluster log - https://tracker.ceph.com/issues/67584 - upgrade:quincy-x: cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log - https://tracker.ceph.com/issues/64460 - rados/upgrade: "[WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log - https://tracker.ceph.com/issues/66809 - upgrade/quincy-x; upgrade/reef-x: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log On Thu, Aug 15, 2024 at 11:55 AM Laura Flores <lflores@redhat.com> wrote:
Rados approved. Failures tracked here: https://tracker.ceph.com/projects/rados/wiki/SQUID#v1911-httpstrackercephcom...
On Thu, Aug 15, 2024 at 11:30 AM Yuri Weinstein <yweinste@redhat.com> wrote:
Laura,
The PR was cherry-picked and the `squid-release` branch was built. Please review the run results in the tracker.
On Wed, Aug 14, 2024 at 2:18 PM Laura Flores <lflores@redhat.com> wrote:
Hey @Yuri Weinstein <yweinste@redhat.com>,
We've fixed a couple of issues and now need a few things rerun.
1. *Can you please rerun upgrade/reef-x and upgrade/quincy-x? * - Reasoning: Many jobs in those suites died due to https://tracker.ceph.com/issues/66883, which we deduced was a
recent
merge to teuthology. Now that the affecting commit was reverted,
we are
ready to have those rerun. 2. *Can you please cherry-pick
<https://github.com/ceph/ceph/pull/58607> to squid-release and reschedule rados:thrash-old-clients?* - Reasoning: Since we stopped building focal for squid, we can no longer test squid against pacific clients. - For this second RC, we had to make the decision to drop pacific from the *rados:thrash-old-clients* tests, which will now use centos 9 stream packages to test against only reef and quincy clients ( https://github.com/ceph/ceph/pull/58607). - We have raised https://tracker.ceph.com/issues/67469 to track
https://github.com/ceph/ceph/pull/58607 the
implementation of a containerized solution for older clients that
don't
have centos 9 stream packages, so that we can reincorporate pacific in the future.
After these two things are rescheduled, we can proceed with a rados
suite
approval and an upgrade suite approval.
Thanks, Laura
On Wed, Aug 14, 2024 at 12:49 PM Adam Emerson <aemerson@redhat.com> wrote:
On 14/08/2024, Yuri Weinstein wrote:
Still waiting to hear back:
rgw - Eric, Adam E
Approved.
(Sorry, I thought we were supposed to reply on the tracker.) _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
--
Laura Flores
She/Her/Hers
Software Engineer, Ceph Storage <https://ceph.io>
Chicago, IL
lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
--
Laura Flores
She/Her/Hers
Software Engineer, Ceph Storage <https://ceph.io>
Chicago, IL
lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
-- Laura Flores She/Her/Hers Software Engineer, Ceph Storage <https://ceph.io> Chicago, IL lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804