tentacle 20.1.1 RC1 QE validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/73123#note-1 Release Notes - TBD LRC upgrade - TBD Dev Leads, please review the list of suites for completeness, as this is a new release. Seeking approvals/reviews for: smoke: PASSED rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv upgrade/squid-x: Laura upgrade/reef-x: Laura upgrade/telemetry-upgrade: PASSED upgrade/tentacle-p2p: N/A upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED TIA
nvmeof approved. The failures were due to healthcheck warning found in logs during deployment, which get resolved pretty soon and then rest of the test proceeds as expected. Regards, Vallari On Mon, Sep 22, 2025 at 8:17 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this is a new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv
upgrade/squid-x: Laura upgrade/reef-x: Laura
upgrade/telemetry-upgrade: PASSED
upgrade/tentacle-p2p: N/A
upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED
perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED
TIA _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Still waiting for approvals: rados: Radek, Laura, Afreen rgw: Adam Emerson fs: Venky orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya upgrade/squid-x: Laura, Adam K (see https://github.com/ceph/ceph/pull/65645) upgrade/reef-x: Laura, Adam K (see https://github.com/ceph/ceph/pull/65645) On Mon, Sep 22, 2025 at 7:45 AM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this is a new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv
upgrade/squid-x: Laura upgrade/reef-x: Laura
upgrade/telemetry-upgrade: PASSED
upgrade/tentacle-p2p: N/A
upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED
perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED
TIA
On 22/09/2025, Yuri Weinstein wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this is a new release. [snip] rgw: Adam Emerson [snip]
I approve for RGW.
On Mon, Sep 22, 2025 at 4:46 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this is a new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya
rbd and krbd approved. (rbd suite is impacted by https://tracker.ceph.com/issues/73297, but the root cause is outside of RBD and it also extends to main and other release branches.) Thanks, Ilya
Hey Yuri, On Mon, Sep 22, 2025 at 8:16 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this is a new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky
fs suite mostly looks fine. I have reached out to Ilya and Adam over slack to discuss about https://tracker.ceph.com/issues/72695
orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv
upgrade/squid-x: Laura upgrade/reef-x: Laura
upgrade/telemetry-upgrade: PASSED
upgrade/tentacle-p2p: N/A
upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED
perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED
TIA _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Cheers, Venky
Dashboard approved. On Mon, Sep 29, 2025 at 5:03 PM Venky Shankar <vshankar@redhat.com> wrote:
Hey Yuri,
On Mon, Sep 22, 2025 at 8:16 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this is
a
new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky
fs suite mostly looks fine. I have reached out to Ilya and Adam over slack to discuss about
https://tracker.ceph.com/issues/72695
orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv
upgrade/squid-x: Laura upgrade/reef-x: Laura
upgrade/telemetry-upgrade: PASSED
upgrade/tentacle-p2p: N/A
upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED
perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED
TIA _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Cheers, Venky _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
The rados suite is approved. The upgrade suite is approved on behalf of rados. Other tech leads (namely @Adam King <adking@redhat.com>, @Venky Shankar <vshankar@redhat.com>, and @Ilya Dryomov <idryomov@gmail.com>) may want to also take a look. I summarized the failures at this link: https://tracker.ceph.com/projects/rados/wiki/TENTACLE#Tentacle-RC1-httpstrac... Thanks, Laura On Mon, Sep 29, 2025 at 9:32 AM Afreen <afreen23.git@gmail.com> wrote:
Dashboard approved.
On Mon, Sep 29, 2025 at 5:03 PM Venky Shankar <vshankar@redhat.com> wrote:
Hey Yuri,
On Mon, Sep 22, 2025 at 8:16 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this
is a
new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky
fs suite mostly looks fine. I have reached out to Ilya and Adam over slack to discuss about
https://tracker.ceph.com/issues/72695
orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv
upgrade/squid-x: Laura upgrade/reef-x: Laura
upgrade/telemetry-upgrade: PASSED
upgrade/tentacle-p2p: N/A
upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED
perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED
TIA _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Cheers, Venky _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
_______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
-- Laura Flores She/Her/Hers Software Engineer, Ceph Storage <https://ceph.io> Chicago, IL lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
The only remaining approval is for cephfs from Venky. On Tue, Sep 30, 2025 at 8:04 AM Laura Flores <lflores@redhat.com> wrote:
The rados suite is approved.
The upgrade suite is approved on behalf of rados. Other tech leads (namely @Adam King <adking@redhat.com>, @Venky Shankar <vshankar@redhat.com>, and @Ilya Dryomov <idryomov@gmail.com>) may want to also take a look. I summarized the failures at this link: https://tracker.ceph.com/projects/rados/wiki/TENTACLE#Tentacle-RC1-httpstrac...
Thanks, Laura
On Mon, Sep 29, 2025 at 9:32 AM Afreen <afreen23.git@gmail.com> wrote:
Dashboard approved.
On Mon, Sep 29, 2025 at 5:03 PM Venky Shankar <vshankar@redhat.com> wrote:
Hey Yuri,
On Mon, Sep 22, 2025 at 8:16 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this
is a
new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky
fs suite mostly looks fine. I have reached out to Ilya and Adam over slack to discuss about
https://tracker.ceph.com/issues/72695
orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv
upgrade/squid-x: Laura upgrade/reef-x: Laura
upgrade/telemetry-upgrade: PASSED
upgrade/tentacle-p2p: N/A
upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED
perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED
TIA _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Cheers, Venky _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
_______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
--
Laura Flores
She/Her/Hers
Software Engineer, Ceph Storage <https://ceph.io>
Chicago, IL
lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
Hi Yuri, On Tue, Sep 30, 2025 at 8:39 PM Yuri Weinstein <yweinste@redhat.com> wrote:
The only remaining approval is for cephfs from Venky.
I was awaiting inputs from Adam regarding the issue I mentioned in my previous email. Adam mentioned that it is a decoding failure in cephadm for a sysctl config. It seems to be happening for the testing kernel IMO. That said, I believe the above failure should not block release of this RC. I also went through Laura's request for checking the upgrade suite and those are fine too. fs approved, failures are https://tracker.ceph.com/projects/cephfs/wiki/Tentacle#2011-RC1
On Tue, Sep 30, 2025 at 8:04 AM Laura Flores <lflores@redhat.com> wrote:
The rados suite is approved.
The upgrade suite is approved on behalf of rados. Other tech leads (namely @Adam King <adking@redhat.com>, @Venky Shankar <vshankar@redhat.com>, and @Ilya Dryomov <idryomov@gmail.com>) may want to also take a look. I summarized the failures at this link: https://tracker.ceph.com/projects/rados/wiki/TENTACLE#Tentacle-RC1-httpstrac...
Thanks, Laura
On Mon, Sep 29, 2025 at 9:32 AM Afreen <afreen23.git@gmail.com> wrote:
Dashboard approved.
On Mon, Sep 29, 2025 at 5:03 PM Venky Shankar <vshankar@redhat.com> wrote:
Hey Yuri,
On Mon, Sep 22, 2025 at 8:16 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this
is a
new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky
fs suite mostly looks fine. I have reached out to Ilya and Adam over slack to discuss about
https://tracker.ceph.com/issues/72695
orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv
upgrade/squid-x: Laura upgrade/reef-x: Laura
upgrade/telemetry-upgrade: PASSED
upgrade/tentacle-p2p: N/A
upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED
perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED
TIA _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Cheers, Venky _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
_______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
--
Laura Flores
She/Her/Hers
Software Engineer, Ceph Storage <https://ceph.io>
Chicago, IL
lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
-- Cheers, Venky
On Wed, Oct 1, 2025 at 8:28 AM Venky Shankar <vshankar@redhat.com> wrote:
Hi Yuri,
On Tue, Sep 30, 2025 at 8:39 PM Yuri Weinstein <yweinste@redhat.com> wrote:
The only remaining approval is for cephfs from Venky.
I was awaiting inputs from Adam regarding the issue I mentioned in my previous email. Adam mentioned that it is a decoding failure in cephadm for a sysctl config. It seems to be happening for the testing kernel IMO.
Hi Venky, This turns out to be a trivial kernel bug introduced with the new panic_sys_info sysctl parameter in 6.17 [1] and fixed in [2]. The fix isn't in mainline yet, but I went ahead and cherry picked it into our testing branch. If you wait for 4eb61c999cea61cd82c41373fbd6dd6273e03e4c to build and retry, these failures should go away. [1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/li... [2] https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git/commit/l... Thanks, Ilya
On Thu, Oct 2, 2025 at 6:01 PM Ilya Dryomov <idryomov@gmail.com> wrote:
On Wed, Oct 1, 2025 at 8:28 AM Venky Shankar <vshankar@redhat.com> wrote:
Hi Yuri,
On Tue, Sep 30, 2025 at 8:39 PM Yuri Weinstein <yweinste@redhat.com> wrote:
The only remaining approval is for cephfs from Venky.
I was awaiting inputs from Adam regarding the issue I mentioned in my previous email. Adam mentioned that it is a decoding failure in cephadm for a sysctl config. It seems to be happening for the testing kernel IMO.
Hi Venky,
This turns out to be a trivial kernel bug introduced with the new panic_sys_info sysctl parameter in 6.17 [1] and fixed in [2]. The fix isn't in mainline yet, but I went ahead and cherry picked it into our testing branch. If you wait for 4eb61c999cea61cd82c41373fbd6dd6273e03e4c to build and retry, these failures should go away.
[1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/li... [2] https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git/commit/l...
Thank you so much, Ilya.
Thanks,
Ilya
-- Cheers, Venky
Orch approved with the caveat that we will need https://github.com/ceph/ceph/pull/65719 to be included in the release. It only changes the default image to point to the actual tentacle image rather than main and it does not require us to do additional testing as all our teuthology tests explicitly specify which image to use rather than relying on the default. On Mon, Sep 22, 2025 at 10:47 AM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this is a new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv
upgrade/squid-x: Laura upgrade/reef-x: Laura
upgrade/telemetry-upgrade: PASSED
upgrade/tentacle-p2p: N/A
upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED
perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED
TIA _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-volume approved On Mon, Sep 22, 2025 at 10:47 AM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release are summarized here:
https://tracker.ceph.com/issues/73123#note-1
Release Notes - TBD LRC upgrade - TBD
Dev Leads, please review the list of suites for completeness, as this is a new release.
Seeking approvals/reviews for:
smoke: PASSED
rados: Radek, Laura, Afreen, Travis rgw: Adam Emerson fs: Venky orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv
upgrade/squid-x: Laura upgrade/reef-x: Laura
upgrade/telemetry-upgrade: PASSED
upgrade/tentacle-p2p: N/A
upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED
perf-basic: PASSED crimson-rados: PASSED powercycle: PASSED
TIA _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (8)
-
Adam Emerson
-
Adam King
-
Afreen
-
Ilya Dryomov
-
Laura Flores
-
Vallari Agrawal
-
Venky Shankar
-
Yuri Weinstein