14.2.22 QE nautilus (last) validation status
Details of this release summarized here: https://tracker.ceph.com/issues/51268#note-1 At the time of approval and review process we'd like also review and approve the Release Notes https://github.com/ceph/ceph/pull/41958 Seeking review/approval: rgw - Casey? rbd - Ilya? krbd - Ilya? fs, kcephfs, mutlimds - Patrick, Ramana (please unusually high amount of reds in fs, maybe infra - David FYI ) ceph-deploy - Josh ? upgrade/client-upgrade-* - Josh, concur w/rhel 7.6 excluding ? upgrade/mimic-x (nautilus) - Josh? upgrade/nautilus-x (octopus) - Josh, Casey? ceph-volume - Guillaume ? Thx YuriW
On Tue, Jun 22, 2021 at 6:37 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rbd - Ilya? krbd - Ilya?
krbd needs to be rerun -- it is full of infrastructure issues. Thanks, Ilya
Ilya, reruning https://pulpito.ceph.com/yuriw-2021-06-22_18:08:28-krbd-nautilus-testing-bas... On Tue, Jun 22, 2021 at 10:58 AM Ilya Dryomov <idryomov@gmail.com> wrote:
On Tue, Jun 22, 2021 at 6:37 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rbd - Ilya? krbd - Ilya?
krbd needs to be rerun -- it is full of infrastructure issues.
Thanks,
Ilya
Please see the latest updates and still seeking approvals. https://tracker.ceph.com/issues/51268#note-1 Please review/approve and add your commits to the Release Notes https://github.com/ceph/ceph/pull/41958 On Tue, Jun 22, 2021 at 12:16 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Ilya, reruning https://pulpito.ceph.com/yuriw-2021-06-22_18:08:28-krbd-nautilus-testing-bas...
On Tue, Jun 22, 2021 at 10:58 AM Ilya Dryomov <idryomov@gmail.com> wrote:
On Tue, Jun 22, 2021 at 6:37 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rbd - Ilya? krbd - Ilya?
krbd needs to be rerun -- it is full of infrastructure issues.
Thanks,
Ilya
On Tue, Jun 22, 2021 at 9:16 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Ilya, reruning https://pulpito.ceph.com/yuriw-2021-06-22_18:08:28-krbd-nautilus-testing-bas...
krbd approved. For rbd, there is a suspicious failure that persisted through the rerun: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-21_15:45:39-rbd-nautilus-d... http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-22_15:18:36-rbd-nautilus-d... Looking... Thanks, Ilya
On Tue, Jun 22, 2021 at 10:58 AM Ilya Dryomov <idryomov@gmail.com> wrote:
On Tue, Jun 22, 2021 at 6:37 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rbd - Ilya? krbd - Ilya?
krbd needs to be rerun -- it is full of infrastructure issues.
Thanks,
Ilya
On Wed, Jun 23, 2021 at 05:56:00PM +0200, Ilya Dryomov wrote:
For rbd, there is a suspicious failure that persisted through the rerun:
http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-21_15:45:39-rbd-nautilus-d... http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-22_15:18:36-rbd-nautilus-d...
Just FYI, it is also reproducible on v14.2.21 (sha1: 5ef401921d7a88aea18ec7558f7f9374ebd8f5a6): http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_16:42:49-rbd-wip-mgol... So it does not look like a regression. I was able to reproduce it on centos only while on ubuntu it always passed for me. -- Mykola Golub
On Fri, Jun 25, 2021 at 7:00 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Wed, Jun 23, 2021 at 05:56:00PM +0200, Ilya Dryomov wrote:
For rbd, there is a suspicious failure that persisted through the rerun:
http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-21_15:45:39-rbd-nautilus-d... http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-22_15:18:36-rbd-nautilus-d...
Just FYI, it is also reproducible on v14.2.21 (sha1: 5ef401921d7a88aea18ec7558f7f9374ebd8f5a6):
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_16:42:49-rbd-wip-mgol...
So it does not look like a regression. I was able to reproduce it on centos only while on ubuntu it always passed for me.
Yuri's successful run which didn't include the last couple of rbd PRs was also on ubuntu. But I do see a green centos job among your runs so it doesn't appear to be OS specific: http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_15:01:11-rbd-wip-mgol... Filed https://tracker.ceph.com/issues/51362 with the (so far scarce) details. Thanks, Ilya
On Fri, Jun 25, 2021 at 11:19:25AM +0200, Ilya Dryomov wrote:
On Fri, Jun 25, 2021 at 7:00 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Wed, Jun 23, 2021 at 05:56:00PM +0200, Ilya Dryomov wrote:
For rbd, there is a suspicious failure that persisted through the rerun:
http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-21_15:45:39-rbd-nautilus-d... http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-22_15:18:36-rbd-nautilus-d...
Just FYI, it is also reproducible on v14.2.21 (sha1: 5ef401921d7a88aea18ec7558f7f9374ebd8f5a6):
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_16:42:49-rbd-wip-mgol...
So it does not look like a regression. I was able to reproduce it on centos only while on ubuntu it always passed for me.
Yuri's successful run which didn't include the last couple of rbd PRs was also on ubuntu. But I do see a green centos job among your runs so it doesn't appear to be OS specific:
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_15:01:11-rbd-wip-mgol...
Yes it could succeed on centos. What I meant is that I had naver seen it to fail on ubuntu, though I also don't think it is OS specific. It also did not fail when I increased the rbd debug level to track the hang.
Filed https://tracker.ceph.com/issues/51362 with the (so far scarce) details.
Thanks,
Ilya
-- Mykola Golub
While we are waiting for finial rbd approval pls add your commits and apporavls to the Release Notes PR https://github.com/ceph/ceph/pull/41958 Thx On Fri, Jun 25, 2021 at 8:46 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Fri, Jun 25, 2021 at 11:19:25AM +0200, Ilya Dryomov wrote:
On Fri, Jun 25, 2021 at 7:00 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Wed, Jun 23, 2021 at 05:56:00PM +0200, Ilya Dryomov wrote:
For rbd, there is a suspicious failure that persisted through the rerun:
http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-21_15:45:39-rbd-nautilus-d... http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-22_15:18:36-rbd-nautilus-d...
Just FYI, it is also reproducible on v14.2.21 (sha1: 5ef401921d7a88aea18ec7558f7f9374ebd8f5a6):
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_16:42:49-rbd-wip-mgol...
So it does not look like a regression. I was able to reproduce it on centos only while on ubuntu it always passed for me.
Yuri's successful run which didn't include the last couple of rbd PRs was also on ubuntu. But I do see a green centos job among your runs so it doesn't appear to be OS specific:
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_15:01:11-rbd-wip-mgol...
Yes it could succeed on centos. What I meant is that I had naver seen it to fail on ubuntu, though I also don't think it is OS specific. It also did not fail when I increased the rbd debug level to track the hang.
Filed https://tracker.ceph.com/issues/51362 with the (so far scarce) details.
Thanks,
Ilya
-- Mykola Golub
On Fri, Jun 25, 2021 at 9:19 PM Yuri Weinstein <yweinste@redhat.com> wrote:
While we are waiting for finial rbd approval pls add your commits and apporavls to the Release Notes PR
It appears that this bug exists in older nautilus releases (as far back as 14.2.12 at least) and is specific to journaling which is a rather narrow use case. rbd approved. Thanks, Ilya
https://github.com/ceph/ceph/pull/41958
Thx
On Fri, Jun 25, 2021 at 8:46 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Fri, Jun 25, 2021 at 11:19:25AM +0200, Ilya Dryomov wrote:
On Fri, Jun 25, 2021 at 7:00 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Wed, Jun 23, 2021 at 05:56:00PM +0200, Ilya Dryomov wrote:
For rbd, there is a suspicious failure that persisted through the rerun:
http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-21_15:45:39-rbd-nautilus-d... http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-22_15:18:36-rbd-nautilus-d...
Just FYI, it is also reproducible on v14.2.21 (sha1: 5ef401921d7a88aea18ec7558f7f9374ebd8f5a6):
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_16:42:49-rbd-wip-mgol...
So it does not look like a regression. I was able to reproduce it on centos only while on ubuntu it always passed for me.
Yuri's successful run which didn't include the last couple of rbd PRs was also on ubuntu. But I do see a green centos job among your runs so it doesn't appear to be OS specific:
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_15:01:11-rbd-wip-mgol...
Yes it could succeed on centos. What I meant is that I had naver seen it to fail on ubuntu, though I also don't think it is OS specific. It also did not fail when I increased the rbd debug level to track the hang.
Filed https://tracker.ceph.com/issues/51362 with the (so far scarce) details.
Thanks,
Ilya
-- Mykola Golub
Josh this is ready for your final review and publishing . David FYI and https://github.com/ceph/ceph/pull/41958 On Tue, Jun 29, 2021 at 12:50 AM Ilya Dryomov <idryomov@gmail.com> wrote:
On Fri, Jun 25, 2021 at 9:19 PM Yuri Weinstein <yweinste@redhat.com> wrote:
While we are waiting for finial rbd approval pls add your commits and apporavls to the Release Notes PR
It appears that this bug exists in older nautilus releases (as far back as 14.2.12 at least) and is specific to journaling which is a rather narrow use case.
rbd approved.
Thanks,
Ilya
https://github.com/ceph/ceph/pull/41958
Thx
On Fri, Jun 25, 2021 at 8:46 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Fri, Jun 25, 2021 at 11:19:25AM +0200, Ilya Dryomov wrote:
On Fri, Jun 25, 2021 at 7:00 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Wed, Jun 23, 2021 at 05:56:00PM +0200, Ilya Dryomov wrote:
For rbd, there is a suspicious failure that persisted through the rerun:
http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-21_15:45:39-rbd-nautilus-d... http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-22_15:18:36-rbd-nautilus-d...
Just FYI, it is also reproducible on v14.2.21 (sha1: 5ef401921d7a88aea18ec7558f7f9374ebd8f5a6):
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_16:42:49-rbd-wip-mgol...
So it does not look like a regression. I was able to reproduce it on centos only while on ubuntu it always passed for me.
Yuri's successful run which didn't include the last couple of rbd PRs was also on ubuntu. But I do see a green centos job among your runs so it doesn't appear to be OS specific:
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_15:01:11-rbd-wip-mgol...
Yes it could succeed on centos. What I meant is that I had naver seen it to fail on ubuntu, though I also don't think it is OS specific. It also did not fail when I increased the rbd debug level to track the hang.
Filed https://tracker.ceph.com/issues/51362 with the (so far scarce) details.
Thanks,
Ilya
-- Mykola Golub
Looks good to go! Josh On 6/29/21 7:54 AM, Yuri Weinstein wrote:
Josh this is ready for your final review and publishing .
David FYI and https://github.com/ceph/ceph/pull/41958
On Tue, Jun 29, 2021 at 12:50 AM Ilya Dryomov <idryomov@gmail.com> wrote:
On Fri, Jun 25, 2021 at 9:19 PM Yuri Weinstein <yweinste@redhat.com> wrote:
While we are waiting for finial rbd approval pls add your commits and apporavls to the Release Notes PR
It appears that this bug exists in older nautilus releases (as far back as 14.2.12 at least) and is specific to journaling which is a rather narrow use case.
rbd approved.
Thanks,
Ilya
https://github.com/ceph/ceph/pull/41958
Thx
On Fri, Jun 25, 2021 at 8:46 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Fri, Jun 25, 2021 at 11:19:25AM +0200, Ilya Dryomov wrote:
On Fri, Jun 25, 2021 at 7:00 AM Mykola Golub <to.my.trociny@gmail.com> wrote:
On Wed, Jun 23, 2021 at 05:56:00PM +0200, Ilya Dryomov wrote:
> For rbd, there is a suspicious failure that persisted through the > rerun: > > http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-21_15:45:39-rbd-nautilus-d... > http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-22_15:18:36-rbd-nautilus-d...
Just FYI, it is also reproducible on v14.2.21 (sha1: 5ef401921d7a88aea18ec7558f7f9374ebd8f5a6):
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_16:42:49-rbd-wip-mgol...
So it does not look like a regression. I was able to reproduce it on centos only while on ubuntu it always passed for me.
Yuri's successful run which didn't include the last couple of rbd PRs was also on ubuntu. But I do see a green centos job among your runs so it doesn't appear to be OS specific:
http://qa-proxy.ceph.com/teuthology/trociny-2021-06-24_15:01:11-rbd-wip-mgol...
Yes it could succeed on centos. What I meant is that I had naver seen it to fail on ubuntu, though I also don't think it is OS specific. It also did not fail when I increased the rbd debug level to track the hang.
Filed https://tracker.ceph.com/issues/51362 with the (so far scarce) details.
Thanks,
Ilya
-- Mykola Golub
_______________________________________________ clt mailing list -- clt@ceph.io To unsubscribe send an email to clt-leave@ceph.io
On Tue, Jun 22, 2021 at 12:37 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rbd - Ilya? krbd - Ilya?
fs, kcephfs, mutlimds - Patrick, Ramana (please unusually high amount of reds in fs, maybe infra - David FYI )
kcephfs and multimds suites look good. fs suite
ceph-deploy - Josh ?
upgrade/client-upgrade-* - Josh, concur w/rhel 7.6 excluding ?
upgrade/mimic-x (nautilus) - Josh?
upgrade/nautilus-x (octopus) - Josh, Casey?
ceph-volume - Guillaume ?
Thx YuriW _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
On Tue, Jun 22, 2021 at 2:39 PM Ramana Venkatesh Raja <rraja@redhat.com> wrote:
On Tue, Jun 22, 2021 at 12:37 PM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rbd - Ilya? krbd - Ilya?
fs, kcephfs, mutlimds - Patrick, Ramana (please unusually high amount of reds in fs, maybe infra - David FYI )
kcephfs and multimds suites look good.
fs suite
... has run into infra issues. So we need a rerun of the fs suite.
ceph-deploy - Josh ?
upgrade/client-upgrade-* - Josh, concur w/rhel 7.6 excluding ?
upgrade/mimic-x (nautilus) - Josh?
upgrade/nautilus-x (octopus) - Josh, Casey?
ceph-volume - Guillaume ?
Thx YuriW _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
On Tue, Jun 22, 2021 at 9:37 AM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rbd - Ilya? krbd - Ilya?
fs, kcephfs, mutlimds - Patrick, Ramana (please unusually high amount of reds in fs, maybe infra - David FYI )
ceph-deploy - Josh ?
upgrade/client-upgrade-* - Josh, concur w/rhel 7.6 excluding ?
should fine without it
upgrade/mimic-x (nautilus) - Josh?
approved, known issue https://tracker.ceph.com/issues/43048
upgrade/nautilus-x (octopus) - Josh, Casey?
the only failure is https://tracker.ceph.com/issues/51208, I have left analysis in https://tracker.ceph.com/issues/51208#note-6 - need Casey to confirm Thanks, Neha
ceph-volume - Guillaume ?
Thx YuriW _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
On Tue, Jun 22, 2021 at 9:37 AM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rbd - Ilya? krbd - Ilya?
fs, kcephfs, mutlimds - Patrick, Ramana (please unusually high amount of reds in fs, maybe infra - David FYI )
fs/kcephfs/multimds approved. -- Patrick Donnelly, Ph.D. He / Him / His Principal Software Engineer Red Hat Sunnyvale, CA GPG: 19F28A586F808C2402351B93C3301A3E258DD79D
On Thu, Jun 24, 2021 at 9:58 AM Patrick Donnelly <pdonnell@redhat.com> wrote:
On Tue, Jun 22, 2021 at 9:37 AM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rgw approved
rbd - Ilya? krbd - Ilya?
fs, kcephfs, mutlimds - Patrick, Ramana (please unusually high amount of reds in fs, maybe infra - David FYI )
fs/kcephfs/multimds approved.
-- Patrick Donnelly, Ph.D. He / Him / His Principal Software Engineer Red Hat Sunnyvale, CA GPG: 19F28A586F808C2402351B93C3301A3E258DD79D _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
ceph-volume tests passed https://jenkins.ceph.com/job/ceph-volume-test/471/ On Thu, 24 Jun 2021 at 15:58, Patrick Donnelly <pdonnell@redhat.com> wrote:
On Tue, Jun 22, 2021 at 9:37 AM Yuri Weinstein <yweinste@redhat.com> wrote:
Details of this release summarized here:
https://tracker.ceph.com/issues/51268#note-1
At the time of approval and review process we'd like also review and approve the Release Notes
https://github.com/ceph/ceph/pull/41958
Seeking review/approval:
rgw - Casey?
rbd - Ilya? krbd - Ilya?
fs, kcephfs, mutlimds - Patrick, Ramana (please unusually high amount of reds in fs, maybe infra - David FYI )
fs/kcephfs/multimds approved.
-- Patrick Donnelly, Ph.D. He / Him / His Principal Software Engineer Red Hat Sunnyvale, CA GPG: 19F28A586F808C2402351B93C3301A3E258DD79D _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
-- *Guillaume Abrioux*Senior Software Engineer
participants (9)
-
Casey Bodley
-
Guillaume Abrioux
-
Ilya Dryomov
-
Josh Durgin
-
Mykola Golub
-
Neha Ojha
-
Patrick Donnelly
-
Ramana Venkatesh Raja
-
Yuri Weinstein