- ceph-users - lists.ceph.io

Re: v20.2.3 tentacle QE validation status
by Guillaume ABRIOUX 29 Jul '26

29 Jul '26

Hello Yuri, ceph-volume approved Regards, -- Guillaume Abrioux Software Engineer From: Yuri Weinstein via ceph-users <ceph-users(a)ceph.io> Date: Monday, 27 July 2026 at 16:10 To: dev <dev(a)ceph.io>; ceph-users <ceph-users(a)ceph.io> Subject: [EXTERNAL] [ceph-users] v20.2.3 tentacle QE validation status Details of this release are summarized here: https://urldefense.proofpoint.com/v2/url?u=https-3A__tracker.ceph.com_issue… Release Notes - TBD LRC upgrade - TBD *PLEASE ADD YOUR COMMENTS/APPROVALS TO THE TRACKER!* Seeking approvals/reviews for: smoke: PASSED rados: Kamoltat, Afreen, Travis rgw: Adam Emerson fs: Venky orch/ceph-volume: Adam King & Guillaume rbd: Ilya krbd: Ilya nvmeof: Aviv, Vallari upgrade: Kamoltat, Patrick upgrade-clients:client-upgrade-reef-tentacle-tentacle: PASSED upgrade-clients:client-upgrade-squid-tentacle-tentacle: PASSED perf-basic: PASSED crimson-rados: N/A powercycle: PASSED Please reply with your approval or flag any concerns. _______________________________________________ ceph-users mailing list -- ceph-users(a)ceph.io To unsubscribe send an email to ceph-users-leave(a)ceph.io Unless otherwise stated above: Compagnie IBM France Siège Social : 17, avenue de l'Europe, 92275 Bois-Colombes Cedex RCS Nanterre 552 118 465 Forme Sociale : S.A.S. Capital Social : 664 614 175,50 € SIRET : 552 118 465 03644 - Code NAF 6203Z

1 0

Re: Mounting CephFS on Ceph nodes themselves
by Dan van der Ster 29 Jul '26

29 Jul '26

On Wed, Jul 29, 2026 at 4:01 AM Gregory Farnum via ceph-users <ceph-users(a)ceph.io> wrote: > > On Tue, Jul 28, 2026 at 3:05 AM Janne Johansson via ceph-users > <ceph-users(a)ceph.io> wrote: > > > > I think the idea was that if you mount cephfs on a box running OSDs or a > > mon daemon, and it gets into some kind of trouble like running out of > > memory or so, then both the client side and the "server" side might be > > competing for the same resources that aren't there, making it worse. > > This is a classic problem in network filesystems: > 1) The kernel runs out of memory and needs to flush out buffered > writes to free up space > 2) The client sends out a network message, which comes back in to the server > 3) The server needs to allocate memory to handle the incoming network message > 4) ...stuck > > RBD and CephFS are susceptible to this, if you mount the kernels on > the same hosts as the OSDs. But the odds of hitting it are a lot lower > on modern systems with their RAM capacities than in the past. It's been a couple of years, but I was still hitting this deadlock on el8 kernels with CephFS / ceph-osd co-located alongside some HPC-type MPI jobs. It's like Greg wrote -- a large client read/write that comes back to an OSD on the same host deadlocks the box. Cheers, Dan > -Greg > > > > > If you have separate OSD hosts and they are having issues, then cephfs > > clients will be slow, but not much more than that, and if clients are > > having resource dips, a separate cluster doesn't mind at all. I think that > > is where the non-recommendation comes from, in case you do combine them, it > > will be hard to get out of this situation, any cpu/ram given to the client > > side would cause more IO to be requested, from the server side that doesn't > > have it. In any case it might make it lots harder to diagnose which end > > actually caused the issue if both suffer at the same time. > > > > > > > > Den tis 28 juli 2026 kl 14:45 skrev Marek Szuba via ceph-users < > > ceph-users(a)ceph.io>: > > > > > Dear fellow Cephies, > > > > > > A few weeks ago I came across in Tentacle documentation on docs.ceph.org > > > (and OF COURSE now that I'm trying to quote it, I cannot find it any > > > more) a mention that CephFS should not be mounted on systems serving > > > Ceph because of there being a risk of harmful interference in the > > > kernel. The context suggested this pertained to one-node Ceph clusters, > > > that said I do not believe that was explicitly stated. Therefore, I very > > > much hope someone will be able to enlighten me whether: > > > > > > * this is indeed still the case with Tentacle, > > > > > > * it applies to one-node clusters only or all Ceph clusters, > > > > > > * it only applies to CephFS mounts using the kernel driver, or ceph-fuse > > > as well. > > > > > > Thank you in advance! > > > > > > -- > > > MS > > > > > > _______________________________________________ > > > ceph-users mailing list -- ceph-users(a)ceph.io > > > To unsubscribe send an email to ceph-users-leave(a)ceph.io > > > > > > > > > -- > > May the most significant bit of your life be positive. > > _______________________________________________ > > ceph-users mailing list -- ceph-users(a)ceph.io > > To unsubscribe send an email to ceph-users-leave(a)ceph.io > > > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io

1 0

Re: Mounting CephFS on Ceph nodes themselves
by Stefan Möding 29 Jul '26

29 Jul '26

Marek Szuba via ceph-users <ceph-users(a)ceph.io> writes: > A few weeks ago I came across in Tentacle documentation on docs.ceph.org > (and OF COURSE now that I'm trying to quote it, I cannot find it any > more) a mention that CephFS should not be mounted on systems serving > Ceph because of there being a risk of harmful interference in the > kernel. The context suggested this pertained to one-node Ceph clusters, > that said I do not believe that was explicitly stated. Therefore, I very > much hope someone will be able to enlighten me whether: Maybe it was this page: https://docs.ceph.com/en/squid/rados/troubleshooting/troubleshooting-pg/ -- Stefan

1 0

Ceph Governing Board Meetings 2026-07-28
by Anthony Middleton 28 Jul '26

28 Jul '26

Hey Ceph friends, I hope you're doing well. Starting now, a portion of our Ceph Governing Board meetings will be recorded and made publicly available each month. This aims to increase transparency and encourage more community participation. You can watch the latest meeting and see the minutes attached below: https://www.youtube.com/watch?v=gPyu9KLVD64. As highlighted in the meeting, there are several committees you can get involved in, like Hardware, Ceph Days, Ceph Ambassadors, and Community Outreach. Feel free to reach out to me if you're interested in connecting with any of the committee leaders. Best, ------- Anthony Middleton Community Manager, Ceph Foundation amiddleton(a)linuxfoundation.org LinkedIn <https://www.linkedin.com/company/ceph>| BlueSky <https://bsky.app/profile/ceph.io> | Twitter <https://x.com/Ceph>

1 0

Re: v20.2.3 tentacle QE validation status
by Kamoltat Sirivadhna 28 Jul '26

28 Jul '26

RADOS Approved On Tue, Jul 28, 2026 at 1:00 PM Adam Emerson via ceph-users < ceph-users(a)ceph.io> wrote: > On 27/07/2026, Yuri Weinstein via dev wrote: > > Details of this release are summarized here: > > https://tracker.ceph.com/issues/77256#note-5 > > > > Release Notes - TBD > > LRC upgrade - TBD > > > > *PLEASE ADD YOUR COMMENTS/APPROVALS TO THE TRACKER!* > > > > Seeking approvals/reviews for: > > > > smoke: PASSED > > > > rados: Kamoltat, Afreen, Travis > > > > rgw: Adam Emerson > > RGW Approved. > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io > > -- Kamoltat (Junior) Sirivadhna (HE/HIM) Senior SoftWare Engineer - IBM Ceph Storage ksirivad(a)redhat.com T: (857) <(919)716-5348>253-8927

1 0

Re: Mounting CephFS on Ceph nodes themselves
by Gregory Farnum 28 Jul '26

28 Jul '26

On Tue, Jul 28, 2026 at 3:05 AM Janne Johansson via ceph-users <ceph-users(a)ceph.io> wrote: > > I think the idea was that if you mount cephfs on a box running OSDs or a > mon daemon, and it gets into some kind of trouble like running out of > memory or so, then both the client side and the "server" side might be > competing for the same resources that aren't there, making it worse. This is a classic problem in network filesystems: 1) The kernel runs out of memory and needs to flush out buffered writes to free up space 2) The client sends out a network message, which comes back in to the server 3) The server needs to allocate memory to handle the incoming network message 4) ...stuck RBD and CephFS are susceptible to this, if you mount the kernels on the same hosts as the OSDs. But the odds of hitting it are a lot lower on modern systems with their RAM capacities than in the past. -Greg > > If you have separate OSD hosts and they are having issues, then cephfs > clients will be slow, but not much more than that, and if clients are > having resource dips, a separate cluster doesn't mind at all. I think that > is where the non-recommendation comes from, in case you do combine them, it > will be hard to get out of this situation, any cpu/ram given to the client > side would cause more IO to be requested, from the server side that doesn't > have it. In any case it might make it lots harder to diagnose which end > actually caused the issue if both suffer at the same time. > > > > Den tis 28 juli 2026 kl 14:45 skrev Marek Szuba via ceph-users < > ceph-users(a)ceph.io>: > > > Dear fellow Cephies, > > > > A few weeks ago I came across in Tentacle documentation on docs.ceph.org > > (and OF COURSE now that I'm trying to quote it, I cannot find it any > > more) a mention that CephFS should not be mounted on systems serving > > Ceph because of there being a risk of harmful interference in the > > kernel. The context suggested this pertained to one-node Ceph clusters, > > that said I do not believe that was explicitly stated. Therefore, I very > > much hope someone will be able to enlighten me whether: > > > > * this is indeed still the case with Tentacle, > > > > * it applies to one-node clusters only or all Ceph clusters, > > > > * it only applies to CephFS mounts using the kernel driver, or ceph-fuse > > as well. > > > > Thank you in advance! > > > > -- > > MS > > > > _______________________________________________ > > ceph-users mailing list -- ceph-users(a)ceph.io > > To unsubscribe send an email to ceph-users-leave(a)ceph.io > > > > > -- > May the most significant bit of your life be positive. > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io >

1 0

Re: Mounting CephFS on Ceph nodes themselves
by Malte Stroem 28 Jul '26

28 Jul '26

Hi, you can mount it on the Ceph nodes. You can mount it everywhere. Best, Malte On 7/28/26 14:48, Marek Szuba via ceph-users wrote: > Dear fellow Cephies, > > A few weeks ago I came across in Tentacle documentation on docs.ceph.org > (and OF COURSE now that I'm trying to quote it, I cannot find it any > more) a mention that CephFS should not be mounted on systems serving > Ceph because of there being a risk of harmful interference in the > kernel. The context suggested this pertained to one-node Ceph clusters, > that said I do not believe that was explicitly stated. Therefore, I very > much hope someone will be able to enlighten me whether: > > * this is indeed still the case with Tentacle, > > * it applies to one-node clusters only or all Ceph clusters, > > * it only applies to CephFS mounts using the kernel driver, or ceph-fuse > as well. > > Thank you in advance! >

1 0

Re: v20.2.3 tentacle QE validation status
by Adam Emerson 28 Jul '26

28 Jul '26

On 27/07/2026, Yuri Weinstein via dev wrote: > Details of this release are summarized here: > https://tracker.ceph.com/issues/77256#note-5 > > Release Notes - TBD > LRC upgrade - TBD > > *PLEASE ADD YOUR COMMENTS/APPROVALS TO THE TRACKER!* > > Seeking approvals/reviews for: > > smoke: PASSED > > rados: Kamoltat, Afreen, Travis > > rgw: Adam Emerson RGW Approved.

1 0

Re: Mounting CephFS on Ceph nodes themselves
by Janne Johansson 28 Jul '26

28 Jul '26

I think the idea was that if you mount cephfs on a box running OSDs or a mon daemon, and it gets into some kind of trouble like running out of memory or so, then both the client side and the "server" side might be competing for the same resources that aren't there, making it worse. If you have separate OSD hosts and they are having issues, then cephfs clients will be slow, but not much more than that, and if clients are having resource dips, a separate cluster doesn't mind at all. I think that is where the non-recommendation comes from, in case you do combine them, it will be hard to get out of this situation, any cpu/ram given to the client side would cause more IO to be requested, from the server side that doesn't have it. In any case it might make it lots harder to diagnose which end actually caused the issue if both suffer at the same time. Den tis 28 juli 2026 kl 14:45 skrev Marek Szuba via ceph-users < ceph-users(a)ceph.io>: > Dear fellow Cephies, > > A few weeks ago I came across in Tentacle documentation on docs.ceph.org > (and OF COURSE now that I'm trying to quote it, I cannot find it any > more) a mention that CephFS should not be mounted on systems serving > Ceph because of there being a risk of harmful interference in the > kernel. The context suggested this pertained to one-node Ceph clusters, > that said I do not believe that was explicitly stated. Therefore, I very > much hope someone will be able to enlighten me whether: > > * this is indeed still the case with Tentacle, > > * it applies to one-node clusters only or all Ceph clusters, > > * it only applies to CephFS mounts using the kernel driver, or ceph-fuse > as well. > > Thank you in advance! > > -- > MS > > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io > -- May the most significant bit of your life be positive.

1 0

Mounting CephFS on Ceph nodes themselves
by Marek Szuba 28 Jul '26

28 Jul '26

Dear fellow Cephies, A few weeks ago I came across in Tentacle documentation on docs.ceph.org (and OF COURSE now that I'm trying to quote it, I cannot find it any more) a mention that CephFS should not be mounted on systems serving Ceph because of there being a risk of harmful interference in the kernel. The context suggested this pertained to one-node Ceph clusters, that said I do not believe that was explicitly stated. Therefore, I very much hope someone will be able to enlighten me whether: * this is indeed still the case with Tentacle, * it applies to one-node clusters only or all Ceph clusters, * it only applies to CephFS mounts using the kernel driver, or ceph-fuse as well. Thank you in advance! -- MS

1 0