Hi guys, what distro would you prefer and why for the production Ceph? We use Ubuntu on most of our Ceph clusters and some are Debian. Now we are thinking about unifying it by using only Debian or Ubuntu. I personally prefer Debian mainly for its stability and easy upgrade-in-place. What are yours preferences? Thank you
Didn't you already got the answer from the reddit thread? https://www.reddit.com/r/ceph/comments/1f88u6m/prefered_distro_for_ceph/ I always point here: https://docs.ceph.com/en/latest/start/os-recommendations/ and we are running very well with Ubuntu with, and without, the orchestrator. Am Do., 5. Sept. 2024 um 12:26 Uhr schrieb Denis Polom <denispolom@gmail.com
:
Hi guys,
what distro would you prefer and why for the production Ceph? We use Ubuntu on most of our Ceph clusters and some are Debian. Now we are thinking about unifying it by using only Debian or Ubuntu.
I personally prefer Debian mainly for its stability and easy upgrade-in-place. What are yours preferences?
Thank you _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groüen Saal.
Hi, I never tried anything else than debian. On 9/5/24 12:33 PM, Boris wrote:
Didn't you already got the answer from the reddit thread? https://www.reddit.com/r/ceph/comments/1f88u6m/prefered_distro_for_ceph/
I always point here: https://docs.ceph.com/en/latest/start/os-recommendations/ and we are running very well with Ubuntu with, and without, the orchestrator.
Am Do., 5. Sept. 2024 um 12:26 Uhr schrieb Denis Polom <denispolom@gmail.com
: Hi guys,
what distro would you prefer and why for the production Ceph? We use Ubuntu on most of our Ceph clusters and some are Debian. Now we are thinking about unifying it by using only Debian or Ubuntu.
I personally prefer Debian mainly for its stability and easy upgrade-in-place. What are yours preferences?
Thank you _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Have been running on Centos/RHEL for ~5 years and not had any issues either. ________________________________ From: Roberto Maggi @ Debian <debian108@gmail.com> Sent: Thursday, September 5, 2024 12:58 PM To: ceph-users@ceph.io <ceph-users@ceph.io> Subject: [EXTERNAL] [ceph-users] Re: Prefered distro for Ceph Hi, I never tried anything else than debian. On 9/5/24 12:33 PM, Boris wrote:
I always point here: https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.ceph.com%2Fen%2Flatest%2Fstart%2Fos-recommendations%2F&data=05%7C02%7Calexhus%40microsoft.com%7C0aa7bbd769e34dc96a6408dccda217b4%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638611343343078625%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=MwuN1Nm10vTbx2%2BMxT0H64vuduWypY32fW7nDrvElGc%3D&reserved=0<https://docs.ceph.com/en/latest/start/os-recommendations/> and we are running very well with Ubuntu with, and without, the orchestrator.
Am Do., 5. Sept. 2024 um 12:26 Uhr schrieb Denis Polom <denispolom@gmail.com
: Hi guys,
what distro would you prefer and why for the production Ceph? We use Ubuntu on most of our Ceph clusters and some are Debian. Now we are thinking about unifying it by using only Debian or Ubuntu.
I personally prefer Debian mainly for its stability and easy upgrade-in-place. What are yours preferences?
Thank you _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
I personally prefer Ubuntu. I like RPM / YUM better than APT / DEB, but Ubuntu provides a far richer set of prebuilt packages, obviating the mess that is EPEL and most of the need to compile and package myself. Ubuntu's kernels are also far more current than those of the RHEL family. I've been forced in RHEL land to use elrepo-kernel kernels, but potentially with certain issues. Stability is IMHO a factor of how you deploy, not of the distribution itself. Maintain local snapshots of the upstream package repositories, and deploy against those. That way all your systems have a consistent set of package revisions, which you control, vs whatever upstream has on a given day. ymmv.
On Sep 5, 2024, at 6:25 AM, Denis Polom <denispolom@gmail.com> wrote:
Hi guys,
what distro would you prefer and why for the production Ceph? We use Ubuntu on most of our Ceph clusters and some are Debian. Now we are thinking about unifying it by using only Debian or Ubuntu.
I personally prefer Debian mainly for its stability and easy upgrade-in-place. What are yours preferences?
Thank you _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
I started with arch-linux & Mimic but it was all manual deployment and development. It takes too much time and requires knowledge. My custom distro worked 4-5 years flawlessly until I hit a rolling-release update problem at one point. These days I use Ubuntu for easy setup and enjoy the pre-tested ceph docker images and auto update. But few months ago with new Ubuntu updates I lost speed and weird problems began like high OSD latency. The root cause was udev, multipath, and scsi related updates against my old ssd drives. Advanced Distros has too many add-ons and I hate it, they always generate weird problems. Try to use minimal distros without weird tunings and complicated extra packages. I think what matters is knowledge on how to select and tune correct kernel versions for your hardware and ceph version. I wonder about SUSE performance. I think it might be a better choice than Ubuntu for Ceph. Any opinions ? Regards. Anthony D'Atri <aad@dreamsnake.net>, 5 Eyl 2024 Per, 16:51 tarihinde şunu yazdı:
I personally prefer Ubuntu.
I like RPM / YUM better than APT / DEB, but Ubuntu provides a far richer set of prebuilt packages, obviating the mess that is EPEL and most of the need to compile and package myself. Ubuntu's kernels are also far more current than those of the RHEL family. I've been forced in RHEL land to use elrepo-kernel kernels, but potentially with certain issues.
Stability is IMHO a factor of how you deploy, not of the distribution itself. Maintain local snapshots of the upstream package repositories, and deploy against those. That way all your systems have a consistent set of package revisions, which you control, vs whatever upstream has on a given day.
ymmv.
On Sep 5, 2024, at 6:25 AM, Denis Polom <denispolom@gmail.com> wrote:
Hi guys,
what distro would you prefer and why for the production Ceph? We use Ubuntu on most of our Ceph clusters and some are Debian. Now we are thinking about unifying it by using only Debian or Ubuntu.
I personally prefer Debian mainly for its stability and easy upgrade-in-place. What are yours preferences?
Thank you _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Le 05/09/2024 à 12:25:24+0200, Denis Polom a écrit Hi,
what distro would you prefer and why for the production Ceph? We use Ubuntu on most of our Ceph clusters and some are Debian. Now we are thinking about unifying it by using only Debian or Ubuntu.
I personally prefer Debian mainly for its stability and easy upgrade-in-place. What are yours preferences?
I'm not the right person to answer you, I just wondering why not use the orchestrator ? Regards JAS -- Albert SHIH 🦫 🐸 Observatoire de Paris Heure locale/Local time: jeu. 05 sept. 2024 15:55:45 CEST
The bare metal has to run *something*, whether Ceph is run from packages or containers.
what distro would you prefer and why for the production Ceph? We use Ubuntu on most of our Ceph clusters and some are Debian. Now we are thinking about unifying it by using only Debian or Ubuntu.
I personally prefer Debian mainly for its stability and easy upgrade-in-place. What are yours preferences?
I'm not the right person to answer you, I just wondering why not use the orchestrator ?
Regards
JAS --
Le 05/09/2024 à 11:06:27-0400, Anthony D'Atri a écrit Hi,
The bare metal has to run *something*, whether Ceph is run from packages or containers.
Yes absolutly. But If you use podman/docker you don't have to really care about the compatibility problem between your linux flavor with Ceph (well almost). So I'm running Debian just because is the one I'm most familiar with, and I'm running ceph with podman. I'm new with ceph so I just like to know if they are any downside to do that. Regards. -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 05 sept. 2024 17:07:17 CEST
Not at all, you're doing the right thing. That's exactly how I would do things if I were setting out to deploy Ceph on bare metal today. Pick a very stable underlying distribution and run Ceph in containers. That's exactly what I'm doing on a massive scale, and it's been one of the best decisions I've ever made. David On Thu, Sep 5, 2024, at 10:09, Albert Shih wrote:
Le 05/09/2024 à 11:06:27-0400, Anthony D'Atri a écrit
Hi,
The bare metal has to run *something*, whether Ceph is run from packages or containers.
Yes absolutly. But If you use podman/docker you don't have to really care about the compatibility problem between your linux flavor with Ceph (well almost).
So I'm running Debian just because is the one I'm most familiar with, and I'm running ceph with podman.
I'm new with ceph so I just like to know if they are any downside to do that.
Regards.
-- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 05 sept. 2024 17:07:17 CEST _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
David I agree. I always recommend using the stable Linux distro you normally use and run ceph in containers. David Orman <ormandj@corenode.com> schrieb am Fr., 6. Sept. 2024, 09:33:
Not at all, you're doing the right thing. That's exactly how I would do things if I were setting out to deploy Ceph on bare metal today. Pick a very stable underlying distribution and run Ceph in containers. That's exactly what I'm doing on a massive scale, and it's been one of the best decisions I've ever made.
David
Le 05/09/2024 à 11:06:27-0400, Anthony D'Atri a écrit
Hi,
The bare metal has to run *something*, whether Ceph is run from
On Thu, Sep 5, 2024, at 10:09, Albert Shih wrote: packages or containers.
Yes absolutly. But If you use podman/docker you don't have to really care about the compatibility problem between your linux flavor with Ceph
(well
almost).
So I'm running Debian just because is the one I'm most familiar with, and I'm running ceph with podman.
I'm new with ceph so I just like to know if they are any downside to do that.
Regards.
-- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 05 sept. 2024 17:07:17 CEST _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (9)
-
Albert Shih
-
Alex Hussein-Kershaw (HE/HIM)
-
Anthony D'Atri
-
Boris
-
David Orman
-
Denis Polom
-
Joachim Kraftmayer
-
Roberto Maggi ＠ Debian
-
Özkan Göksu