16 Feb
2021
16 Feb
'21
8:12 p.m.
For the past several months I had been building a sizable Ceph cluster that
will be up to 10PB with between 20 and 40 OSD servers this year.
A few weeks ago I was informed that SUSE is shutting down SES and will no
longer be selling it. We haven't licensed our proof of concept cluster
that is currently at 14 OSD nodes, but it looks like SUSE is not going to
be the answer here.
I'm seeking recommendations for consulting help on this project since SUSE
has let me down.
I have Ceph installed and operating, however, I've been struggling with
getting the pool configured properly for CephFS and getting very poor
performance. The OSD servers have TLC NVMe for DB, and Optane NVMe for
WAL, so I should be seeing decent performance with the current cluster.
I'm not opposed to completely switching OS distributions. Ceph on SUSE was
our first SUSE installation. Almost everything else we run is on CentOS,
but that may change thanks to IBM cannibalizing CentOS.
Please reach out to me if you can recommend someone to sell us consulting
hours and/or a support contract.
-Chip Schweiss
chip.schweiss(a)wustl.edu
Washington University School of Medicine
16 Feb
16 Feb
8:14 p.m.
These guys are great.
[ https://croit.io/ | https://croit.io/ ]
From: "Schweiss, Chip" <chip(a)innovates.com>
To: "ceph-users" <ceph-users(a)ceph.io>
Sent: Tuesday, February 16, 2021 9:42:24 AM
Subject: [ceph-users] SUSE POC - Dead in the water
For the past several months I had been building a sizable Ceph cluster that
will be up to 10PB with between 20 and 40 OSD servers this year.
A few weeks ago I was informed that SUSE is shutting down SES and will no
longer be selling it. We haven't licensed our proof of concept cluster
that is currently at 14 OSD nodes, but it looks like SUSE is not going to
be the answer here.
I'm seeking recommendations for consulting help on this project since SUSE
has let me down.
I have Ceph installed and operating, however, I've been struggling with
getting the pool configured properly for CephFS and getting very poor
performance. The OSD servers have TLC NVMe for DB, and Optane NVMe for
WAL, so I should be seeing decent performance with the current cluster.
I'm not opposed to completely switching OS distributions. Ceph on SUSE was
our first SUSE installation. Almost everything else we run is on CentOS,
but that may change thanks to IBM cannibalizing CentOS.
Please reach out to me if you can recommend someone to sell us consulting
hours and/or a support contract.
-Chip Schweiss
chip.schweiss(a)wustl.edu
Washington University School of Medicine
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
8:24 p.m.
Not nice to hear, similar to centos I guess. For now I am sticking to my centos7 till it
is eol. So I have a few years left to decide. You can of course get an el7/el8 license, I
think you will be having the best match.
Maybe in a few years the distribution does not matter any more, because everything will be
running in container images.
-----Original Message-----
Sent: 16 February 2021 15:42
To: ceph-users(a)ceph.io
Subject: [ceph-users] SUSE POC - Dead in the water
For the past several months I had been building a sizable Ceph cluster
that
will be up to 10PB with between 20 and 40 OSD servers this year.
A few weeks ago I was informed that SUSE is shutting down SES and will
no
longer be selling it. We haven't licensed our proof of concept cluster
that is currently at 14 OSD nodes, but it looks like SUSE is not going
to
be the answer here.
I'm seeking recommendations for consulting help on this project since
SUSE
has let me down.
I have Ceph installed and operating, however, I've been struggling with
getting the pool configured properly for CephFS and getting very poor
performance. The OSD servers have TLC NVMe for DB, and Optane NVMe for
WAL, so I should be seeing decent performance with the current cluster.
I'm not opposed to completely switching OS distributions. Ceph on SUSE
was
our first SUSE installation. Almost everything else we run is on
CentOS,
but that may change thanks to IBM cannibalizing CentOS.
Please reach out to me if you can recommend someone to sell us
consulting
hours and/or a support contract.
-Chip Schweiss
chip.schweiss(a)wustl.edu
Washington University School of Medicine
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
9:17 p.m.
Hi Chip,
Regarding CephFS performance, it really depends on the io patterns and
what you are trying to accomplish. Can you talk a little bit more about
what you are seeing?
Thanks,
Mark
On 2/16/21 8:42 AM, Schweiss, Chip wrote:
For the past several months I had been building a
sizable Ceph cluster that
will be up to 10PB with between 20 and 40 OSD servers this year.
A few weeks ago I was informed that SUSE is shutting down SES and will no
longer be selling it. We haven't licensed our proof of concept cluster
that is currently at 14 OSD nodes, but it looks like SUSE is not going to
be the answer here.
I'm seeking recommendations for consulting help on this project since SUSE
has let me down.
I have Ceph installed and operating, however, I've been struggling with
getting the pool configured properly for CephFS and getting very poor
performance. The OSD servers have TLC NVMe for DB, and Optane NVMe for
WAL, so I should be seeing decent performance with the current cluster.
I'm not opposed to completely switching OS distributions. Ceph on SUSE was
our first SUSE installation. Almost everything else we run is on CentOS,
but that may change thanks to IBM cannibalizing CentOS.
Please reach out to me if you can recommend someone to sell us consulting
hours and/or a support contract.
-Chip Schweiss
chip.schweiss(a)wustl.edu
Washington University School of Medicine
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
10:12 p.m.
Mark,
We'll see if the problems follow me as I install Croit They gave a very
impressive impromptu presentation shortly after I sent this call for help.
I'll make sure I post some details about our CephFS endeavor as things
progress, it will likely help others as they start their Ceph projects.
-Chip
On Tue, Feb 16, 2021 at 9:48 AM Mark Nelson <mnelson(a)redhat.com> wrote:
Hi Chip,
Regarding CephFS performance, it really depends on the io patterns and
what you are trying to accomplish. Can you talk a little bit more about
what you are seeing?
Thanks,
Mark
On 2/16/21 8:42 AM, Schweiss, Chip wrote:
For the past several months I had been building a
sizable Ceph cluster
that
will be up to 10PB with between 20 and 40 OSD
servers this year.
A few weeks ago I was informed that SUSE is shutting down SES and will no
longer be selling it. We haven't licensed our proof of concept cluster
that is currently at 14 OSD nodes, but it looks like SUSE is not going to
be the answer here.
I'm seeking recommendations for consulting help on this project since
SUSE
has let me down.
I have Ceph installed and operating, however, I've been struggling with
getting the pool configured properly for CephFS and getting very poor
performance. The OSD servers have TLC NVMe for DB, and Optane NVMe for
WAL, so I should be seeing decent performance with the current cluster.
I'm not opposed to completely switching OS distributions. Ceph on SUSE
was
our first SUSE installation. Almost everything
else we run is on
CentOS,
but that may change thanks to IBM cannibalizing
CentOS.
Please reach out to me if you can recommend someone to sell us consulting
hours and/or a support contract.
-Chip Schweiss
chip.schweiss(a)wustl.edu
Washington University School of Medicine
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
10:24 p.m.
Ehhh I think they are using the standard ceph versions. Your problem with cephfs is a more
a matter of configuring/setup, and you should be able solve that (and have similar
results) with any distribution.
-----Original Message-----
From: Schweiss, Chip <chip(a)innovates.com>
Sent: 16 February 2021 17:43
To: Mark Nelson <mnelson(a)redhat.com>
Cc: ceph-users(a)ceph.io
Subject: [ceph-users] Re: SUSE POC - Dead in the water
Mark,
We'll see if the problems follow me as I install Croit They gave a
very
impressive impromptu presentation shortly after I sent this call for
help.
I'll make sure I post some details about our CephFS endeavor as things
progress, it will likely help others as they start their Ceph projects.
-Chip
On Tue, Feb 16, 2021 at 9:48 AM Mark Nelson <mnelson(a)redhat.com> wrote:
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
Hi Chip,
Regarding CephFS performance, it really depends on the io patterns and
what you are trying to accomplish. Can you talk a little bit more
about
what you are seeing?
Thanks,
Mark
On 2/16/21 8:42 AM, Schweiss, Chip wrote:
> For the past several months I had been building a sizable Ceph
cluster
that
> will be up to 10PB with between 20 and 40 OSD servers this year.
>
> A few weeks ago I was informed that SUSE is shutting down SES and
will no
> longer be selling it. We haven't
licensed our proof of concept
cluster
> that is currently at 14 OSD nodes, but it
looks like SUSE is not
going to
> be the answer here.
>
> I'm seeking recommendations for consulting help on this project
since
SUSE
> has let me down.
>
> I have Ceph installed and operating, however, I've been struggling
with
> getting the pool configured properly for
CephFS and getting very
poor
> performance. The OSD servers have TLC NVMe
for DB, and Optane NVMe
for
> WAL, so I should be seeing decent
performance with the current
cluster.
>
> I'm not opposed to completely switching OS distributions. Ceph on
SUSE
was
consulting
our first SUSE installation. Almost everything
else we run is on
CentOS,
> but that may change thanks to IBM cannibalizing CentOS.
>
> Please reach out to me if you can recommend someone to sell us
hours
and/or a support contract.
-Chip Schweiss
chip.schweiss(a)wustl.edu
Washington University School of Medicine
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
10:34 p.m.
Hi Chip,
Glad to hear it! From an upstream perspective we've got a pretty good
idea of some of the bottlenecks in the MDS and others in the
OSD/Bluestore, but it's always nice to hear what folks are struggling
with out in the field to challenge our assumptions.
Best of luck!
Mark
On 2/16/21 10:42 AM, Schweiss, Chip wrote:
Mark,
We'll see if the problems follow me as I install Croit They gave a
very impressive impromptu presentation shortly after I sent this call
for help.
I'll make sure I post some details about our CephFS endeavor as things
progress, it will likely help others as they start their Ceph projects.
-Chip
On Tue, Feb 16, 2021 at 9:48 AM Mark Nelson <mnelson(a)redhat.com
<mailto:mnelson@redhat.com>> wrote:
Hi Chip,
Regarding CephFS performance, it really depends on the io patterns
and
what you are trying to accomplish. Can you talk a little bit more
about
what you are seeing?
Thanks,
Mark
On 2/16/21 8:42 AM, Schweiss, Chip wrote:
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
<mailto:ceph-users@ceph.io>
To unsubscribe send an email to ceph-users-leave(a)ceph.io
<mailto:ceph-users-leave@ceph.io>
For the past several months I had been building a
sizable Ceph
cluster that
will be up to 10PB with between 20 and 40 OSD
servers this year.
A few weeks ago I was informed that SUSE is shutting down SES
and will no
longer be selling it. We haven't licensed
our proof of concept
cluster
that is currently at 14 OSD nodes, but it looks
like SUSE is not
going to
be the answer here.
I'm seeking recommendations for consulting help on this project
since
SUSE
has let me down.
I have Ceph installed and operating, however, I've been
struggling with
getting the pool configured properly for CephFS
and getting very
poor
performance. The OSD servers have TLC NVMe for
DB, and Optane
NVMe for
WAL, so I should be seeing decent performance
with the current
cluster.
I'm not opposed to completely switching OS distributions. Ceph
on SUSE
was
our first SUSE installation. Almost everything
else we run is
on CentOS,
but that may change thanks to IBM cannibalizing
CentOS.
Please reach out to me if you can recommend someone to sell us
consulting
hours and/or a support contract.
-Chip Schweiss
chip.schweiss(a)wustl.edu <mailto:chip.schweiss@wustl.edu>
Washington University School of Medicine
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
<mailto:ceph-users@ceph.io>
To unsubscribe send an email to
ceph-users-leave(a)ceph.io
<mailto:ceph-users-leave@ceph.io>
1165
days inactive
1165
days old
6 comments
4 participants
participants (4)
-
Adam Boyhan -
Marc -
Mark Nelson -
Schweiss, Chip