Seeking Participation! Take the new Ceph User Stores Survey!
Hi all, The Ceph User Council is conducting a survey to gather insights from community members who actively use production Ceph clusters. We want to hear directly from you: *What is the use case of your production Ceph cluster?* Since its official Argonaut release in 2012, Ceph has grown significantly in features and user adoption. By learning about your use cases, we aim to understand Ceph’s strengths and limitations in performance, scalability, and usability. This feedback will help inform future improvements to Ceph. Our ultimate goal is to enhance the Ceph community's shared knowledge by publishing real-world user stories on our website. These stories will serve as valuable resources for both current and future users, demonstrating the diversity and potential of Ceph in production environments. All responses are anonymous unless the participant willingly shares their contact information. The Ceph User Council will contact participants who opt to share their contact information before anything is officially published. We have not yet determined when the survey will close, but we will give a heads up before doing so. Take the survey here! https://docs.google.com/forms/d/e/1FAIpQLSe66NedXh4gHLgk9G45eqP5V2wHlz4IKqRm... Thanks, Laura Flores -- Laura Flores She/Her/Hers Software Engineer, Ceph Storage <https://ceph.io> Chicago, IL lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
Correction: "Stories", not "Stores" in the subject. :) On Tue, Jan 21, 2025 at 10:43 AM Laura Flores <lflores@redhat.com> wrote:
Hi all,
The Ceph User Council is conducting a survey to gather insights from community members who actively use production Ceph clusters. We want to hear directly from you: *What is the use case of your production Ceph cluster?*
Since its official Argonaut release in 2012, Ceph has grown significantly in features and user adoption. By learning about your use cases, we aim to understand Ceph’s strengths and limitations in performance, scalability, and usability. This feedback will help inform future improvements to Ceph.
Our ultimate goal is to enhance the Ceph community's shared knowledge by publishing real-world user stories on our website. These stories will serve as valuable resources for both current and future users, demonstrating the diversity and potential of Ceph in production environments.
All responses are anonymous unless the participant willingly shares their contact information. The Ceph User Council will contact participants who opt to share their contact information before anything is officially published. We have not yet determined when the survey will close, but we will give a heads up before doing so.
Take the survey here! https://docs.google.com/forms/d/e/1FAIpQLSe66NedXh4gHLgk9G45eqP5V2wHlz4IKqRm...
Thanks, Laura Flores
--
Laura Flores
She/Her/Hers
Software Engineer, Ceph Storage <https://ceph.io>
Chicago, IL
lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
-- Laura Flores She/Her/Hers Software Engineer, Ceph Storage <https://ceph.io> Chicago, IL lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
On Tue, Jan 21, 2025 at 10:43:13AM -0600, Laura Flores wrote:
Hi all,
The Ceph User Council is conducting a survey to gather insights from community members who actively use production Ceph clusters. We want to hear directly from you: *What is the use case of your production Ceph cluster?* As fast feedback when I passed the survey on to somebody else - to improve responses, if CUC can offer commands to make it easier to grab some of the quantitative data:
Do you have the pg autoscaler enabled? How many OSDs per node are you using? How many clients are reading/writing from the Ceph cluster in parallel? How many nodes are in your largest Ceph cluster? How many placement groups (PGs) per OSD are you using? What is the size of the largest files being stored in your Ceph cluster(s)? What is the size of the largest objects being stored in your Ceph cluster(s)? What is the size of your largest Ceph cluster? What’s the average Read/Write ratio/percentage in your workload? And an additional guidance - if you have multiple Ceph clusters, how should the form be answered? I think some of these were also previously decided in other survey efforts, and could be reused? -- Robin Hugh Johnson Gentoo Linux: Dev, Infra Lead, Foundation Treasurer E-Mail : robbat2@gentoo.org GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136
Hi Robin, As fast feedback when I passed the survey on to somebody else - to
improve responses, if CUC can offer commands to make it easier to grab some of the quantitative data:
Do you have the pg autoscaler enabled?
How many OSDs per node are you using? How many clients are reading/writing from the Ceph cluster in parallel? How many nodes are in your largest Ceph cluster? How many placement groups (PGs) per OSD are you using? What is the size of the largest files being stored in your Ceph cluster(s)? What is the size of the largest objects being stored in your Ceph cluster(s)? What is the size of your largest Ceph cluster? What’s the average Read/Write ratio/percentage in your workload?
Thanks for the suggestions! I updated the survey to address all but three of these queries, which I need to check on. Here are the ones I updated: 1. Do you have the pg autoscaler enabled? Run `ceph osd pool autoscale-status` and check to see if "AUTOSCALE" is on for any of your pools. 2. How many OSDs per node are you using? Run `ceph osd tree` to check this. 3. How many nodes are in your largest Ceph cluster? Run `ceph osd tree` to check this. 4. How many placement groups (PGs) per OSD are you using? Run `ceph osd df` and check the "PGS" column. 5. What is the size of your largest Ceph cluster? Run `ceph df` and look at the "TOTAL / SIZE" entry to check for this. 6. What’s the average Read/Write ratio/percentage in your workload? You may check `ceph -s` and look at the "io" section to get a sense of this. I need to check on these three for the best commands: - How many clients are reading/writing from the Ceph cluster in parallel? - What is the size of the largest files being stored in your Ceph cluster(s)? - What is the size of the largest objects being stored in your Ceph cluster(s)? And an additional guidance - if you have multiple Ceph clusters, how
should the form be answered? I think some of these were also previously decided in other survey efforts, and could be reused?
Another good question. We structured the survey so you can elaborate in the text boxes if you have multiple clusters, or we ask in terms of your largest cluster since we are interested in large-scale situations. However, if you would like to take the survey multiple times for multiple clusters, feel free to do so- I would just indicate in the "name/email" question that this is "take 2" etc. of the survey- just somehow make it obvious that it is part of a previous response. This is also why we ask for contact information- so we can follow up with you to elaborate on anything that wasn't covered in the survey! I will check on the three unanswered questions and respond back if there are any good commands to run for this. If any users would like to chime in on helpful commands as well, feel free to do so! Thanks, Laura On Tue, Jan 21, 2025 at 2:55 PM Robin H. Johnson <robbat2@gentoo.org> wrote:
On Tue, Jan 21, 2025 at 10:43:13AM -0600, Laura Flores wrote:
Hi all,
The Ceph User Council is conducting a survey to gather insights from community members who actively use production Ceph clusters. We want to hear directly from you: *What is the use case of your production Ceph cluster?* As fast feedback when I passed the survey on to somebody else - to improve responses, if CUC can offer commands to make it easier to grab some of the quantitative data:
Do you have the pg autoscaler enabled? How many OSDs per node are you using? How many clients are reading/writing from the Ceph cluster in parallel? How many nodes are in your largest Ceph cluster? How many placement groups (PGs) per OSD are you using? What is the size of the largest files being stored in your Ceph cluster(s)? What is the size of the largest objects being stored in your Ceph cluster(s)? What is the size of your largest Ceph cluster? What’s the average Read/Write ratio/percentage in your workload?
And an additional guidance - if you have multiple Ceph clusters, how should the form be answered? I think some of these were also previously decided in other survey efforts, and could be reused?
-- Robin Hugh Johnson Gentoo Linux: Dev, Infra Lead, Foundation Treasurer E-Mail : robbat2@gentoo.org GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Laura Flores She/Her/Hers Software Engineer, Ceph Storage <https://ceph.io> Chicago, IL lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
Hello Laura Few more suggestions.. 1. As we are facing some issue, can we add more command to control clients using watcher, rbd status pool/image Watchers: watcher=10.160.0.245:0/2076588905 client.12541259 cookie=140446370329088 Some commands to control watcher and kill client.id <http://client.id/>. something like rbd lock remove <pool-name>/<image-name> <client_id> Or rbd watchers <pool-name>/<image-name> Or something rbd check <pool-name>/<image-name> Or Rbd list watchers pool-name or pool/image 2. Also, as we have multiple ceph clusters, so on dashboard every time by going to hosts we are able to see hosts names to identify the nodes and cluster type lets say, dev or prod. Can we have a variable on dashboard to see “Name: Location-Dev”?, I think we have enough space to list name in this are.  3. Seems dashboard/mgr is not cleaning itself. Most of time we need to fail to manager to clear such errors, But it seems a similar issue as in step1 above. I mounted this volume and unmounted and clean everything, even mount point. But for last three days this alert is active, I have tried failing back to different mgrs. CephNodeDiskspaceWarning Mountpoint /mnt/dst-volume on prod-host1 will be full in less than 5 days based on the 48 hour trailing fill rate. 4. We need more command to control pool repair. If we have started a pool repair command, how we can stop it? Regards Dev
On Jan 21, 2025, at 2:35 PM, Laura Flores <lflores@redhat.com> wrote:
Hi Robin,
As fast feedback when I passed the survey on to somebody else - to
improve responses, if CUC can offer commands to make it easier to grab some of the quantitative data:
Do you have the pg autoscaler enabled?
How many OSDs per node are you using? How many clients are reading/writing from the Ceph cluster in parallel? How many nodes are in your largest Ceph cluster? How many placement groups (PGs) per OSD are you using? What is the size of the largest files being stored in your Ceph cluster(s)? What is the size of the largest objects being stored in your Ceph cluster(s)? What is the size of your largest Ceph cluster? What’s the average Read/Write ratio/percentage in your workload?
Thanks for the suggestions! I updated the survey to address all but three of these queries, which I need to check on. Here are the ones I updated:
1. Do you have the pg autoscaler enabled? Run `ceph osd pool autoscale-status` and check to see if "AUTOSCALE" is on for any of your pools.
2. How many OSDs per node are you using? Run `ceph osd tree` to check this.
3. How many nodes are in your largest Ceph cluster? Run `ceph osd tree` to check this.
4. How many placement groups (PGs) per OSD are you using? Run `ceph osd df` and check the "PGS" column.
5. What is the size of your largest Ceph cluster? Run `ceph df` and look at the "TOTAL / SIZE" entry to check for this.
6. What’s the average Read/Write ratio/percentage in your workload? You may check `ceph -s` and look at the "io" section to get a sense of this.
I need to check on these three for the best commands: - How many clients are reading/writing from the Ceph cluster in parallel? - What is the size of the largest files being stored in your Ceph cluster(s)? - What is the size of the largest objects being stored in your Ceph cluster(s)?
And an additional guidance - if you have multiple Ceph clusters, how
should the form be answered? I think some of these were also previously decided in other survey efforts, and could be reused?
Another good question. We structured the survey so you can elaborate in the text boxes if you have multiple clusters, or we ask in terms of your largest cluster since we are interested in large-scale situations. However, if you would like to take the survey multiple times for multiple clusters, feel free to do so- I would just indicate in the "name/email" question that this is "take 2" etc. of the survey- just somehow make it obvious that it is part of a previous response. This is also why we ask for contact information- so we can follow up with you to elaborate on anything that wasn't covered in the survey!
I will check on the three unanswered questions and respond back if there are any good commands to run for this. If any users would like to chime in on helpful commands as well, feel free to do so!
Thanks, Laura
On Tue, Jan 21, 2025 at 2:55 PM Robin H. Johnson <robbat2@gentoo.org> wrote:
On Tue, Jan 21, 2025 at 10:43:13AM -0600, Laura Flores wrote:
Hi all,
The Ceph User Council is conducting a survey to gather insights from community members who actively use production Ceph clusters. We want to hear directly from you: *What is the use case of your production Ceph cluster?* As fast feedback when I passed the survey on to somebody else - to improve responses, if CUC can offer commands to make it easier to grab some of the quantitative data:
Do you have the pg autoscaler enabled? How many OSDs per node are you using? How many clients are reading/writing from the Ceph cluster in parallel? How many nodes are in your largest Ceph cluster? How many placement groups (PGs) per OSD are you using? What is the size of the largest files being stored in your Ceph cluster(s)? What is the size of the largest objects being stored in your Ceph cluster(s)? What is the size of your largest Ceph cluster? What’s the average Read/Write ratio/percentage in your workload?
And an additional guidance - if you have multiple Ceph clusters, how should the form be answered? I think some of these were also previously decided in other survey efforts, and could be reused?
-- Robin Hugh Johnson Gentoo Linux: Dev, Infra Lead, Foundation Treasurer E-Mail : robbat2@gentoo.org GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
--
Laura Flores
She/Her/Hers
Software Engineer, Ceph Storage <https://www.google.com/url?q=https://ceph.io&source=gmail-imap&ust=1738103898000000&usg=AOvVaw0wWXEK5D4AIoEyHNBva2Zu>
Chicago, IL
lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hi Robin, Getting back to you about how to infer these questions: - How many clients are reading/writing from the Ceph cluster in parallel?
- What is the size of the largest files being stored in your Ceph cluster(s)? - What is the size of the largest objects being stored in your Ceph cluster(s)?
To my knowledge, there isn't really a cut-and-dry command you can run to infer this, so your answer can be an estimation based on how familiar you are with your workload/use case. If you are not sure, you can select "Not sure" as an option. If you have provided your contact information, we will follow up with you, where you will have a chance to elaborate if needed. Thanks, Laura On Tue, Jan 21, 2025 at 4:35 PM Laura Flores <lflores@redhat.com> wrote:
Hi Robin,
As fast feedback when I passed the survey on to somebody else - to
improve responses, if CUC can offer commands to make it easier to grab some of the quantitative data:
Do you have the pg autoscaler enabled?
How many OSDs per node are you using? How many clients are reading/writing from the Ceph cluster in parallel? How many nodes are in your largest Ceph cluster? How many placement groups (PGs) per OSD are you using? What is the size of the largest files being stored in your Ceph cluster(s)? What is the size of the largest objects being stored in your Ceph cluster(s)? What is the size of your largest Ceph cluster? What’s the average Read/Write ratio/percentage in your workload?
Thanks for the suggestions! I updated the survey to address all but three of these queries, which I need to check on. Here are the ones I updated:
1. Do you have the pg autoscaler enabled? Run `ceph osd pool autoscale-status` and check to see if "AUTOSCALE" is on for any of your pools.
2. How many OSDs per node are you using? Run `ceph osd tree` to check this.
3. How many nodes are in your largest Ceph cluster? Run `ceph osd tree` to check this.
4. How many placement groups (PGs) per OSD are you using? Run `ceph osd df` and check the "PGS" column.
5. What is the size of your largest Ceph cluster? Run `ceph df` and look at the "TOTAL / SIZE" entry to check for this.
6. What’s the average Read/Write ratio/percentage in your workload? You may check `ceph -s` and look at the "io" section to get a sense of this.
I need to check on these three for the best commands: - How many clients are reading/writing from the Ceph cluster in parallel? - What is the size of the largest files being stored in your Ceph cluster(s)? - What is the size of the largest objects being stored in your Ceph cluster(s)?
And an additional guidance - if you have multiple Ceph clusters, how
should the form be answered? I think some of these were also previously decided in other survey efforts, and could be reused?
Another good question. We structured the survey so you can elaborate in the text boxes if you have multiple clusters, or we ask in terms of your largest cluster since we are interested in large-scale situations. However, if you would like to take the survey multiple times for multiple clusters, feel free to do so- I would just indicate in the "name/email" question that this is "take 2" etc. of the survey- just somehow make it obvious that it is part of a previous response. This is also why we ask for contact information- so we can follow up with you to elaborate on anything that wasn't covered in the survey!
I will check on the three unanswered questions and respond back if there are any good commands to run for this. If any users would like to chime in on helpful commands as well, feel free to do so!
Thanks, Laura
On Tue, Jan 21, 2025 at 2:55 PM Robin H. Johnson <robbat2@gentoo.org> wrote:
On Tue, Jan 21, 2025 at 10:43:13AM -0600, Laura Flores wrote:
Hi all,
The Ceph User Council is conducting a survey to gather insights from community members who actively use production Ceph clusters. We want to hear directly from you: *What is the use case of your production Ceph cluster?* As fast feedback when I passed the survey on to somebody else - to improve responses, if CUC can offer commands to make it easier to grab some of the quantitative data:
Do you have the pg autoscaler enabled? How many OSDs per node are you using? How many clients are reading/writing from the Ceph cluster in parallel? How many nodes are in your largest Ceph cluster? How many placement groups (PGs) per OSD are you using? What is the size of the largest files being stored in your Ceph cluster(s)? What is the size of the largest objects being stored in your Ceph cluster(s)? What is the size of your largest Ceph cluster? What’s the average Read/Write ratio/percentage in your workload?
And an additional guidance - if you have multiple Ceph clusters, how should the form be answered? I think some of these were also previously decided in other survey efforts, and could be reused?
-- Robin Hugh Johnson Gentoo Linux: Dev, Infra Lead, Foundation Treasurer E-Mail : robbat2@gentoo.org GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
--
Laura Flores
She/Her/Hers
Software Engineer, Ceph Storage <https://ceph.io>
Chicago, IL
lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
-- Laura Flores She/Her/Hers Software Engineer, Ceph Storage <https://ceph.io> Chicago, IL lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
Hi all, Huge thanks to the 46 community members who have already taken the survey! It's still open, so if you haven't taken it already, follow this link to do so! https://docs.google.com/forms/d/e/1FAIpQLSe66NedXh4gHLgk9G45eqP5V2wHlz4IKqRm... We still plan to keep the survey open for a bit, and we will update the thread in advance when we decide to close it. Stay tuned! Thanks, Laura On Tue, Jan 21, 2025 at 10:43 AM Laura Flores <lflores@redhat.com> wrote:
Hi all,
The Ceph User Council is conducting a survey to gather insights from community members who actively use production Ceph clusters. We want to hear directly from you: *What is the use case of your production Ceph cluster?*
Since its official Argonaut release in 2012, Ceph has grown significantly in features and user adoption. By learning about your use cases, we aim to understand Ceph’s strengths and limitations in performance, scalability, and usability. This feedback will help inform future improvements to Ceph.
Our ultimate goal is to enhance the Ceph community's shared knowledge by publishing real-world user stories on our website. These stories will serve as valuable resources for both current and future users, demonstrating the diversity and potential of Ceph in production environments.
All responses are anonymous unless the participant willingly shares their contact information. The Ceph User Council will contact participants who opt to share their contact information before anything is officially published. We have not yet determined when the survey will close, but we will give a heads up before doing so.
Take the survey here! https://docs.google.com/forms/d/e/1FAIpQLSe66NedXh4gHLgk9G45eqP5V2wHlz4IKqRm...
Thanks, Laura Flores
--
Laura Flores
She/Her/Hers
Software Engineer, Ceph Storage <https://ceph.io>
Chicago, IL
lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
-- Laura Flores She/Her/Hers Software Engineer, Ceph Storage <https://ceph.io> Chicago, IL lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
https://docs.google.com/forms/d/e/1FAIpQLSe66NedXh4gHLgk9G45eqP5V2wHlz4I KqRmGUJ074peaTGNKQ/viewform?usp=sf_link
FYI I have stuff in polish, and no language switching...
Hi Marc, Can you clarify what you mean here? Is there a problem with the survey's language setting? Not seeing anything wrong on my end, but if there is, I'd appreciate it if someone can confirm. Thanks, Laura On Mon, Jan 27, 2025 at 5:02 PM Marc <Marc@f1-outsourcing.eu> wrote:
https://docs.google.com/forms/d/e/1FAIpQLSe66NedXh4gHLgk9G45eqP5V2wHlz4I KqRmGUJ074peaTGNKQ/viewform?usp=sf_link
FYI I have stuff in polish, and no language switching... _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Laura Flores She/Her/Hers Software Engineer, Ceph Storage <https://ceph.io> Chicago, IL lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
Can you clarify what you mean here? Is there a problem with the survey's language setting? Not seeing anything wrong on my end, but if there is, I'd appreciate it if someone can confirm.
I guess it is some bug in this form no idea. Not sure if attachments are stripped here in the mailing list.
Hey Marc, I would suggest checking your browser's language settings. I have gotten confirmation from others that the form is working okay. Thanks, Laura On Mon, Jan 27, 2025 at 5:46 PM Marc <Marc@f1-outsourcing.eu> wrote:
Can you clarify what you mean here? Is there a problem with the survey's language setting? Not seeing anything wrong on my end, but if there is, I'd appreciate it if someone can confirm.
I guess it is some bug in this form no idea. Not sure if attachments are stripped here in the mailing list.
-- Laura Flores She/Her/Hers Software Engineer, Ceph Storage <https://ceph.io> Chicago, IL lflores@ibm.com | lflores@redhat.com <lflores@redhat.com> M: +17087388804
I am quite sure it is not my browser.
I would suggest checking your browser's language settings. I have gotten confirmation from others that the form is working okay.
Can you clarify what you mean here? Is there a problem with the
language setting? Not seeing anything wrong on my end, but if
survey's there is,
I'd appreciate it if someone can confirm.
I guess it is some bug in this form no idea. Not sure if attachments are stripped here in the mailing list.
You should put this as a first By completing this survey, I agree to be contacted by the Ceph User Council. * Yes I agree.
I would suggest checking your browser's language settings. I have gotten confirmation from others that the form is working okay.
Thanks, Laura
Can you clarify what you mean here? Is there a problem with the
language setting? Not seeing anything wrong on my end, but if
survey's there is,
I'd appreciate it if someone can confirm.
I guess it is some bug in this form no idea. Not sure if attachments are stripped here in the mailing list.
participants (4)
-
Devender Singh
-
Laura Flores
-
Marc
-
Robin H. Johnson