Anyone know of a s3 compatible interface that I can just run, and reads/writes files from a local file system and not from object storage?
On 28.02.23 16:31, Marc wrote:
Anyone know of a s3 compatible interface that I can just run, and reads/writes files from a local file system and not from object storage?
Have a look at Minio: https://min.io/product/overview#architecture Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030-405051-43 Fax: 030-405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin
Also look at truenas core which has minio built in. Venlig hilsen - Mit freundlichen Grüßen - Kind Regards, Jens Galsgaard Gitservice.dk +45 28864340 -----Oprindelig meddelelse----- Fra: Robert Sander <r.sander@heinlein-support.de> Sendt: 28. februar 2023 18:38 Til: ceph-users@ceph.io Emne: [ceph-users] Re: s3 compatible interface On 28.02.23 16:31, Marc wrote:
Anyone know of a s3 compatible interface that I can just run, and reads/writes files from a local file system and not from object storage?
Have a look at Minio: https://min.io/product/overview#architecture Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030-405051-43 Fax: 030-405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Minio no longer lets you read / write from the posix side. Only through minio itself. :( Haven't found a replacement yet. If you do, please let me know. Thanks, Kevin ________________________________________ From: Robert Sander <r.sander@heinlein-support.de> Sent: Tuesday, February 28, 2023 9:37 AM To: ceph-users@ceph.io Subject: [ceph-users] Re: s3 compatible interface Check twice before you click! This email originated from outside PNNL. On 28.02.23 16:31, Marc wrote:
Anyone know of a s3 compatible interface that I can just run, and reads/writes files from a local file system and not from object storage?
Have a look at Minio: https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmin.io%2Fproduct%2Foverview%23architecture&data=05%7C01%7Ckevin.fox%40pnnl.gov%7Cfbffadde8e0a45e1d18308db19b2b714%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638132027594291339%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=uPhkVghMl%2B%2BU75ddjwv9FMaLlAHO4GgkcreH5bZFIm0%3D&reserved=0 Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.heinlein-support.de%2F&data=05%7C01%7Ckevin.fox%40pnnl.gov%7Cfbffadde8e0a45e1d18308db19b2b714%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638132027594291339%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ciJR1pAWHTbtBbpJJ6GDtcBl7pUJdnU8C5ZBLoWlcaM%3D&reserved=0 Tel: 030-405051-43 Fax: 030-405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
We're actually writing this for RGW right now. It'll be a bit before it's productized, but it's in the works. Daniel On 2/28/23 14:13, Fox, Kevin M wrote:
Minio no longer lets you read / write from the posix side. Only through minio itself. :(
Haven't found a replacement yet. If you do, please let me know.
Thanks, Kevin
________________________________________ From: Robert Sander <r.sander@heinlein-support.de> Sent: Tuesday, February 28, 2023 9:37 AM To: ceph-users@ceph.io Subject: [ceph-users] Re: s3 compatible interface
Check twice before you click! This email originated from outside PNNL.
On 28.02.23 16:31, Marc wrote:
Anyone know of a s3 compatible interface that I can just run, and reads/writes files from a local file system and not from object storage?
Have a look at Minio:
Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.heinlein-support.de%2F&data=05%7C01%7Ckevin.fox%40pnnl.gov%7Cfbffadde8e0a45e1d18308db19b2b714%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638132027594291339%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ciJR1pAWHTbtBbpJJ6GDtcBl7pUJdnU8C5ZBLoWlcaM%3D&reserved=0
Tel: 030-405051-43 Fax: 030-405051-19
Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
On Wed, Mar 01, 2023 at 08:39:56AM -0500, Daniel Gryniewicz wrote:
We're actually writing this for RGW right now. It'll be a bit before it's productized, but it's in the works.
Just curious, what is the use cases for this feature? S3 against CephFS? -- Kai Stian Olstad
On 3/3/23 13:53, Kai Stian Olstad wrote:
On Wed, Mar 01, 2023 at 08:39:56AM -0500, Daniel Gryniewicz wrote:
We're actually writing this for RGW right now. It'll be a bit before it's productized, but it's in the works.
Just curious, what is the use cases for this feature? S3 against CephFS?
Local FS for development use, and distributed FS (initial target is GPFS) for production. There's no current plans to make it work against CephFS, although I would imagine it will work fine. But if you have a Ceph cluster, you're much better off using standard RGW on RADOS. Daniel
+1. If I know radosgw on top of cephfs is a thing, I may change some plans. Is that the planned route? Thanks, Kevin ________________________________________ From: Daniel Gryniewicz <dang@redhat.com> Sent: Monday, March 6, 2023 6:21 AM To: Kai Stian Olstad Cc: ceph-users@ceph.io Subject: [ceph-users] Re: s3 compatible interface Check twice before you click! This email originated from outside PNNL. On 3/3/23 13:53, Kai Stian Olstad wrote:
On Wed, Mar 01, 2023 at 08:39:56AM -0500, Daniel Gryniewicz wrote:
We're actually writing this for RGW right now. It'll be a bit before it's productized, but it's in the works.
Just curious, what is the use cases for this feature? S3 against CephFS?
Local FS for development use, and distributed FS (initial target is GPFS) for production. There's no current plans to make it work against CephFS, although I would imagine it will work fine. But if you have a Ceph cluster, you're much better off using standard RGW on RADOS. Daniel _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
As far as I know, we have no plans to productize (or even test) on CephFS. It should work, but CephFS isn't pure POSIX, so there may be issues. Daniel On 3/6/23 11:57, Fox, Kevin M wrote:
+1. If I know radosgw on top of cephfs is a thing, I may change some plans. Is that the planned route?
Thanks, Kevin
________________________________________ From: Daniel Gryniewicz <dang@redhat.com> Sent: Monday, March 6, 2023 6:21 AM To: Kai Stian Olstad Cc: ceph-users@ceph.io Subject: [ceph-users] Re: s3 compatible interface
Check twice before you click! This email originated from outside PNNL.
On 3/3/23 13:53, Kai Stian Olstad wrote:
On Wed, Mar 01, 2023 at 08:39:56AM -0500, Daniel Gryniewicz wrote:
We're actually writing this for RGW right now. It'll be a bit before it's productized, but it's in the works.
Just curious, what is the use cases for this feature? S3 against CephFS?
Local FS for development use, and distributed FS (initial target is GPFS) for production. There's no current plans to make it work against CephFS, although I would imagine it will work fine. But if you have a Ceph cluster, you're much better off using standard RGW on RADOS.
Daniel _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hi, You can try [1] geesefs project, the presentation for this code is here [2] [1] https://github.com/yandex-cloud/geesefs [2] https://yourcmc-ru.translate.goog/geesefs-2022/highload.html?_x_tr_sl=ru&_x_tr_tl=en&_x_tr_hl=en&_x_tr_pto=wapp k
On 28 Feb 2023, at 22:31, Marc <Marc@f1-outsourcing.eu> wrote:
Anyone know of a s3 compatible interface that I can just run, and reads/writes files from a local file system and not from object storage?
for testing you can try: https://github.com/aquarist-labs/s3gw ___________________________________ Clyso GmbH - Ceph Foundation Member Am 28.02.23 um 16:31 schrieb Marc:
Anyone know of a s3 compatible interface that I can just run, and reads/writes files from a local file system and not from object storage? _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
for testing you can try: https://github.com/aquarist-labs/s3gw
Yes indeed, that looks like it can be used with a simple fs backend.
Hi Marc, I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation of https://github.com/aquarist-labs/s3gw and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS. Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data? The only thing I found is https://s3gw-docs.readthedocs.io/en/latest/helm-charts/#local-storage, but it sounds to me that this is not where the user data will be going. Thanks for any hints and best regards, ================= Frank Schilder AIT Risø Campus Bygning 109, rum S14 ________________________________________ From: Marc <Marc@f1-outsourcing.eu> Sent: 18 March 2023 14:24:07 To: Clyso GmbH - Ceph Foundation Member; ceph-users@ceph.io Subject: [ceph-users] Re: s3 compatible interface
for testing you can try: https://github.com/aquarist-labs/s3gw
Yes indeed, that looks like it can be used with a simple fs backend. _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
On 3/20/23 12:02, Frank Schilder wrote:
Hi Marc,
I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation of https://github.com/aquarist-labs/s3gw and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS.
Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data?
The only thing I found is https://s3gw-docs.readthedocs.io/en/latest/helm-charts/#local-storage, but it sounds to me that this is not where the user data will be going.
Thanks for any hints and best regards,
for testing you can try: https://github.com/aquarist-labs/s3gw
Yes indeed, that looks like it can be used with a simple fs backend.
Hey, I was playing around with RadosGW's file backend (coming in Reef, zipper) a few months back and ended up making this docker container that just works to setup things: https://github.com/ChrisMacNaughton/ceph-rgw-docker; published (still, maybe for a while?) at https://hub.docker.com/r/iceyec/ceph-rgw-zipper Chris
On 3/20/23 12:02, Frank Schilder wrote:
Hi Marc,
I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation ofhttps://github.com/aquarist-labs/s3gw and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS.
Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data?
The only thing I found ishttps://s3gw-docs.readthedocs.io/en/latest/helm-charts/#local-storage, but it sounds to me that this is not where the user data will be going.
Thanks for any hints and best regards,
for testing you can try:https://github.com/aquarist-labs/s3gw
Yes indeed, that looks like it can be used with a simple fs backend.
Hey, (Re-sending this email from a mailing-list subscribed email) I was playing around with RadosGW's file backend (coming in Reef, zipper) a few months back and ended up making this docker container that just works to setup things: https://github.com/ChrisMacNaughton/ceph-rgw-docker <https://github.com/ChrisMacNaughton/ceph-rgw-docker>; published (still, maybe for a while?) at https://hub.docker.com/r/iceyec/ceph-rgw-zipper <https://hub.docker.com/r/iceyec/ceph-rgw-zipper> Chris
Hi Chris, This looks useful. Note for this thread: this *looks like* it's using the zipper dbstore backend? Yes, that's coming in Reef. We think of dbstore as mostly the zipper reference driver, but it can be useful as a standalone setup, potentially. But there's now a prototype of a posix file filter that can be stacked on dbstore (or rados, I guess)--not yet merged, and iiuc post-Reef. That's the project Daniel was describing. The posix/gpfs filter is aiming for being thin and fast and horizontally scalable. The s3gw project that Clyso and folks were writing about is distinct from both of these. I *think* it's truthful to say that s3gw is its own thing--a hybrid backing store with objects in files, but also metadata atomicity from an embedded db--plus interesting orchestration. Matt On Mon, Mar 20, 2023 at 3:45 PM Chris MacNaughton < chris.macnaughton@canonical.com> wrote:
On 3/20/23 12:02, Frank Schilder wrote:
Hi Marc,
I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation of https://github.com/aquarist-labs/s3gw and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS.
Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data?
The only thing I found is https://s3gw-docs.readthedocs.io/en/latest/helm-charts/#local-storage, but it sounds to me that this is not where the user data will be going.
Thanks for any hints and best regards,
for testing you can try: https://github.com/aquarist-labs/s3gw
Yes indeed, that looks like it can be used with a simple fs backend.
Hey,
(Re-sending this email from a mailing-list subscribed email)
I was playing around with RadosGW's file backend (coming in Reef, zipper) a few months back and ended up making this docker container that just works to setup things: https://github.com/ChrisMacNaughton/ceph-rgw-docker; published (still, maybe for a while?) at https://hub.docker.com/r/iceyec/ceph-rgw-zipper
Chris _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Matt Benjamin Red Hat, Inc. 315 West Huron Street, Suite 140A Ann Arbor, Michigan 48103 http://www.redhat.com/en/technologies/storage tel. 734-821-5101 fax. 734-769-8938 cel. 734-216-5309
Hi, maybe I should have mentioned the zipper project as well, watched both IBM and SUSE presentations at FOSDEM 2023. I personally follow the zipper project with great interest. Joachim ___________________________________ Ceph Foundation Member Am 21.03.23 um 01:27 schrieb Matt Benjamin:
Hi Chris,
This looks useful. Note for this thread: this *looks like* it's using the zipper dbstore backend? Yes, that's coming in Reef. We think of dbstore as mostly the zipper reference driver, but it can be useful as a standalone setup, potentially.
But there's now a prototype of a posix file filter that can be stacked on dbstore (or rados, I guess)--not yet merged, and iiuc post-Reef. That's the project Daniel was describing. The posix/gpfs filter is aiming for being thin and fast and horizontally scalable.
The s3gw project that Clyso and folks were writing about is distinct from both of these. I *think* it's truthful to say that s3gw is its own thing--a hybrid backing store with objects in files, but also metadata atomicity from an embedded db--plus interesting orchestration.
Matt
On Mon, Mar 20, 2023 at 3:45 PM Chris MacNaughton < chris.macnaughton@canonical.com> wrote:
On 3/20/23 12:02, Frank Schilder wrote:
Hi Marc,
I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation of https://github.com/aquarist-labs/s3gw and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS.
Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data?
The only thing I found is https://s3gw-docs.readthedocs.io/en/latest/helm-charts/#local-storage, but it sounds to me that this is not where the user data will be going.
Thanks for any hints and best regards,
for testing you can try: https://github.com/aquarist-labs/s3gw
Yes indeed, that looks like it can be used with a simple fs backend.
Hey,
(Re-sending this email from a mailing-list subscribed email)
I was playing around with RadosGW's file backend (coming in Reef, zipper) a few months back and ended up making this docker container that just works to setup things: https://github.com/ChrisMacNaughton/ceph-rgw-docker; published (still, maybe for a while?) at https://hub.docker.com/r/iceyec/ceph-rgw-zipper
Chris _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Will either the file store or the posix/gpfs filter support the underlying files changing underneath so you can access the files either through s3 or by other out of band means (smb, nfs, etc)? Thanks, Kevin ________________________________________ From: Matt Benjamin <mbenjami@redhat.com> Sent: Monday, March 20, 2023 5:27 PM To: Chris MacNaughton Cc: ceph-users@ceph.io; Kyle Bader Subject: [ceph-users] Re: s3 compatible interface Check twice before you click! This email originated from outside PNNL. Hi Chris, This looks useful. Note for this thread: this *looks like* it's using the zipper dbstore backend? Yes, that's coming in Reef. We think of dbstore as mostly the zipper reference driver, but it can be useful as a standalone setup, potentially. But there's now a prototype of a posix file filter that can be stacked on dbstore (or rados, I guess)--not yet merged, and iiuc post-Reef. That's the project Daniel was describing. The posix/gpfs filter is aiming for being thin and fast and horizontally scalable. The s3gw project that Clyso and folks were writing about is distinct from both of these. I *think* it's truthful to say that s3gw is its own thing--a hybrid backing store with objects in files, but also metadata atomicity from an embedded db--plus interesting orchestration. Matt On Mon, Mar 20, 2023 at 3:45 PM Chris MacNaughton < chris.macnaughton@canonical.com> wrote:
On 3/20/23 12:02, Frank Schilder wrote:
Hi Marc,
I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation of https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Faquarist-labs%2Fs3gw&data=05%7C01%7Ckevin.fox%40pnnl.gov%7C748fc400c7aa4d6e60db08db29a36b4b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638149554103894808%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=nq5PtA585rwTIsKwtyuh2EYcCDMIu%2Bwry6%2BXh1GukKs%3D&reserved=0 and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS.
Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data?
The only thing I found is https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fs3gw-docs.readthedocs.io%2Fen%2Flatest%2Fhelm-charts%2F%23local-storage&data=05%7C01%7Ckevin.fox%40pnnl.gov%7C748fc400c7aa4d6e60db08db29a36b4b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638149554103894808%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1fr9aDJ3nqnB3RDDzsF6vpxzXN4961YRDQ%2BhHCdEC%2Bw%3D&reserved=0, but it sounds to me that this is not where the user data will be going.
Thanks for any hints and best regards,
Yes indeed, that looks like it can be used with a simple fs backend.
Hey,
(Re-sending this email from a mailing-list subscribed email)
I was playing around with RadosGW's file backend (coming in Reef, zipper) a few months back and ended up making this docker container that just works to setup things: https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FChrisMacNaughton%2Fceph-rgw-docker&data=05%7C01%7Ckevin.fox%40pnnl.gov%7C748fc400c7aa4d6e60db08db29a36b4b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638149554103894808%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Lu%2F9P50FHeInNkTkYUKQGzwDePnvkvcRR%2FmTOPdzeRE%3D&reserved=0; published (still, maybe for a while?) at https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhub.docker.com%2Fr%2Ficeyec%2Fceph-rgw-zipper&data=05%7C01%7Ckevin.fox%40pnnl.gov%7C748fc400c7aa4d6e60db08db29a36b4b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638149554103894808%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WQI5wYhaP6XDTiR%2FcKvkAe7i6o4iBgATWVdr4zSBDRI%3D&reserved=0
Chris _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Matt Benjamin Red Hat, Inc. 315 West Huron Street, Suite 140A Ann Arbor, Michigan 48103 https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.redhat.com%2Fen%2Ftechnologies%2Fstorage&data=05%7C01%7Ckevin.fox%40pnnl.gov%7C748fc400c7aa4d6e60db08db29a36b4b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638149554103894808%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RfbcL8PwVdbOwIcc3h%2BLPXZ5pAtFEUnPfLIYMsVGhgk%3D&reserved=0 tel. 734-821-5101 fax. 734-769-8938 cel. 734-216-5309 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Yes, the POSIXDriver will support that. If you want NFS access, we'd suggest you use Ganesha's FSAL_RGW to access through RGW (because multipart uploads are not fun), but it will work. Daniel On 3/21/23 15:48, Fox, Kevin M wrote:
Will either the file store or the posix/gpfs filter support the underlying files changing underneath so you can access the files either through s3 or by other out of band means (smb, nfs, etc)?
Thanks, Kevin
________________________________________ From: Matt Benjamin <mbenjami@redhat.com> Sent: Monday, March 20, 2023 5:27 PM To: Chris MacNaughton Cc: ceph-users@ceph.io; Kyle Bader Subject: [ceph-users] Re: s3 compatible interface
Check twice before you click! This email originated from outside PNNL.
Hi Chris,
This looks useful. Note for this thread: this *looks like* it's using the zipper dbstore backend? Yes, that's coming in Reef. We think of dbstore as mostly the zipper reference driver, but it can be useful as a standalone setup, potentially.
But there's now a prototype of a posix file filter that can be stacked on dbstore (or rados, I guess)--not yet merged, and iiuc post-Reef. That's the project Daniel was describing. The posix/gpfs filter is aiming for being thin and fast and horizontally scalable.
The s3gw project that Clyso and folks were writing about is distinct from both of these. I *think* it's truthful to say that s3gw is its own thing--a hybrid backing store with objects in files, but also metadata atomicity from an embedded db--plus interesting orchestration.
Matt
On Mon, Mar 20, 2023 at 3:45 PM Chris MacNaughton < chris.macnaughton@canonical.com> wrote:
On 3/20/23 12:02, Frank Schilder wrote:
Hi Marc,
I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation of https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Faquarist-labs%2Fs3gw&data=05%7C01%7Ckevin.fox%40pnnl.gov%7C748fc400c7aa4d6e60db08db29a36b4b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638149554103894808%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=nq5PtA585rwTIsKwtyuh2EYcCDMIu%2Bwry6%2BXh1GukKs%3D&reserved=0 and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS.
Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data?
The only thing I found is https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fs3gw-docs.readthedocs.io%2Fen%2Flatest%2Fhelm-charts%2F%23local-storage&data=05%7C01%7Ckevin.fox%40pnnl.gov%7C748fc400c7aa4d6e60db08db29a36b4b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638149554103894808%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1fr9aDJ3nqnB3RDDzsF6vpxzXN4961YRDQ%2BhHCdEC%2Bw%3D&reserved=0, but it sounds to me that this is not where the user data will be going.
Thanks for any hints and best regards,
Yes indeed, that looks like it can be used with a simple fs backend.
Hey,
(Re-sending this email from a mailing-list subscribed email)
I was playing around with RadosGW's file backend (coming in Reef, zipper) a few months back and ended up making this docker container that just works to setup things: https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FChrisMacNaughton%2Fceph-rgw-docker&data=05%7C01%7Ckevin.fox%40pnnl.gov%7C748fc400c7aa4d6e60db08db29a36b4b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638149554103894808%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Lu%2F9P50FHeInNkTkYUKQGzwDePnvkvcRR%2FmTOPdzeRE%3D&reserved=0; published (still, maybe for a while?) at https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhub.docker.com%2Fr%2Ficeyec%2Fceph-rgw-zipper&data=05%7C01%7Ckevin.fox%40pnnl.gov%7C748fc400c7aa4d6e60db08db29a36b4b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C638149554103894808%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WQI5wYhaP6XDTiR%2FcKvkAe7i6o4iBgATWVdr4zSBDRI%3D&reserved=0
Chris _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
--
Matt Benjamin Red Hat, Inc. 315 West Huron Street, Suite 140A Ann Arbor, Michigan 48103
tel. 734-821-5101 fax. 734-769-8938 cel. 734-216-5309 _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (13)
-
Chris MacNaughton
-
Chris MacNaughton
-
Clyso GmbH - Ceph Foundation Member
-
Daniel Gryniewicz
-
Fox, Kevin M
-
Frank Schilder
-
Jens Galsgaard
-
Joachim Kraftmayer
-
Kai Stian Olstad
-
Konstantin Shalygin
-
Marc
-
Matt Benjamin
-
Robert Sander