Also look at truenas core which has minio built in. Venlig hilsen - Mit freundlichen Grüßen - Kind Regards, Jens Galsgaard Gitservice.dk +45 28864340 -----Oprindelig meddelelse----- Fra: Robert Sander <r.sander(a)heinlein-support.de> Sendt: 28. februar 2023 18:38 Til: ceph-users(a)ceph.io Emne: [ceph-users] Re: s3 compatible interface On 28.02.23 16:31, Marc wrote: Have a look at Minio: https://min.io/product/overview#architecture Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030-405051-43 Fax: 030-405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin _______________________________________________ ceph-users mailing list -- ceph-users(a)ceph.io To unsubscribe send an email to ceph-users-leave(a)ceph.io

Hi, You can try [1] geesefs project, the presentation for this code is here [2] [1] https://github.com/yandex-cloud/geesefs [2] https://yourcmc-ru.translate.goog/geesefs-2022/highload.html?_x_tr_sl=ru&am… k

On Wed, Mar 01, 2023 at 08:39:56AM -0500, Daniel Gryniewicz wrote: Just curious, what is the use cases for this feature? S3 against CephFS? -- Kai Stian Olstad

+1. If I know radosgw on top of cephfs is a thing, I may change some plans. Is that the planned route? Thanks, Kevin ________________________________________ From: Daniel Gryniewicz <dang(a)redhat.com> Sent: Monday, March 6, 2023 6:21 AM To: Kai Stian Olstad Cc: ceph-users(a)ceph.io Subject: [ceph-users] Re: s3 compatible interface Check twice before you click! This email originated from outside PNNL. On 3/3/23 13:53, Kai Stian Olstad wrote: Local FS for development use, and distributed FS (initial target is GPFS) for production. There's no current plans to make it work against CephFS, although I would imagine it will work fine. But if you have a Ceph cluster, you're much better off using standard RGW on RADOS. Daniel _______________________________________________ ceph-users mailing list -- ceph-users(a)ceph.io To unsubscribe send an email to ceph-users-leave(a)ceph.io

for testing you can try: https://github.com/aquarist-labs/s3gw ___________________________________ Clyso GmbH - Ceph Foundation Member Am 28.02.23 um 16:31 schrieb Marc: > Anyone know of a s3 compatible interface that I can just run, and reads/writes files from a local file system and not from object storage? > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io

Hi Marc, I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation of https://github.com/aquarist-labs/s3gw and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS. Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data? The only thing I found is https://s3gw-docs.readthedocs.io/en/latest/helm-charts/#local-storage, but it sounds to me that this is not where the user data will be going. Thanks for any hints and best regards, ================= Frank Schilder AIT Risø Campus Bygning 109, rum S14 ________________________________________ From: Marc <Marc(a)f1-outsourcing.eu> Sent: 18 March 2023 14:24:07 To: Clyso GmbH - Ceph Foundation Member; ceph-users(a)ceph.io Subject: [ceph-users] Re: s3 compatible interface Yes indeed, that looks like it can be used with a simple fs backend. _______________________________________________ ceph-users mailing list -- ceph-users(a)ceph.io To unsubscribe send an email to ceph-users-leave(a)ceph.io

On 3/20/23 12:02, Frank Schilder wrote: Hey, (Re-sending this email from a mailing-list subscribed email) I was playing around with RadosGW's file backend (coming in Reef, zipper) a few months back and ended up making this docker container that just works to setup things: https://github.com/ChrisMacNaughton/ceph-rgw-docker <https://github.com/ChrisMacNaughton/ceph-rgw-docker>; published (still, maybe for a while?) at https://hub.docker.com/r/iceyec/ceph-rgw-zipper <https://hub.docker.com/r/iceyec/ceph-rgw-zipper> Chris

Hi, maybe I should have mentioned the zipper project as well, watched both IBM and SUSE presentations at FOSDEM 2023. I personally follow the zipper project with great interest. Joachim ___________________________________ Ceph Foundation Member Am 21.03.23 um 01:27 schrieb Matt Benjamin: > Hi Chris, > > This looks useful. Note for this thread: this *looks like* it's using the > zipper dbstore backend? Yes, that's coming in Reef. We think of dbstore > as mostly the zipper reference driver, but it can be useful as a standalone > setup, potentially. > > But there's now a prototype of a posix file filter that can be stacked on > dbstore (or rados, I guess)--not yet merged, and iiuc post-Reef. That's > the project Daniel was describing. The posix/gpfs filter is aiming for > being thin and fast and horizontally scalable. > > The s3gw project that Clyso and folks were writing about is distinct from > both of these. I *think* it's truthful to say that s3gw is its own > thing--a hybrid backing store with objects in files, but also metadata > atomicity from an embedded db--plus interesting orchestration. > > Matt > > On Mon, Mar 20, 2023 at 3:45 PM Chris MacNaughton < > chris.macnaughton(a)canonical.com&gt; wrote: > >> On 3/20/23 12:02, Frank Schilder wrote: >> >> Hi Marc, >> >> I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation of https://github.com/aquarist-labs/s3gw and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS. >> >> Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data? >> >> The only thing I found is https://s3gw-docs.readthedocs.io/en/latest/helm-charts/#local-storage, but it sounds to me that this is not where the user data will be going. >> >> Thanks for any hints and best regards, >> >> >> for testing you can try: https://github.com/aquarist-labs/s3gw >> >> Yes indeed, that looks like it can be used with a simple fs backend. >> >> Hey, >> >> (Re-sending this email from a mailing-list subscribed email) >> >> I was playing around with RadosGW's file backend (coming in Reef, zipper) >> a few months back and ended up making this docker container that just works >> to setup things: >> https://github.com/ChrisMacNaughton/ceph-rgw-docker; published (still, >> maybe for a while?) at https://hub.docker.com/r/iceyec/ceph-rgw-zipper >> >> Chris >> _______________________________________________ >> ceph-users mailing list -- ceph-users(a)ceph.io >> To unsubscribe send an email to ceph-users-leave(a)ceph.io >> >

Yes, the POSIXDriver will support that. If you want NFS access, we'd suggest you use Ganesha's FSAL_RGW to access through RGW (because multipart uploads are not fun), but it will work. Daniel On 3/21/23 15:48, Fox, Kevin M wrote: