RGW - S3 bucket browser and/or S3 explorer
Hi all. Is anyone aware of a ("S3 bucket browser" | "S3 explorer"), which works with RadosGW static websites? I've played around with those below, but none of them works (in my environment): - https://github.com/qoomon/aws-s3-bucket-browser - https://github.com/guimou/ceph-js-s3-explorer - https://github.com/awslabs/aws-js-s3-explorer - https://github.com/awslabs/aws-js-s3-explorer/tree/v2-alpha Any hints are highly appreciated!
Perhaps this? https://s3browser.com/ Regards, * Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] <http://www.linehaul.ai/> [image: linkedin icon] <https://www.linkedin.com/in/anthony-fec/> On Fri, Feb 7, 2025 at 7:09 PM <notna@ist-einmalig.de> wrote:
Hi all.
Is anyone aware of a ("S3 bucket browser" | "S3 explorer"), which works with RadosGW static websites?
I've played around with those below, but none of them works (in my environment):
- https://github.com/qoomon/aws-s3-bucket-browser - https://github.com/guimou/ceph-js-s3-explorer - https://github.com/awslabs/aws-js-s3-explorer - https://github.com/awslabs/aws-js-s3-explorer/tree/v2-alpha
Any hints are highly appreciated!
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Also Cyberduck works well with RGW: https://cyberduck.io/ Its just an endpoint difference from AWS since the basis of Ceph S3 protocol is the same. Best, Laimis J. laimis.juzeliunas@oxylabs.io
On 11 Feb 2025, at 08:49, Anthony Fecarotta <anthony@linehaul.ai> wrote:
Perhaps this? https://www.google.com/url?q=https://s3browser.com/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2aGO3QO62i_KoflakkWnLQ
Regards,
* Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] <https://www.google.com/url?q=http://www.linehaul.ai/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw0y1OB3e3H92u-pTQnPc9Zp> [image: linkedin icon] <https://www.google.com/url?q=https://www.linkedin.com/in/anthony-fec/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw15iLzJ4KQ8zf90Ha_6cnpj>
On Fri, Feb 7, 2025 at 7:09 PM <notna@ist-einmalig.de> wrote:
Hi all.
Is anyone aware of a ("S3 bucket browser" | "S3 explorer"), which works with RadosGW static websites?
I've played around with those below, but none of them works (in my environment):
- https://www.google.com/url?q=https://github.com/qoomon/aws-s3-bucket-browser&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2GsknVblPKkS6hKZANRkvy - https://www.google.com/url?q=https://github.com/guimou/ceph-js-s3-explorer&source=gmail-imap&ust=1739861484000000&usg=AOvVaw1JfZ46YSv_gb5PXnERGlVa - https://www.google.com/url?q=https://github.com/awslabs/aws-js-s3-explorer&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2vHZmQ6T15NYIzmh-dnr1s - https://www.google.com/url?q=https://github.com/awslabs/aws-js-s3-explorer/tree/v2-alpha&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2_Ma6FVQ2rP5uVdpfzu3FN
Any hints are highly appreciated!
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Interesting! Will mess with that today. Regards, * Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] <http://www.linehaul.ai/> [image: linkedin icon] <https://www.linkedin.com/in/anthony-fec/> On Tue, Feb 11, 2025 at 2:21 AM Laimis Juzeliūnas < laimis.juzeliunas@oxylabs.io> wrote:
Also Cyberduck works well with RGW: https://cyberduck.io/ Its just an endpoint difference from AWS since the basis of Ceph S3 protocol is the same.
Best, *Laimis J.* laimis.juzeliunas@oxylabs.io
On 11 Feb 2025, at 08:49, Anthony Fecarotta <anthony@linehaul.ai> wrote:
Perhaps this? https://www.google.com/url?q=https://s3browser.com/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2aGO3QO62i_KoflakkWnLQ
Regards,
* Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] < https://www.google.com/url?q=http://www.linehaul.ai/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw0y1OB3e3H92u-pTQnPc9Zp
[image: linkedin icon] < https://www.google.com/url?q=https://www.linkedin.com/in/anthony-fec/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw15iLzJ4KQ8zf90Ha_6cnpj
On Fri, Feb 7, 2025 at 7:09 PM <notna@ist-einmalig.de> wrote:
Hi all.
Is anyone aware of a ("S3 bucket browser" | "S3 explorer"), which works with RadosGW static websites?
I've played around with those below, but none of them works (in my environment):
- https://www.google.com/url?q=https://github.com/qoomon/aws-s3-bucket-browser&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2GsknVblPKkS6hKZANRkvy - https://www.google.com/url?q=https://github.com/guimou/ceph-js-s3-explorer&source=gmail-imap&ust=1739861484000000&usg=AOvVaw1JfZ46YSv_gb5PXnERGlVa - https://www.google.com/url?q=https://github.com/awslabs/aws-js-s3-explorer&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2vHZmQ6T15NYIzmh-dnr1s - https://www.google.com/url?q=https://github.com/awslabs/aws-js-s3-explorer/tree/v2-alpha&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2_Ma6FVQ2rP5uVdpfzu3FN
Any hints are highly appreciated!
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
What would you like to do? Serve your bucket objects as static files on web? On Tue, Feb 11, 2025 at 1:31 PM Anthony Fecarotta <anthony@linehaul.ai> wrote:
Interesting! Will mess with that today.
Regards,
* Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] <http://www.linehaul.ai/> [image: linkedin icon] <https://www.linkedin.com/in/anthony-fec/>
On Tue, Feb 11, 2025 at 2:21 AM Laimis Juzeliūnas < laimis.juzeliunas@oxylabs.io> wrote:
Also Cyberduck works well with RGW: https://cyberduck.io/ Its just an endpoint difference from AWS since the basis of Ceph S3 protocol is the same.
Best, *Laimis J.* laimis.juzeliunas@oxylabs.io
On 11 Feb 2025, at 08:49, Anthony Fecarotta <anthony@linehaul.ai> wrote:
Perhaps this?
Regards,
* Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] <
[image: linkedin icon] <
On Fri, Feb 7, 2025 at 7:09 PM <notna@ist-einmalig.de> wrote:
Hi all.
Is anyone aware of a ("S3 bucket browser" | "S3 explorer"), which works with RadosGW static websites?
I've played around with those below, but none of them works (in my environment):
-
-
-
-
Any hints are highly appreciated!
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
You can't have "everything S3 has to offer / supports..." without secrets in the browser. Amazon released storage browser react component <https://github.com/aws-amplify/amplify-ui/issues/5731> a while ago, maybe this is what you are looking for; but we've been using really simple and minimalistic https://github.com/rokj/stree-web (in terms of supported s3 functionality) which suffice our needs for now. Rok On Tue, Feb 11, 2025 at 8:31 PM <notna@ist-einmalig.de> wrote:
yes.
a nice website showing the "static website" objects with all available object meta data, like size, (modification) time, everything S3 has to offer / supports...
an extremely great additional thing would be something similar to (unix / linux like OS'es) symlinks... or, lets say, the GitHub "latest" URLs for the GH releases... so, showing an "(latest) object" and as soon as one either selects it in the "web browser gui" or "downloads" it via other S3-like ways (s3cmd, aws s3, Cyberduck, ...) the object refered to by this "link object" would be shown / downloaded... (I'm aware, this is not really officially supported by AWS S3, but let's dream on ;) )
and, again, I'm talking about "static websites" only here... not the usual full-fledged S3 RGW endpoint, where you i.e. need to provide your secrets.... b'cause for this, I've a working "S3 browser" by now already...
*Gesendet: *Dienstag, 11. Februar 2025 um 13:59 *Von: *"Rok Jaklič" <rjaklic@gmail.com> *An: *"Anthony Fecarotta" <anthony@linehaul.ai> *CC: *"Laimis Juzeliūnas" <laimis.juzeliunas@oxylabs.io>, notna@ist-einmalig.de,ceph-users <ceph-users@ceph.io> *Betreff: *[ceph-users] Re: RGW - S3 bucket browser and/or S3 explorer What would you like to do?
Serve your bucket objects as static files on web?
On Tue, Feb 11, 2025 at 1:31 PM Anthony Fecarotta <anthony@linehaul.ai> wrote:
Interesting! Will mess with that today.
Regards,
* Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] <http://www.linehaul.ai/> [image: linkedin icon] <https://www.linkedin.com/in/anthony-fec/>
On Tue, Feb 11, 2025 at 2:21 AM Laimis Juzeliūnas < laimis.juzeliunas@oxylabs.io> wrote:
Also Cyberduck works well with RGW: https://cyberduck.io/ Its just an endpoint difference from AWS since the basis of Ceph S3 protocol is the same.
Best, *Laimis J.* laimis.juzeliunas@oxylabs.io
On 11 Feb 2025, at 08:49, Anthony Fecarotta <anthony@linehaul.ai> wrote:
Perhaps this?
Regards,
* Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] <
[image: linkedin icon] <
On Fri, Feb 7, 2025 at 7:09 PM <notna@ist-einmalig.de> wrote:
Hi all.
Is anyone aware of a ("S3 bucket browser" | "S3 explorer"), which works with RadosGW static websites?
I've played around with those below, but none of them works (in my environment):
-
-
-
-
Any hints are highly appreciated!
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Interesting, I just use the Amazon S3 connection template in the UI and specify the server endpoint for Ceph S3 with respective keys. The Ceph endpoint is exposed as a load balancer for all the RGW daemons and it works straight "out of the box" with Cyberduck. Laimis J. On Tue, Feb 11, 2025, 21:41 <notna@ist-einmalig.de> wrote:
yes, Cyberduck works pretty ok if you want a "GUI application".
As far as I remember, CD switched to the "domain-path" URLs some releases / years ago.... And the "usual" RGW S3 is still on "path", so you need either to tweak CD in the user's "Cyberduck config file" a bit to ensure it uses the "path-style" S3 URLs... or use a very old version, which did "path" per default...
*Gesendet: *Dienstag, 11. Februar 2025 um 09:20 *Von: *"Laimis Juzeliūnas" <laimis.juzeliunas@oxylabs.io> *An: *"Anthony Fecarotta" <anthony@linehaul.ai> *CC: *notna@ist-einmalig.de,ceph-users <ceph-users@ceph.io> *Betreff: *Re: [ceph-users] RGW - S3 bucket browser and/or S3 explorer Also Cyberduck works well with RGW: https://cyberduck.io/ Its just an endpoint difference from AWS since the basis of Ceph S3 protocol is the same.
Best, *Laimis J.* laimis.juzeliunas@oxylabs.io
On 11 Feb 2025, at 08:49, Anthony Fecarotta <anthony@linehaul.ai> wrote:
Perhaps this? https://www.google.com/url?q=https://s3browser.com/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2aGO3QO62i_KoflakkWnLQ
Regards,
* Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] < https://www.google.com/url?q=http://www.linehaul.ai/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw0y1OB3e3H92u-pTQnPc9Zp
[image: linkedin icon] < https://www.google.com/url?q=https://www.linkedin.com/in/anthony-fec/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw15iLzJ4KQ8zf90Ha_6cnpj
On Fri, Feb 7, 2025 at 7:09 PM <notna@ist-einmalig.de> wrote:
Hi all.
Is anyone aware of a ("S3 bucket browser" | "S3 explorer"), which works with RadosGW static websites?
I've played around with those below, but none of them works (in my environment):
- https://www.google.com/url?q=https://github.com/qoomon/aws-s3-bucket-browser&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2GsknVblPKkS6hKZANRkvy - https://www.google.com/url?q=https://github.com/guimou/ceph-js-s3-explorer&source=gmail-imap&ust=1739861484000000&usg=AOvVaw1JfZ46YSv_gb5PXnERGlVa - https://www.google.com/url?q=https://github.com/awslabs/aws-js-s3-explorer&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2vHZmQ6T15NYIzmh-dnr1s - https://www.google.com/url?q=https://github.com/awslabs/aws-js-s3-explorer/tree/v2-alpha&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2_Ma6FVQ2rP5uVdpfzu3FN
Any hints are highly appreciated!
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
@notna@ist-einmalig.de <notna@ist-einmalig.de> you are 100% correct, as I have just spent an hour finding that out the hard way lol. Regards, * Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] <http://www.linehaul.ai/> [image: linkedin icon] <https://www.linkedin.com/in/anthony-fec/> On Tue, Feb 11, 2025 at 1:41 PM <notna@ist-einmalig.de> wrote:
yes, Cyberduck works pretty ok if you want a "GUI application".
As far as I remember, CD switched to the "domain-path" URLs some releases / years ago.... And the "usual" RGW S3 is still on "path", so you need either to tweak CD in the user's "Cyberduck config file" a bit to ensure it uses the "path-style" S3 URLs... or use a very old version, which did "path" per default...
*Gesendet: *Dienstag, 11. Februar 2025 um 09:20 *Von: *"Laimis Juzeliūnas" <laimis.juzeliunas@oxylabs.io> *An: *"Anthony Fecarotta" <anthony@linehaul.ai> *CC: *notna@ist-einmalig.de,ceph-users <ceph-users@ceph.io> *Betreff: *Re: [ceph-users] RGW - S3 bucket browser and/or S3 explorer Also Cyberduck works well with RGW: https://cyberduck.io/ Its just an endpoint difference from AWS since the basis of Ceph S3 protocol is the same.
Best, *Laimis J.* laimis.juzeliunas@oxylabs.io
On 11 Feb 2025, at 08:49, Anthony Fecarotta <anthony@linehaul.ai> wrote:
Perhaps this? https://www.google.com/url?q=https://s3browser.com/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2aGO3QO62i_KoflakkWnLQ
Regards,
* Anthony Fecarotta* Founder & President [image: phone-icon] anthony@linehaul.ai [image: phone-icon] 224-339-1182 [image: phone-icon] (855) 625-0300 [image: phone-icon] 1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181 [image: phone-icon] www.linehaul.ai [image: linehaul.ai logo] < https://www.google.com/url?q=http://www.linehaul.ai/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw0y1OB3e3H92u-pTQnPc9Zp
[image: linkedin icon] < https://www.google.com/url?q=https://www.linkedin.com/in/anthony-fec/&source=gmail-imap&ust=1739861484000000&usg=AOvVaw15iLzJ4KQ8zf90Ha_6cnpj
On Fri, Feb 7, 2025 at 7:09 PM <notna@ist-einmalig.de> wrote:
Hi all.
Is anyone aware of a ("S3 bucket browser" | "S3 explorer"), which works with RadosGW static websites?
I've played around with those below, but none of them works (in my environment):
- https://www.google.com/url?q=https://github.com/qoomon/aws-s3-bucket-browser&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2GsknVblPKkS6hKZANRkvy - https://www.google.com/url?q=https://github.com/guimou/ceph-js-s3-explorer&source=gmail-imap&ust=1739861484000000&usg=AOvVaw1JfZ46YSv_gb5PXnERGlVa - https://www.google.com/url?q=https://github.com/awslabs/aws-js-s3-explorer&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2vHZmQ6T15NYIzmh-dnr1s - https://www.google.com/url?q=https://github.com/awslabs/aws-js-s3-explorer/tree/v2-alpha&source=gmail-imap&ust=1739861484000000&usg=AOvVaw2_Ma6FVQ2rP5uVdpfzu3FN
Any hints are highly appreciated!
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (4)
-
Anthony Fecarotta
-
Laimis Juzeliūnas
-
notna＠ist-einmalig.de
-
Rok Jaklič