Posix backend for Radosgw
Hi, I am trying to test the posix backend for radosgw in my test machine. It is running Ubuntu 22.04 with the latest squid release(19.2.0) I have configured a small single node cluster without any osd. $ sudo ceph -v ceph version 19.2.0 (16063ff2022298c9300e49a547a16ffda59baf13) squid (stable) $ sudo ceph -s cluster: id: 92d1770c-e83e-11ef-bcc9-5f5839c0a1fa health: HEALTH_WARN Failed to place 1 daemon(s) Reduced data availability: 1 pg inactive OSD count 0 < osd_pool_default_size 3 services: mon: 1 daemons, quorum testserver (age 3d) mgr: testserver.iavwwx(active, since 2d) osd: 0 osds: 0 up, 0 in data: pools: 1 pools, 1 pgs objects: 0 objects, 0 B usage: 0 B used, 0 B / 0 B avail pgs: 100.000% pgs unknown 1 unknown progress: Global Recovery Event (0s) [............................] Test machine is running a raided xfs file system. Using the below config in the radosgw.conf [client] rgw backend store = dbstore rgw config store = dbstore dbstore db dir = /mnt/raidx/rgw/dbstore dbstore_config_uri = file:///mnt/raidx/dbstore/config.db rgw filter = posix rgw posix base path = /mnt/raidx/posix/root rgw posix database root = /mnt/raidx/rgw/posix/lmdb [client.radosgw.gateway] rgw init timeout = 1200 rgw frontends = beast port=80 Not able to start the radosgw, fails to initialize the rados. 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 ceph version 19.2.0 (16063ff2022298c9300e49a547a16ffda59baf13) squid (stable), process radosgw, pid 2673837 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 framework: beast 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 framework conf key: port, val: 7480 2025-02-11T00:35:13.183-0800 7f76b02eca40 1 init_numa not setting numa affinity 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 pidfile_write: ignore empty --pid-file 2025-02-11T00:35:13.187-0800 7f76b02eca40 -1 rgw main: ERROR: failed to initialize config store 'dbstore': unable to open database file 2025-02-11T00:35:13.187-0800 7f76b02eca40 -1 Couldn't init storage provider (RADOS) My intent is to run a standalone radosgw with a filesystem backend, which works as a s3 gateway. It would be better if i can avoid running a ceph-mon and other daemons as it is just working as a s3 gateway. Are there any configuration steps I am missing here? Please point me to any documentation available on this. Would appreciate any help on this. Best, Varada
Anyone tried the posix backend for Ceph radosgw? Appreciate any pointers here on configuring and testing. Varada On Fri, Feb 14, 2025 at 12:40 PM Varada Kari <varada.kari@gmail.com> wrote:
Hi,
I am trying to test the posix backend for radosgw in my test machine. It is running Ubuntu 22.04 with the latest squid release(19.2.0) I have configured a small single node cluster without any osd.
$ sudo ceph -v ceph version 19.2.0 (16063ff2022298c9300e49a547a16ffda59baf13) squid (stable) $ sudo ceph -s cluster: id: 92d1770c-e83e-11ef-bcc9-5f5839c0a1fa health: HEALTH_WARN Failed to place 1 daemon(s) Reduced data availability: 1 pg inactive OSD count 0 < osd_pool_default_size 3
services: mon: 1 daemons, quorum testserver (age 3d) mgr: testserver.iavwwx(active, since 2d) osd: 0 osds: 0 up, 0 in
data: pools: 1 pools, 1 pgs objects: 0 objects, 0 B usage: 0 B used, 0 B / 0 B avail pgs: 100.000% pgs unknown 1 unknown
progress: Global Recovery Event (0s) [............................]
Test machine is running a raided xfs file system. Using the below config in the radosgw.conf
[client]
rgw backend store = dbstore rgw config store = dbstore dbstore db dir = /mnt/raidx/rgw/dbstore dbstore_config_uri = file:///mnt/raidx/dbstore/config.db
rgw filter = posix rgw posix base path = /mnt/raidx/posix/root rgw posix database root = /mnt/raidx/rgw/posix/lmdb
[client.radosgw.gateway] rgw init timeout = 1200 rgw frontends = beast port=80
Not able to start the radosgw, fails to initialize the rados.
2025-02-11T00:35:13.183-0800 7f76b02eca40 0 ceph version 19.2.0 (16063ff2022298c9300e49a547a16ffda59baf13) squid (stable), process radosgw, pid 2673837 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 framework: beast 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 framework conf key: port, val: 7480 2025-02-11T00:35:13.183-0800 7f76b02eca40 1 init_numa not setting numa affinity 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 pidfile_write: ignore empty --pid-file 2025-02-11T00:35:13.187-0800 7f76b02eca40 -1 rgw main: ERROR: failed to initialize config store 'dbstore': unable to open database file 2025-02-11T00:35:13.187-0800 7f76b02eca40 -1 Couldn't init storage provider (RADOS)
My intent is to run a standalone radosgw with a filesystem backend, which works as a s3 gateway. It would be better if i can avoid running a ceph-mon and other daemons as it is just working as a s3 gateway. Are there any configuration steps I am missing here? Please point me to any documentation available on this. Would appreciate any help on this.
Best, Varada
This might be helpful - https://github.com/mmgaggle/zgw/tree/posix On Sat, Feb 15, 2025 at 05:38 Varada Kari <varada.kari@gmail.com> wrote:
Anyone tried the posix backend for Ceph radosgw? Appreciate any pointers here on configuring and testing.
Varada
On Fri, Feb 14, 2025 at 12:40 PM Varada Kari <varada.kari@gmail.com> wrote:
Hi,
I am trying to test the posix backend for radosgw in my test machine. It is running Ubuntu 22.04 with the latest squid release(19.2.0) I have configured a small single node cluster without any osd.
$ sudo ceph -v ceph version 19.2.0 (16063ff2022298c9300e49a547a16ffda59baf13) squid (stable) $ sudo ceph -s cluster: id: 92d1770c-e83e-11ef-bcc9-5f5839c0a1fa health: HEALTH_WARN Failed to place 1 daemon(s) Reduced data availability: 1 pg inactive OSD count 0 < osd_pool_default_size 3
services: mon: 1 daemons, quorum testserver (age 3d) mgr: testserver.iavwwx(active, since 2d) osd: 0 osds: 0 up, 0 in
data: pools: 1 pools, 1 pgs objects: 0 objects, 0 B usage: 0 B used, 0 B / 0 B avail pgs: 100.000% pgs unknown 1 unknown
progress: Global Recovery Event (0s) [............................]
Test machine is running a raided xfs file system. Using the below config in the radosgw.conf
[client]
rgw backend store = dbstore rgw config store = dbstore dbstore db dir = /mnt/raidx/rgw/dbstore dbstore_config_uri = file:///mnt/raidx/dbstore/config.db
rgw filter = posix rgw posix base path = /mnt/raidx/posix/root rgw posix database root = /mnt/raidx/rgw/posix/lmdb
[client.radosgw.gateway] rgw init timeout = 1200 rgw frontends = beast port=80
Not able to start the radosgw, fails to initialize the rados.
2025-02-11T00:35:13.183-0800 7f76b02eca40 0 ceph version 19.2.0 (16063ff2022298c9300e49a547a16ffda59baf13) squid (stable), process radosgw, pid 2673837 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 framework: beast 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 framework conf key: port, val: 7480 2025-02-11T00:35:13.183-0800 7f76b02eca40 1 init_numa not setting numa affinity 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 pidfile_write: ignore empty --pid-file 2025-02-11T00:35:13.187-0800 7f76b02eca40 -1 rgw main: ERROR: failed to initialize config store 'dbstore': unable to open database file 2025-02-11T00:35:13.187-0800 7f76b02eca40 -1 Couldn't init storage provider (RADOS)
My intent is to run a standalone radosgw with a filesystem backend, which works as a s3 gateway. It would be better if i can avoid running a ceph-mon and other daemons as it is just working as a s3 gateway. Are there any configuration steps I am missing here? Please point me to any documentation available on this. Would appreciate any help on this.
Best, Varada
_______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
Thanks Kyle for the pointer. Varada On Mon, Feb 17, 2025 at 9:52 AM Kyle Bader <kyle.bader@gmail.com> wrote:
This might be helpful -
https://github.com/mmgaggle/zgw/tree/posix
On Sat, Feb 15, 2025 at 05:38 Varada Kari <varada.kari@gmail.com> wrote:
Anyone tried the posix backend for Ceph radosgw? Appreciate any pointers here on configuring and testing.
Varada
On Fri, Feb 14, 2025 at 12:40 PM Varada Kari <varada.kari@gmail.com> wrote:
Hi,
I am trying to test the posix backend for radosgw in my test machine. It is running Ubuntu 22.04 with the latest squid release(19.2.0) I have configured a small single node cluster without any osd.
$ sudo ceph -v ceph version 19.2.0 (16063ff2022298c9300e49a547a16ffda59baf13) squid (stable) $ sudo ceph -s cluster: id: 92d1770c-e83e-11ef-bcc9-5f5839c0a1fa health: HEALTH_WARN Failed to place 1 daemon(s) Reduced data availability: 1 pg inactive OSD count 0 < osd_pool_default_size 3
services: mon: 1 daemons, quorum testserver (age 3d) mgr: testserver.iavwwx(active, since 2d) osd: 0 osds: 0 up, 0 in
data: pools: 1 pools, 1 pgs objects: 0 objects, 0 B usage: 0 B used, 0 B / 0 B avail pgs: 100.000% pgs unknown 1 unknown
progress: Global Recovery Event (0s) [............................]
Test machine is running a raided xfs file system. Using the below config in the radosgw.conf
[client]
rgw backend store = dbstore rgw config store = dbstore dbstore db dir = /mnt/raidx/rgw/dbstore dbstore_config_uri = file:///mnt/raidx/dbstore/config.db
rgw filter = posix rgw posix base path = /mnt/raidx/posix/root rgw posix database root = /mnt/raidx/rgw/posix/lmdb
[client.radosgw.gateway] rgw init timeout = 1200 rgw frontends = beast port=80
Not able to start the radosgw, fails to initialize the rados.
2025-02-11T00:35:13.183-0800 7f76b02eca40 0 ceph version 19.2.0 (16063ff2022298c9300e49a547a16ffda59baf13) squid (stable), process radosgw, pid 2673837 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 framework: beast 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 framework conf key: port, val: 7480 2025-02-11T00:35:13.183-0800 7f76b02eca40 1 init_numa not setting numa affinity 2025-02-11T00:35:13.183-0800 7f76b02eca40 0 pidfile_write: ignore empty --pid-file 2025-02-11T00:35:13.187-0800 7f76b02eca40 -1 rgw main: ERROR: failed to initialize config store 'dbstore': unable to open database file 2025-02-11T00:35:13.187-0800 7f76b02eca40 -1 Couldn't init storage provider (RADOS)
My intent is to run a standalone radosgw with a filesystem backend, which works as a s3 gateway. It would be better if i can avoid running a ceph-mon and other daemons as it is just working as a s3 gateway. Are there any configuration steps I am missing here? Please point me to any documentation available on this. Would appreciate any help on this.
Best, Varada
_______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
participants (2)
-
Kyle Bader
-
Varada Kari