22 Apr
2021
22 Apr
'21
7:26 p.m.
I'm trying to configure an S3 gateway with pacific and can't wrap my mind around.
In the configuration file, my configuration is:
[client.radosgw.fa41]
rgw_data = /data/ceph/data/radosgw/$cluster.$id
log_file = /data/ceph/logs/$cluster-radosgw.$id.log
rgw_frontends = "beast ssl_endpoint=0.0.0.0:443
ssl_certificate=/data/ceph/conf/ceph.crt ssl_private_key=/data/ceph/conf/ceph.key"
and radosgw ignore it:
# /usr/bin/radosgw -d --cluster ngceph --name client.fa41 --setuser ceph --setgroup ceph
2021-04-22T20:19:44.362+0200 7fdf51416480 0 deferred set uid:gid to 167:167 (ceph:ceph)
2021-04-22T20:19:44.363+0200 7fdf51416480 0 ceph version 16.2.1
(afb9061ab4117f798c858c741efa6390e48ccf10) pacific (stable), process radosgw, pid 9780
2021-04-22T20:19:44.363+0200 7fdf51416480 0 framework: beast
2021-04-22T20:19:44.363+0200 7fdf51416480 0 framework conf key: port, val: 7480
2021-04-22T20:19:44.363+0200 7fdf51416480 1 radosgw_Main not setting numa affinity
2021-04-22T20:19:45.585+0200 7fdf51416480 0 framework: beast
2021-04-22T20:19:45.586+0200 7fdf51416480 0 framework conf key: ssl_certificate, val:
config://rgw/cert/$realm/$zone.crt
2021-04-22T20:19:45.586+0200 7fdf51416480 0 framework conf key: ssl_private_key, val:
config://rgw/cert/$realm/$zone.key
2021-04-22T20:19:45.586+0200 7fdf51416480 0 starting handler: beast
2021-04-22T20:19:45.592+0200 7fdf51416480 0 WARNING: cannot open socket for
endpoint=[::]:7480, Address family not supported by protocol
2021-04-22T20:19:45.627+0200 7fdf51416480 0 set uid:gid to 167:167 (ceph:ceph)
2021-04-22T20:19:45.811+0200 7fdf51416480 1 mgrc service_daemon_register rgw.134130
metadata {arch=x86_64,ceph_release=pacific,ceph_version=ceph version 16.2.1
(afb9061ab4117f798c858c741efa6390e48ccf10) pacific
(stable),ceph_version_short=16.2.1,cpu=Intel Core Processor (Haswell, no
TSX),distro=centos,distro_description=CentOS Linux
8,distro_version=8,frontend_config#0=beast
port=7480,frontend_type#0=beast,hostname=fa41,id=fa41,kernel_description=#1 SMP Thu Apr 8
19:01:30 UTC
2021,kernel_version=4.18.0-240.22.1.el8_3.x86_64,mem_swap_kb=0,mem_total_kb=16211232,num_handles=1,os=Linux,pid=9780,zone_id=2dc75a54-8c59-42bc-98a8-35542fdc4e52,zone_name=default,zonegroup_id=d11b8d14-7608-4b1d-a548-09b5dd813a7a,zonegroup_name=default}
I don't get what I'm missing. Is there any typo in the configuration that I'm
missing ?
I've verified using strace, and it reads the expected configuration file.
22 Apr
22 Apr
7:40 p.m.
On Thu, Apr 22, 2021 at 2:26 PM Fabrice Bacchella
<fabrice.bacchella(a)orange.fr> wrote:
I'm trying to configure an S3 gateway with pacific and can't wrap my mind
around.
In the configuration file, my configuration is:
[client.radosgw.fa41]
rgw_data = /data/ceph/data/radosgw/$cluster.$id
log_file = /data/ceph/logs/$cluster-radosgw.$id.log
rgw_frontends = "beast ssl_endpoint=0.0.0.0:443
ssl_certificate=/data/ceph/conf/ceph.crt ssl_private_key=/data/ceph/conf/ceph.key"
and radosgw ignore it:
# /usr/bin/radosgw -d --cluster ngceph --name client.fa41 --setuser ceph --setgroup ceph
the --name should match the ceph.conf section. does '--name
client.radosgw.fa41' work?
2021-04-22T20:19:44.362+0200 7fdf51416480 0 deferred
set uid:gid to 167:167 (ceph:ceph)
2021-04-22T20:19:44.363+0200 7fdf51416480 0 ceph version 16.2.1
(afb9061ab4117f798c858c741efa6390e48ccf10) pacific (stable), process radosgw, pid 9780
2021-04-22T20:19:44.363+0200 7fdf51416480 0 framework: beast
2021-04-22T20:19:44.363+0200 7fdf51416480 0 framework conf key: port, val: 7480
2021-04-22T20:19:44.363+0200 7fdf51416480 1 radosgw_Main not setting numa affinity
2021-04-22T20:19:45.585+0200 7fdf51416480 0 framework: beast
2021-04-22T20:19:45.586+0200 7fdf51416480 0 framework conf key: ssl_certificate, val:
config://rgw/cert/$realm/$zone.crt
2021-04-22T20:19:45.586+0200 7fdf51416480 0 framework conf key: ssl_private_key, val:
config://rgw/cert/$realm/$zone.key
2021-04-22T20:19:45.586+0200 7fdf51416480 0 starting handler: beast
2021-04-22T20:19:45.592+0200 7fdf51416480 0 WARNING: cannot open socket for
endpoint=[::]:7480, Address family not supported by protocol
2021-04-22T20:19:45.627+0200 7fdf51416480 0 set uid:gid to 167:167 (ceph:ceph)
2021-04-22T20:19:45.811+0200 7fdf51416480 1 mgrc service_daemon_register rgw.134130
metadata {arch=x86_64,ceph_release=pacific,ceph_version=ceph version 16.2.1
(afb9061ab4117f798c858c741efa6390e48ccf10) pacific
(stable),ceph_version_short=16.2.1,cpu=Intel Core Processor (Haswell, no
TSX),distro=centos,distro_description=CentOS Linux
8,distro_version=8,frontend_config#0=beast
port=7480,frontend_type#0=beast,hostname=fa41,id=fa41,kernel_description=#1 SMP Thu Apr 8
19:01:30 UTC
2021,kernel_version=4.18.0-240.22.1.el8_3.x86_64,mem_swap_kb=0,mem_total_kb=16211232,num_handles=1,os=Linux,pid=9780,zone_id=2dc75a54-8c59-42bc-98a8-35542fdc4e52,zone_name=default,zonegroup_id=d11b8d14-7608-4b1d-a548-09b5dd813a7a,zonegroup_name=default}
I don't get what I'm missing. Is there any typo in the configuration that I'm
missing ?
I've verified using strace, and it reads the expected configuration file.
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
8:29 p.m.
Le 22 avr. 2021 à 20:40, Casey Bodley
<cbodley(a)redhat.com> a écrit :
On Thu, Apr 22, 2021 at 2:26 PM Fabrice Bacchella
<fabrice.bacchella(a)orange.fr <mailto:fabrice.bacchella@orange.fr>> wrote:
Indeed it works much better now, thanks.
But I took the argument from the unit:
ExecStart=/usr/bin/radosgw -f --cluster ${CLUSTER} --name client.%i --setuser ceph
--setgroup ceph
So to works, the unit to start should be ceph-radosgw(a)radosgw.fa41.service. That's
would be a little strange.
And in the dashboard, it's shown as with an ID of radosgw.fa41 in the ObjectGatway
screen. Isn't that some kind of inconcistency about what is the ID for a client ?
Meanwhile, neither
/usr/bin/radosgw -d --cluster ngceph -i radosgw.fa41 --setuser ceph --setgroup ceph
or
/usr/bin/radosgw -d --cluster ngceph -i fa41 --setuser ceph --setgroup ceph
I've installed ceph-radosgw-16.2.1-0.el8.x86_64 directly from the ceph repositories.
I'm trying to configure an S3 gateway with pacific and can't wrap my mind
around.
In the configuration file, my configuration is:
[client.radosgw.fa41]
rgw_data = /data/ceph/data/radosgw/$cluster.$id
log_file = /data/ceph/logs/$cluster-radosgw.$id.log
rgw_frontends = "beast ssl_endpoint=0.0.0.0:443
ssl_certificate=/data/ceph/conf/ceph.crt ssl_private_key=/data/ceph/conf/ceph.key"
and radosgw ignore it:
# /usr/bin/radosgw -d --cluster ngceph --name client.fa41 --setuser ceph --setgroup ceph
the --name should match the ceph.conf section. does '--name
client.radosgw.fa41' work?
> 2021-04-22T20:19:44.362+0200 7fdf51416480 0 deferred set uid:gid to 167:167
(ceph:ceph)
> 2021-04-22T20:19:44.363+0200 7fdf51416480 0 ceph version 16.2.1
(afb9061ab4117f798c858c741efa6390e48ccf10) pacific (stable), process radosgw, pid 9780
> 2021-04-22T20:19:44.363+0200 7fdf51416480 0 framework: beast
> 2021-04-22T20:19:44.363+0200 7fdf51416480 0 framework conf key: port, val: 7480
> 2021-04-22T20:19:44.363+0200 7fdf51416480 1 radosgw_Main not setting numa affinity
> 2021-04-22T20:19:45.585+0200 7fdf51416480 0 framework: beast
> 2021-04-22T20:19:45.586+0200 7fdf51416480 0 framework conf key: ssl_certificate,
val: config://rgw/cert/$realm/$zone.crt
> 2021-04-22T20:19:45.586+0200 7fdf51416480 0 framework conf key: ssl_private_key,
val: config://rgw/cert/$realm/$zone.key
> 2021-04-22T20:19:45.586+0200 7fdf51416480 0 starting handler: beast
> 2021-04-22T20:19:45.592+0200 7fdf51416480 0 WARNING: cannot open socket for
endpoint=[::]:7480, Address family not supported by protocol
> 2021-04-22T20:19:45.627+0200 7fdf51416480 0 set uid:gid to 167:167 (ceph:ceph)
> 2021-04-22T20:19:45.811+0200 7fdf51416480 1 mgrc service_daemon_register rgw.134130
metadata {arch=x86_64,ceph_release=pacific,ceph_version=ceph version 16.2.1
(afb9061ab4117f798c858c741efa6390e48ccf10) pacific
(stable),ceph_version_short=16.2.1,cpu=Intel Core Processor (Haswell, no
TSX),distro=centos,distro_description=CentOS Linux
8,distro_version=8,frontend_config#0=beast
port=7480,frontend_type#0=beast,hostname=fa41,id=fa41,kernel_description=#1 SMP Thu Apr 8
19:01:30 UTC
2021,kernel_version=4.18.0-240.22.1.el8_3.x86_64,mem_swap_kb=0,mem_total_kb=16211232,num_handles=1,os=Linux,pid=9780,zone_id=2dc75a54-8c59-42bc-98a8-35542fdc4e52,zone_name=default,zonegroup_id=d11b8d14-7608-4b1d-a548-09b5dd813a7a,zonegroup_name=default}
>
> I don't get what I'm missing. Is there any typo in the configuration that
I'm missing ?
>
> I've verified using strace, and it reads the expected configuration file.
> _______________________________________________
> ceph-users mailing list -- ceph-users(a)ceph.io
> To unsubscribe send an email to ceph-users-leave(a)ceph.io
9:32 p.m.
I agree. Documentation here is pretty vague. systemd services for osds on
ubuntu 20.04 and ceph pacific version 16.2.1 does not work either, so I
have to run it manually with
/usr/bin/ceph-osd -f --cluster ceph --id some-number --setuser ceph
--setgroup ceph
I think it would be much better if documentation would focus on how to run
it manually without systemd help, because distributions are not all "the
same" even with systemd in place.
Rok
V V čet., 22. apr. 2021 ob 21:29 je oseba Fabrice Bacchella <
fabrice.bacchella(a)orange.fr> napisala:
Le 22 avr. 2021 à 20:40, Casey Bodley
<cbodley(a)redhat.com> a écrit :
On Thu, Apr 22, 2021 at 2:26 PM Fabrice Bacchella
<fabrice.bacchella(a)orange.fr <mailto:fabrice.bacchella@orange.fr>>
wrote:
>
> I'm trying to configure an S3 gateway with pacific and can't wrap my
mind around.
>
> In the configuration file, my configuration is:
>
> [client.radosgw.fa41]
> rgw_data = /data/ceph/data/radosgw/$cluster.$id
> log_file = /data/ceph/logs/$cluster-radosgw.$id.log
> rgw_frontends = "beast ssl_endpoint=0.0.0.0:443
ssl_certificate=/data/ceph/conf/ceph.crt
ssl_private_key=/data/ceph/conf/ceph.key"
>
> and radosgw ignore it:
>
> # /usr/bin/radosgw -d --cluster ngceph --name client.fa41 --setuser
ceph
--setgroup ceph
the --name should match the ceph.conf section. does '--name
client.radosgw.fa41' work?
Indeed it works much better now, thanks.
But I took the argument from the unit:
ExecStart=/usr/bin/radosgw -f --cluster ${CLUSTER} --name client.%i
--setuser ceph --setgroup ceph
So to works, the unit to start should be ceph-radosgw(a)radosgw.fa41.service.
That's would be a little strange.
And in the dashboard, it's shown as with an ID of radosgw.fa41 in the
ObjectGatway screen. Isn't that some kind of inconcistency about what is
the ID for a client ?
Meanwhile, neither
/usr/bin/radosgw -d --cluster ngceph -i radosgw.fa41 --setuser ceph
--setgroup ceph
or
/usr/bin/radosgw -d --cluster ngceph -i fa41 --setuser ceph --setgroup ceph
I've installed ceph-radosgw-16.2.1-0.el8.x86_64 directly from the ceph
repositories.
> 2021-04-22T20:19:44.362+0200 7fdf51416480 0 deferred set uid:gid to
167:167
(ceph:ceph)
> 2021-04-22T20:19:44.363+0200 7fdf51416480 0
ceph version 16.2.1
(afb9061ab4117f798c858c741efa6390e48ccf10) pacific (stable),
process
radosgw, pid 9780
> 2021-04-22T20:19:44.363+0200 7fdf51416480 0
framework: beast
> 2021-04-22T20:19:44.363+0200 7fdf51416480 0 framework conf key: port,
val:
7480
> 2021-04-22T20:19:44.363+0200 7fdf51416480 1
radosgw_Main not setting
numa affinity
> 2021-04-22T20:19:45.585+0200 7fdf51416480 0
framework: beast
> 2021-04-22T20:19:45.586+0200 7fdf51416480 0 framework conf key:
ssl_certificate, val: config://rgw/cert/$realm/$zone.crt
> 2021-04-22T20:19:45.586+0200 7fdf51416480 0
framework conf key:
ssl_private_key, val: config://rgw/cert/$realm/$zone.key
> 2021-04-22T20:19:45.586+0200 7fdf51416480 0
starting handler: beast
> 2021-04-22T20:19:45.592+0200 7fdf51416480 0 WARNING: cannot open
socket for
endpoint=[::]:7480, Address family not supported by protocol
> 2021-04-22T20:19:45.627+0200 7fdf51416480 0
set uid:gid to 167:167
(ceph:ceph)
> 2021-04-22T20:19:45.811+0200 7fdf51416480 1
mgrc
service_daemon_register rgw.134130 metadata
{arch=x86_64,ceph_release=pacific,ceph_version=ceph version 16.2.1
(afb9061ab4117f798c858c741efa6390e48ccf10) pacific
(stable),ceph_version_short=16.2.1,cpu=Intel Core Processor (Haswell, no
TSX),distro=centos,distro_description=CentOS Linux
8,distro_version=8,frontend_config#0=beast
port=7480,frontend_type#0=beast,hostname=fa41,id=fa41,kernel_description=#1
SMP Thu Apr 8 19:01:30 UTC
2021,kernel_version=4.18.0-240.22.1.el8_3.x86_64,mem_swap_kb=0,mem_total_kb=16211232,num_handles=1,os=Linux,pid=9780,zone_id=2dc75a54-8c59-42bc-98a8-35542fdc4e52,zone_name=default,zonegroup_id=d11b8d14-7608-4b1d-a548-09b5dd813a7a,zonegroup_name=default}
>
> I don't get what I'm missing. Is there any typo in the configuration
that I'm missing ?
>
> I've verified using strace, and it reads the expected configuration
file.
>
_______________________________________________
> ceph-users mailing list -- ceph-users(a)ceph.io
> To unsubscribe send an email to ceph-users-leave(a)ceph.io
_______________________________________________
ceph-users mailing list -- ceph-users(a)ceph.io
To unsubscribe send an email to ceph-users-leave(a)ceph.io
1122
days inactive
1122
days old
3 comments
3 participants
participants (3)
-
Casey Bodley -
Fabrice Bacchella -
Rok Jaklič