Hi Mohamed,
On Jan 22, 2020, at 10:05 AM, mohamed zayan
<mohamed.zayan19(a)gmail.com <mailto:mohamed.zayan19@gmail.com>> wrote:
Currently I have a cluster of 2 nodes on two raspberrypi 3 devices.
pi1 is admin/mon/mgr/osd
pi2 is osd
I am currently trying to run radosgw on pi2. I have failed multiple times
/var/lib/ceph/radosgw# /usr/bin/radosgw -f --cluster ceph --name
client.rgw.pi2 --setuser ceph --setgroup ceph
Thread::try_create(): pthread_create failed with error
11/tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc
<http://thread.cc/>:
In function 'void Thread::create(const char *, size_t)' thread
71114000 time 2020-01-22 14:58:13.793803
/tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc
<http://thread.cc/>:
152: FAILED assert(ret == 0)
I’m not too familiar with the Raspberry Pi platform or Raspbian. But there are some clues
in the output you provided, specifically this text — “ Thread::try_create():
pthread_create failed with error 11”.
I assume these low valued error codes are consistent between Fedora and Raspbian, and so
the code 11 means:
#define EAGAIN 11 /* Try again */
I found the following:
https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eaga…
<https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eagain>
So that seems to leave 3 possibilities:
1. RGW is asking for more resources that your platform is able to provide.
a. There are limits as to the number of threads.
b. There may be a memory limit, since each thread needs to maintain its own stack.
2. There is a bug in RGW where completed threads are not thread_join’d by their parents.
a. This seems unlikely as this appears to happen during start-up before threads are
likely done with their work.
3. Florian Weimer identifies a kernel bug.
I suspect it’s #1, so you might want to try reducing the number of threads rgw uses by
lowering the value of rgw_thread_pool_size in your configuration.
Eric
--
J. Eric Ivancich
he / him / his
Red Hat Storage
Ann Arbor, Michigan, USA