Hi Mohamed,
On Jan 22, 2020, at 10:05 AM, mohamed zayan <mohamed.zayan19@gmail.com <mailto:mohamed.zayan19@gmail.com>> wrote:
Currently I have a cluster of 2 nodes on two raspberrypi 3 devices. pi1 is admin/mon/mgr/osd
pi2 is osd
I am currently trying to run radosgw on pi2. I have failed multiple times
/var/lib/ceph/radosgw# /usr/bin/radosgw -f --cluster ceph --name client.rgw.pi2 --setuser ceph --setgroup ceph Thread::try_create(): pthread_create failed with error 11/tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc <http://thread.cc/>: In function 'void Thread::create(const char *, size_t)' thread 71114000 time 2020-01-22 14:58:13.793803 /tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc <http://thread.cc/>: 152: FAILED assert(ret == 0)
I’m not too familiar with the Raspberry Pi platform or Raspbian. But there are some clues in the output you provided, specifically this text — “ Thread::try_create(): pthread_create failed with error 11”. I assume these low valued error codes are consistent between Fedora and Raspbian, and so the code 11 means: #define EAGAIN 11 /* Try again */ I found the following: https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eagai... <https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eagain> So that seems to leave 3 possibilities: 1. RGW is asking for more resources that your platform is able to provide. a. There are limits as to the number of threads. b. There may be a memory limit, since each thread needs to maintain its own stack. 2. There is a bug in RGW where completed threads are not thread_join’d by their parents. a. This seems unlikely as this appears to happen during start-up before threads are likely done with their work. 3. Florian Weimer identifies a kernel bug. I suspect it’s #1, so you might want to try reducing the number of threads rgw uses by lowering the value of rgw_thread_pool_size in your configuration. Eric -- J. Eric Ivancich he / him / his Red Hat Storage Ann Arbor, Michigan, USA