- ceph-users - lists.ceph.io

100 % Genuine Call Girls In Paharganj Delhi 8448079011 Escort Service In Delhi
by Vicky Singh 14 Jun '24

14 Jun '24

Call Vicky 8448079011 Book Call Girls In Paharganj Delhi Independent /Mahipalpur, Available inbound and outbound escorts in India for home or hotel service at reasonable charges. The need for escorts or a professional companion in India is growing with the increasing number of city people. The person who has to be a companion should have a good sense of humor and should be able to understand the needs of the person they are accompanying. The person who has to be a companion should also have the ability to communicate well with this person. Service providers with us are much expected to follow all best Indian level qualities. High standards level quality is available to the clients. The person who is accompanying someone should be able to offer the companionship that the other needs and provide a sense of security. This will require them to be patient, friendly and respectful. The male fantasy is what a man would like to see in a woman. It is the opposite of the female fantasy. The male fantasy is most often associated with physical attractiveness and sex appeal. Male fantasies are not just limited to visual aspects, but also include personality traits such as intelligence, humor and kindness. Fantasy of a partner who is physically attractive and smart (attractive) In the same way men are more likely than women to fantasize about being with an intelligent partner, men also tend to fantasize about having an attractive partner. Men may fantasize about their female partners being physically attractive and as such demonstrating high levels of tight bulging figure with ultimate sex appeal It is the opposite of the female fantasy. The male fantasy is most often associated with physical attractiveness and sex appeal. Male fantasies are not just limited to visual aspects, but also include personality traits such as intelligence, humor and kindness. Fantasy of a partner who is physically attractive and smart (attractive) In the same way men are more likely than women to fantasize about being with an intelligent partner, men also tend to fantasize about having an attractive partner. Men may fantasize about their female partners being physically attractive and as such demonstrating high levels of tight bulging figure with ultimate sex appeal It is the opposite of the female fantasy. The male fantasy is most often associated with physical attractiveness and sex appeal. Male fantasies are not just limited to visual aspects, but also include personality traits such as intelligence, humor and kindness. Fantasy of a partner who is physically attractive and smart (attractive) In the same way men are more likely than women to fantasize about being with an intelligent partner, men also tend to fantasize about having an attractive partner. Men may fantasize about their female partners being physically attractive and as such demonstrating high levels of tight bulging figure with ultimate sex appeal but also include personality traits such as intelligence, humor and kindness. Fanta About Us Green Park Escort Delhi Okhla Escort Delhi Lajpat Nagar Escort Delhi Delhi/New Delhi Escort Dwarka Escort Delhi Call Girls In Karol Bagh Delhi Paharganj Call Girls Delhi Majnu Ka tilla Escort Delhi Pitampura Escort Delhi GTB Nagar Escort Delhi Badarpur Escort Delhi Sarita Vihar Escort Delhi/ Nehru Place Call Girls Delhi Hauz Khas Escort Delhi Katwaria Sarai Escort Delhi Lado sarai Escort delhi Kalkaji Escort Delhi Safadarjung Escort Service Delhi Saket Escort Service Delhi Vasant Kunj Escort Delhi/ RK Puram Escort Delhi/ Bhikaji Cama Palace Escort Delhi Aerocity Escort Service Delhi Mahipalpur Escort Delhi Dhaula Kuan Escort Service Delhi Tilak Nagar Escort Service Delhi Chanakyapuri Escort Service Delhi Janakpuri Escort Service In Delhi Kirti Nagar Escort Delhi Patel Nagar Escort Service Delhi Patel Chowk Escort Service Delhi Connaught Place Escort Service Delhi Rajouri Garden Escort Delhi Anand Vihar Escort Service Delhi Kashmeri Gate Escort Service Delhi Ajmiri Gate Escort Service Delhi Jor Bagh Escort Service Delhi ALL Delhi Ncr

1 0

Are ceph commands backward compatible?
by Satoru Takeuchi 13 Jun '24

13 Jun '24

Hi, I'm developing some tools that execute ceph commands like rbd. During development, I have come to wonder about compatibility of ceph commands. I'd like to use ceph commands which version is >= the version used by ceph daemons. It results in executing new ceph commands against ceph clusters using old versions. So I'd like to know my tools are expected to work fine. Coud someone tell me whether ceph commands are backword compatible? The officlal document didn't have the information I needed. Thanks, Satoru

1 0

deep scrubb and scrubb does get the job done
by Manuel Oetiker 13 Jun '24

13 Jun '24

Hi our cluster is on warning for more than two weeks we had to move some pools form ssd to hdd and it looked good ... but somehow the pgs scrubb does not get done with his jobs * PG_NOT_DEEP_SCRUBBED : 171 pgs not deep-scrubbed in time * PG_NOT_SCRUBBED : 132 pgs not scrubbed in time Till the move the cluster was happy without any warnings... There is no have load on the cluster I don't see why the cluster get not done with that... is there a way to find out why ... Thanks for any hint Manuel

2 1

Can't comment on my own tracker item any more
by Frank Schilder 13 Jun '24

13 Jun '24

Hi all, I just received a notification about a bug I reported 4 years ago (https://tracker.ceph.com/issues/45253) > Issue #45253 has been updated by Victoria Mackie. I would like to leave a comment, but the comment function seems not available any more even through I'm logged in and I'm reported as the author. I can still edit the item itself, but I'm not able to leave comments. Can someone please look into that? Thanks! ================= Frank Schilder AIT Risø Campus Bygning 109, rum S14

1 1

Performance issues RGW (S3)
by sinan＠turka.nl 13 Jun '24

13 Jun '24

Hi all, My Ceph setup: - 12 OSD nodes, 4 OSD nodes per rack. Replication of 3, 1 replica per rack. - 20 spinning SAS disks per node. - Some nodes have 256GB RAM, some nodes 128GB. - CPU varies between Intel E5-2650 and Intel Gold 5317. - Each node has 10Gbit/s network. Using rados bench I am getting decent results (depending on block size): - 1000 MB/s throughput, 1000 IOps with 1MB block size - 30 MB/s throughput, 7500 IOps with 4K block size Unfortunately not getting the same performance with Rados Gateway (S3). - 1x HAProxy with 3 backend RGW's. I am using Minio Warp for benchmarking (PUT). I am 1 Warp server and 5 Warp clients. Benchmarking towards the HAProxy. Results: - Using 10MB object size, I am hitting the 10Gbit/s link of the HAProxy server. Thats good. - Using 500K object size, I am getting a throughput of 70 up to 150 MB/s with 140 up to 300 obj/s. It depends on the concurrency setting of Warp. It look likes the objects/s is the bottleneck, not the throughput. Max memory usage is about 80-90GB per node. CPU's are quite idling. Is it reasonable to expect more IOps / objects/s for RGW with my setup? At this moment I am not able to find the bottleneck what is causing the low obj/s. Ceph version is 15.2. Thanks!

4 14

Ceph crash :-(
by Ranjan Ghosh 13 Jun '24

13 Jun '24

Hi all, I just upgraded the first node of our cluster to Ubuntu 24.04 (Noble) from 23.10 (Mantic). Unfortunately Ceph doesnt work anymore on the new node: === ceph version 19.2.0~git20240301.4c76c50 (4c76c50a73f63ba48ccdf0adccce03b00d1d80c7) squid (dev) 1: /lib/x86_64-linux-gnu/libc.so.6(+0x45320) [0x7c7da3c45320] 2: pthread_kill() 3: gsignal() 4: abort() 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xa5ffe) [0x7c7da40a5ffe] 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xbae9c) [0x7c7da40bae9c] 7: (std::unexpected()+0) [0x7c7da40a5a49] 8: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xbb128) [0x7c7da40bb128] 9: (ceph::buffer::v15_2_0::list::iterator_impl<true>::copy(unsigned int, char*)+0xc4) [0x7c7da4a6e414] 10: (MDSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0xc74) [0x7c7da4c98fc4] 11: (MDSDaemon::handle_mds_map(boost::intrusive_ptr<MMDSMap const> const&)+0x2c6) [0x59124a7cd766] 12: (MDSDaemon::handle_core_message(boost::intrusive_ptr<Message const> const&)+0x2c9) [0x59124a7d0d79] 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr<Message> const&)+0xe1) [0x59124a7d1341] 14: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr<Message> const&)+0x3b8) [0x7c7da4930dd8] 15: (DispatchQueue::entry()+0x771) [0x7c7da492ecb1] 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7c7da49f3f81] 17: /lib/x86_64-linux-gnu/libc.so.6(+0x9ca94) [0x7c7da3c9ca94] 18: /lib/x86_64-linux-gnu/libc.so.6(+0x129c3c) [0x7c7da3d29c3c] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. === What's more APT says I now got a Ceph Version (19.2.0~git20240301.4c76c50-0ubuntu6) which doesn't even have any official release notes: https://docs.ceph.com/en/latest/releases/ How did I get here? What can I do to get back a working Ceph version? Until this is resolved, I obviously don't want to upgrade the other nodes. Thank you / BR Ranjan

4 5

Re: Ceph crash :-(
by Robert Sander 13 Jun '24

13 Jun '24

Hi, On 13.06.24 20:29, Ranjan Ghosh wrote: > Other Ceph nodes run on 18.2 which came with the previous Ubuntu version. > > I wonder if I could easily switch to Ceph packages or whether that would > cause even more problems. > > Perhaps it's more advisable to wait until Ubuntu releases proper packages. Read the Ceph documentation about upgrading a Ceph cluster. You cannot just upgrade packages on one node and reboot it. There is a certain order to follow. This is why it's bad to use the packages shipped by the distribution: When upgrading the distribution on one node you also upgrade the Ceph packages. download.ceph.com has packages for Ubuntu 22.04 and nothing for 24.04. Therefor I would assume Ubuntu 24.04 is not a supported platform for Ceph (unless you use the cephadm orchestrator and container). BTW: Please keep the discussion on the mailing list. Regards -- Robert Sander Heinlein Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030-405051-43 Fax: 030-405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

1 0

Testing CEPH scrubbing / self-healing capabilities
by Petr Bena 13 Jun '24

13 Jun '24

Hello, I wanted to try out (lab ceph setup) what exactly is going to happen when parts of data on OSD disk gets corrupted. I created a simple test where I was going through the block device data until I found something that resembled user data (using dd and hexdump) (/dev/sdd is a block device that is used by OSD) INFRA [root@ceph-vm-lab5 ~]# dd if=/dev/sdd bs=32 count=1 skip=33920 | hexdump -C 00000000 6e 20 69 64 3d 30 20 65 78 65 3d 22 2f 75 73 72 |n id=0 exe="/usr| 00000010 2f 73 62 69 6e 2f 73 73 68 64 22 20 68 6f 73 74 |/sbin/sshd" host| Then I deliberately overwrote 32 bytes using random data: INFRA [root@ceph-vm-lab5 ~]# dd if=/dev/urandom of=/dev/sdd bs=32 count=1 seek=33920 INFRA [root@ceph-vm-lab5 ~]# dd if=/dev/sdd bs=32 count=1 skip=33920 | hexdump -C 00000000 25 75 af 3e 87 b0 3b 04 78 ba 79 e3 64 fc 76 d2 |%u.>..;.x.y.d.v.| 00000010 9e 94 00 c2 45 a5 e1 d2 a8 86 f1 25 fc 18 07 5a |....E......%...Z| At this point I would expect some sort of data corruption. I restarted the OSD daemon on this host to make sure it flushes any potentially buffered data. It restarted OK without noticing anything, which was expected. Then I ran ceph osd scrub 5 ceph osd deep-scrub 5 And waiting for all scheduled scrub operations for all PGs to finish. No inconsistency was found. No errors reported, scrubs just finished OK, data are still visibly corrupt via hexdump. Did I just hit some block of data that WAS used by OSD, but was marked deleted and therefore no longer used or am I missing something? I would expect CEPH to detect disk corruption and automatically replace the invalid data with a valid copy? I use only replica pools in this lab setup, for RBD and CephFS. Thanks

4 7

Safe to move misplaced hosts between failure domains in the crush tree?
by Torkil Svensgaard 13 Jun '24

13 Jun '24

Hi We have 3 servers for replica 3 with failure domain datacenter: -1 4437.29248 root default -33 1467.84814 datacenter 714 -69 69.86389 host ceph-flash1 -34 1511.25378 datacenter HX1 -73 69.86389 host ceph-flash2 -36 1458.19067 datacenter UXH -77 69.86389 host ceph-flash3 We made a mistake when we moved the servers physically so while the replica 3 is intact the crush tree is not accurate. If we just remedy the situation with "ceph osd crush move ceph-flashX datacenter=Y" we will just end up with a lot of misplaced data and some churn, right? Or will the affected pool go degraded/unavailable? Mvh. Torkil -- Torkil Svensgaard Sysadmin MR-Forskningssektionen, afs. 714 DRCMR, Danish Research Centre for Magnetic Resonance Hvidovre Hospital Kettegård Allé 30 DK-2650 Hvidovre Denmark Tel: +45 386 22828 E-mail: torkil(a)drcmr.dk

4 8

How radosgw considers that the file upload is done?
by Szabo, Istvan (Agoda) 12 Jun '24

12 Jun '24

Hi, Wonder how radosgw knows that a transaction is done and didn't break the connection between the user interface and gateway? Let's see this is one request: 2024-06-12T16:26:03.386+0700 7fa34c7f0700 1 beast: 0x7fa5bc776750: 1.1.1.1 - - [2024-06-12T16:26:03.386063+0700] "PUT /bucket/0/2/966394.delta HTTP/1.1" 200 238 - "User-Agent: APN/1.0 Hortonworks/1.0 HDP/3.1.0.0-78, Hadoop 3.2.2, aws-sdk-java/1.11.563 Linux/5.15.0-101-generic OpenJDK_64-Bit_Server_VM/11.0.18+10-post-Debian-1deb10u1 java/11.0.18 scala/2.12.15 vendor/Debian com.amazonaws.services.s3.transfer.TransferManager/1.11.563" - 2024-06-12T16:26:03.386+0700 7fa4e9ffb700 1 ====== req done req=0x7fa5a4572750 op status=0 http_status=200 latency=7999937ns ====== What I can see here is the req done op status=0 I guess if the connection broke between user and gateway the req will be done also, but what s op status? Is it the one that I'm actually looking for? If connection broke maybe that is different value? Thank you ________________________________ This message is confidential and is for the sole use of the intended recipient(s). It may also be privileged or otherwise protected by copyright or other legal rules. If you have received it by mistake please let us know by reply email and delete it from your system. It is prohibited to copy this message or disclose its content to anyone. Any confidentiality or privilege is not waived or lost by any mistaken delivery or unauthorized disclosure of the message. All messages sent to and from Agoda may be monitored to ensure compliance with company policies, to protect the company's interests and to remove potential malware. Electronic messages may be intercepted, amended, lost or deleted, or contain viruses.

2 1