- ceph-users - lists.ceph.io

100 % Genuine Call Girls In Janakpuri Delhi 8448079011 Escort Service In Delhi
by Vicky Singh 22 Jun '24

22 Jun '24

Call Vicky 8448079011 Book Call Girls In Janapuri Delhi Independent /Mahipalpur, Available inbound and outbound escorts in India for home or hotel service at reasonable charges. The need for escorts or a professional companion in India is growing with the increasing number of city people. The person who has to be a companion should have a good sense of humor and should be able to understand the needs of the person they are accompanying. The person who has to be a companion should also have the ability to communicate well with this person. Service providers with us are much expected to follow all best Indian level qualities. High standards level quality is available to the clients. The person who is accompanying someone should be able to offer the companionship that the other needs and provide a sense of security. This will require them to be patient, friendly and respectful. The male fantasy is what a man would like to see in a woman. It is the opposite of the female fantasy. The male fantasy is most often associated with physical attractiveness and sex appeal. Male fantasies are not just limited to visual aspects, but also include personality traits such as intelligence, humor and kindness. Fantasy of a partner who is physically attractive and smart (attractive) In the same way men are more likely than women to fantasize about being with an intelligent partner, men also tend to fantasize about having an attractive partner. Men may fantasize about their female partners being physically attractive and as such demonstrating high levels of tight bulging figure with ultimate sex appeal It is the opposite of the female fantasy. The male fantasy is most often associated with physical attractiveness and sex appeal. Male fantasies are not just limited to visual aspects, but also include personality traits such as intelligence, humor and kindness. Fantasy of a partner who is physically attractive and smart (attractive) In the same way men are more likely than women to fantasize about being with an intelligent partner, men also tend to fantasize about having an attractive partner. Men may fantasize about their female partners being physically attractive and as such demonstrating high levels of tight bulging figure with ultimate sex appeal It is the opposite of the female fantasy. The male fantasy is most often associated with physical attractiveness and sex appeal. Male fantasies are not just limited to visual aspects, but also include personality traits such as intelligence, humor and kindness. Fantasy of a partner who is physically attractive and smart (attractive) In the same way men are more likely than women to fantasize about being with an intelligent partner, men also tend to fantasize about having an attractive partner. Men may fantasize about their female partners being physically attractive and as such demonstrating high levels of tight bulging figure with ultimate sex appeal but also include personality traits such as intelligence, humor and kindness. Fanta About Us Green Park Escort Delhi Okhla Escort Delhi Lajpat Nagar Escort Delhi Delhi/New Delhi Escort Dwarka Escort Delhi Call Girls In Karol Bagh Delhi Paharganj Call Girls Delhi Majnu Ka tilla Escort Delhi Pitampura Escort Delhi GTB Nagar Escort Delhi Badarpur Escort Delhi Sarita Vihar Escort Delhi/ Nehru Place Call Girls Delhi Hauz Khas Escort Delhi Katwaria Sarai Escort Delhi Lado sarai Escort delhi Kalkaji Escort Delhi Safadarjung Escort Service Delhi Saket Escort Service Delhi Vasant Kunj Escort Delhi/ RK Puram Escort Delhi/ Bhikaji Cama Palace Escort Delhi Aerocity Escort Service Delhi Mahipalpur Escort Delhi Dhaula Kuan Escort Service Delhi Tilak Nagar Escort Service Delhi Chanakyapuri Escort Service Delhi Janakpuri Escort Service In Delhi Kirti Nagar Escort Delhi Patel Nagar Escort Service Delhi Patel Chowk Escort Service Delhi Connaught Place Escort Service Delhi Rajouri Garden Escort Delhi Anand Vihar Escort Service Delhi Kashmeri Gate Escort Service Delhi Ajmiri Gate Escort Service Delhi Jor Bagh Escort Service Delhi ALL Delhi Ncr

1 0

Phhantom host
by Tim Holloway 22 Jun '24

22 Jun '24

Ceph Pacific Thanks to some misplaced thumbs-on-keyboard, I inadvertently managed to alias a non-ceph system's ip as a ceph host and ceph adopted it somehow. I fixed the fat-fingered IP, and have gone through the usual motions to delete a host, but some parts of the ceph ecosystem haven't caught up. The host no longer shows on "ceph orch host ls', but on the web control panel, it's still there and thinks it has an OSD attached. Ditto for the "ceph health detail". On the other hand, the webapp shows not one, but THREE OSD's associated with the phantom host on the dashboard/hosts detail expansion. It's claiming to own OSD daemons that are actually on other machines. Any assistance would be much appreciated! Tim

2 2

Querying Cephfs Metadata
by Daniel Williams 21 Jun '24

21 Jun '24

Hey, I'm trying to find the last two objects on an old data pool for a cephfs cluster that seemingly aren't found via find && getfattr. More generically though, is there a low level tool or (C++ or Python) library for reading and analyzing cephfs metadata? Daniel

1 0

Cannot mount RBD on client
by service.plant＠ya.ru 21 Jun '24

21 Jun '24

Hi everyone! I've encountered situation I cannot even google. In a nutshell, rbd map test/kek --id test hags forever on ```futex(0x7ffdfa73d748, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 0, NULL, FUTEX_BITSET_MATCH_ANY``` instruction in strace. Of course, I have all the keyrings and ceph.conf on site. I would think about network related problem however there is neither firewall not iptables filtering rules. Tcpdump show that packages fly both ends (i don't know what is inside). The trick is when I bring admin keyring onto client - ```ceph -s``` command works perfect. Thare are no mentions about connection attemp in systemd service of monitors. No mentions at all in any logs. I've been fighting for three days now and no result. So ANY advice is very appreciated and you will receive quants of love from me personally :) Ubuntu 22.04.4 LTS on both client and ceph nodes with kernel 5.15.0-112-generic There is no firewall and no iptables rules filtering rules on client and the same (excluding rules added by docker) on cluster nodes. There is a ping between client and any of cluster nodes. By netcat I can see that OSD and MON ports are open. I am totally lost here. Please, give me a hint what to check and where to find? root@ceph1:/tmp/nfs# ceph -s cluster: id: ceph-fsid health: HEALTH_OK services: mon: 3 daemons, quorum ceph10,ceph6,ceph1 (age 46h) mgr: ceph1.rynror(active, since 46h), standbys: ceph2.nxpjmd osd: 109 osds: 108 up (since 44h), 108 in (since 43h) flags noautoscale data: pools: 6 pools, 6401 pgs objects: 38 objects, 65 MiB usage: 105 TiB used, 1.7 PiB / 1.8 PiB avail pgs: 6401 active+clean Thanks in advance This is ceph v18.2.2

3 3

wrong public_ip after blackout / poweroutage
by mailing-lists 21 Jun '24

21 Jun '24

Dear Cephers, after a succession of unfortunate events, we have suffered a complete datacenter blackout today. Ceph _nearly_ perfectly came back up. The Health was OK and all services were online, but we were having weird problems. Weird as in, we could sometimes map rbds and sometimes not, and sometimes we could use the cephfs and sometimes we could not... Turns out, some osds (id say 5%) came back with the cluster_ip address as their public_ip and thus were not reachable. I do not see any pattern, why some osds are faulty and others are not. The fault is spread over nearly all nodes. This is an example: osd.45 up in weight 1 up_from 184143 up_thru 184164 down_at 184142 last_clean_interval [182655,184103) [v2:192.168.222.20:6834/1536394698,v1:192.168.222.20:6842/1536394698] [v2:192.168.222.20:6848/1536394698,v1:192.168.222.20:6853/1536394698] exists,up 002326c9 This should have a public_ip in the first brackets []. Our cluster-network is 192.168.222.0/24, which is of course only available on the ceph internal switch. Simply restarting the osds that were affected solved this problem... So I am not really asking for your help troubleshooting this; I would just like to understand if there is a reasonable explanation. My guess would be some kind of race-condition when the interfaces came up, but then again, why on ~5% of all osds? ... Anyways im tired, I hope that this mail is somewhat understandable. We are running Ceph 17.2.7 with cephadm docker deployment. If you have any ideas for the cause of this, please let me know. I have not seen this issue when I'm gracefully rebooting the nodes. Best

4 3

Ceph osd df tree takes a long time to respond
by Huy Nguyen 20 Jun '24

20 Jun '24

Ceph version 14.2.7 Ceph osd df tree command take long time than usual but I can't find out what is the reason? The monitor node still has plenty of available RAM and CPU resources. I checked the monitor and mgr log but nothing seems useful. I checked an older cluster in version 13.2.10 but Ceph osd df tree still responded normally, so that was not version related. Anyone have any idea? Thanks

2 2

Full list of metrics provided by ceph exporter daemon
by Peter Razumovsky 20 Jun '24

20 Jun '24

Hello! I'm using Ceph Reef with Rook v1.13 and want to find somewhere a full list of metrics exported by brand new ceph exporter daemon. We found that some metrics have been changed after moving from prometheus module metrics to a separate daemon. We used described method [1] to give us a time to mitigate all risks during transfer to a new daemon. Now we want to obtain a full list of ceph-exporter metrics to compare old and new metrics and to mitigate potential risks of losing monitoring data and breaking alerting systems. We found some examples of metrics [2] but it is not complete so we will appreciate it if someone points us to the full list. [1] https://docs.ceph.com/en/latest/mgr/prometheus/#ceph-daemon-performance-cou… [2] https://docs.ceph.com/en/latest/monitoring/ -- Best regards, Peter Razumovsky

2 3

Daily slow ops around the same time on different osds
by Szabo, Istvan (Agoda) 19 Jun '24

19 Jun '24

Hi, For some reason daily I receive a slow ops which affect the rgw.log pool the most (which is pretty small, 32pg / 57k objects / 9.5GB data) Could be the issue related to rocksdb tasks? Some log lines: ... 2024-06-18T14:17:43.849+0700 7fd8002ea700 1 heartbeat_map reset_timeout 'OSD::osd_op_tp thread 0x7fd8002ea700' had timed out after 15 2024-06-18T14:17:50.865+0700 7fd81a31e700 -1 osd.461 472771 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.3349483990.0:462716190 22.11 22:8deed178:::meta.log.08e85e9f-c16e-43f0-b88d-362f3b7ced2d.15:head [call log.list in=69b] snapc 0=[] ondisk+read+known_if_redirected e472771) 2024-06-18T14:17:50.865+0700 7fd81a31e700 0 log_channel(cluster) log [WRN] : 1 slow requests (by type [ 'delayed' : 1 ] most affected pool [ 'dc.rgw.log' : 1 ]) 2024-06-18T14:19:36.040+0700 7fd81e5b4700 1 heartbeat_map is_healthy 'OSD::osd_op_tp ... 2024-06-18T14:19:51.908+0700 7fd81a31e700 -1 osd.461 472771 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.3371539359.0:5095510 22.11 22:8df1b9e1:::datalog.sync-status.shard.61c9d940-fde4-4bed-9389-edc8d7741817.111: head [call lock.lock in=64b] snapc 0=[] ondisk+write+known_if_redirected e472771) 2024-06-18T14:19:51.908+0700 7fd81a31e700 0 log_channel(cluster) log [WRN] : 2 slow requests (by type [ 'delayed' : 2 ] most affected pool [ 'dc.rgw.log' : 2 ]) 2024-06-18T14:19:52.899+0700 7fd81a31e700 -1 osd.461 472771 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.3371539359.0:5095510 22.11 22:8df1b9e1:::datalog.sync-status.shard.61c9d940-fde4-4bed-9389-edc8d7741817.111: I found this thread: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/FR5V466HBXG… but I think it is not relevant for me. We use only SSDs without separated rocksdb so we don' have spillover. CPU is not overloaded (80% idle) however it's interesting that in vmstat the "r" is pretty big which indicates waiting list for cpu: procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu----- r b swpd free buff cache si so bi bo in cs us sy id wa st 12 0 0 6205288 329803136 15633844 0 0 2149 1894 0 0 5 3 92 0 0 17 0 0 6156780 329827840 15637252 0 0 125584 250416 646098 1965051 10 8 82 0 0 21 0 0 6154636 329849504 15636112 0 0 99320 245024 493324 1682377 7 6 87 0 0 16 0 0 6144256 329869664 15636924 0 0 87484 301968 623345 1993374 8 7 84 0 0 19 0 0 6057012 329890080 15637932 0 0 160444 303664 549194 1820562 8 6 85 0 0 Any idea what this could indicate on octopus 15.2.17 with ubuntu 20.04? ty ________________________________ This message is confidential and is for the sole use of the intended recipient(s). It may also be privileged or otherwise protected by copyright or other legal rules. If you have received it by mistake please let us know by reply email and delete it from your system. It is prohibited to copy this message or disclose its content to anyone. Any confidentiality or privilege is not waived or lost by any mistaken delivery or unauthorized disclosure of the message. All messages sent to and from Agoda may be monitored to ensure compliance with company policies, to protect the company's interests and to remove potential malware. Electronic messages may be intercepted, amended, lost or deleted, or contain viruses.

2 1

Replacing SSD disk(metadata, rocksdb) which are associated with HDDs(osd block)
by TaekSoo Lim 19 Jun '24

19 Jun '24

Hi all, I have configured a ceph cluster to be used as an object store with a combination of SSDs and HDDs, where the block.db is stored on LVM on SSDs and the OSD block is stored on HDDs. I have set up one SSD for storing metadata (rocksDB), and five HDDs are associated with it to store the OSD blocks. During a disk replacement test, if one SSD that stores the block.db fails, all five associated OSDs go down. When replacing and recovering the failed SSD, it seems necessary to reconfigure the five OSDs, which takes too long to recover data and has significant performance impact. So here are two questions: - Is it common practice to configure SSDs with block.db and associate them with five HDD disks to store OSD blocks when using eight SSDs and forty HDDs? Or would it be better to only store the rgw index on SSDs? I am also curious about the difference in performance between these configurations. - If SSDs are configured with block.db as described above, will it be necessary to reinstall the five associated OSDs (HDDs) if one SSD fails ? Also, is there a way to reconstruct the metadata on the newly replaced SSD from the remaining five intact HDDs? As a novice in ceph clusters, I seek advice from experienced users. Thank you.

2 1

Monitoring
by Alex 19 Jun '24

19 Jun '24

Good morning. Our RH Ceph comes with Prometheus monitoring "built in". How does everyone interstate that into their existing monitoring infrastructure so Ceph and other servers are all under one dashboard? Thanks, Alex.

4 7