July 2020 - ceph-users - lists.ceph.io

by Daniel Mezentsev

Hi All, I started a small project related to metrics collection and processing, Ceph was chosen as a storage backend. Decided to use rados directly, to avoid any additional layers. I got a very simple client - it works fine, but performance is very low. Can't get more than 30-35MBsec. Rados bench shows 200MBsec for my test pool. Should be mentioned about the client - I'm using sbcl (yep lisp). Call to rados API is just cffi call. Did try in async mode. Wow ! Saturated network bandwidth for large objects (4Mb and bigger), for small objects - saturated OSD IOPS ~2.4KIOPS for 8 SAS disks, so ~300 IOPS per disk - that sounds pretty reasonable. Bottom line - issue not with the lisp client - im getting close to C performance, difference is sync vs async IO. Why it's so big - sync operations are approx 2-3 times slower then async . Daniel Mezentsev, founder (+1) 604 313 8592. Soleks Data Group. Shaping the clouds.

3 years, 10 months

4
6
0 0

HP printer offline

by masonlava77＠gmail.com

When I make my hard efforts to print the documents through my HP printer, suddenly my HP printer goes offline mode. I am applying an appropriate command to my HP printer, I am facing HP printer offline problem. This offline error is an annoying issue for me, so I am not able to work on my HP printer. I am trying to find out the major reasons of HP printer offline error, but I don’t get the success to find out actual reasons. As per my technical skills, I have applied my technical knowledge to sort out HP printer offline issue. So anyone can suggest the smart methods to rectify this offline error. https://www.hpprintersupportpro.com/blog/stop-my-hp-printer-from-going-offl…

3 years, 10 months

1
0
0 0

HP printer offline

by masonlava77＠gmail.com

When I make my hard efforts to print the documents through my HP printer, suddenly my HP printer goes offline mode. I am applying an appropriate command to my HP printer, I am facing HP printer offline problem. This offline error is an annoying issue for me, so I am not able to work on my HP printer. I am trying to find out the major reasons of HP printer offline error, but I don’t get the success to find out actual reasons. As per my technical skills, I have applied my technical knowledge to sort out HP printer offline issue. So anyone can suggest the smart methods to rectify this offline error. https://www.hpprintersupportpro.com/blog/stop-my-hp-printer-from-going-offl…

3 years, 10 months

1
0
0 0

Cache Tier OSDs full and near full - not flushing and evicting

by Priya Sehgal

Hi, We have a large production cluster with Writeback Cache Tier. Recently, we observed that some of the OSDs were near full and got full from the Cache Tier and the cluster is in error state. The target_max_bytes was not set correctly and hence I think the flush and eviction never happened. I wish to disable caching and remove the cache tier, but before that wish to flush all the contents of the cache. I have set the cache mode to "forward" as suggested here: https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/1.2.3/ht…. But, rados df still shows same usage of cache tier. It's not automatically flushing and evicting. I tried "cache-try-flush", but this command gets blocked for some reason for many objects (although this is supposed to be non-blocking). How do I make sure all the objects are flushed to backing tier and objects evicted so that I can safely deprecate/remove the cache tier which is currently having many full and near full OSDs (in cache tier). -- Regards, Priya

3 years, 10 months

1
0
0 0

ceph OSD node optimised sysctl configuration

by Jeremi Avenant

Hi All Is there perhaps any updated documentation about ceph OSD node optimised sysctl configuration? I'm seeing a lot of these: $ netstat -s ... 4955341 packets pruned from receive queue because of socket buffer overrun ... 5866 times the listen queue of a socket overflowed ... TCPBacklogDrop: 14601 OS: Ubuntu 16 HWE Ceph Luminous : 12.2.13 Ceph-ansible: 3.2.20 + containerised Thanks in advance. -- *Jeremi-Ernst Avenant, Mr.* Inter-University Institute for Data Intensive Astronomy 5th Floor, Department of Physics and Astronomy, University of Cape Town Tel: 021 959 4137 <0219592327> Web: www.idia.ac.za <http://www.uwc.ac.za/> E-mail (IDIA): jeremi(a)idia.ac.za <mfundo(a)idia.ac.za> Rondebosch, Cape Town, 7600, South Africa

3 years, 10 months

1
0
0 0

"ceph daemon osd.x ops" shows different number from "ceph osd status <bucket>"

by rainning

"ceph daemon osd.x ops" shows ops currently in flight, the number is different from "ceph osd status <bucket>". Is the number of ops in "ceph osd status <bucket>" also the ops currently in flight? root@osd021:~# ceph daemon osd.636 ops {     "ops": [],     "num_ops": 0 } root@osd021:~# ceph osd status osd021 +-----+--------+-------+-------+--------+---------+--------+---------+-----------+ |  id |  host  |  used | avail | wr ops | wr data | rd ops | rd data |   state   | +-----+--------+-------+-------+--------+---------+--------+---------+-----------+ |  37 | osd021 |  542G | 1134G |   22   |   225k  |   12   |   274k  | exists,up | |  91 | osd021 |  567G | 1109G |   38   |   281k  |   12   |  1006k  | exists,up | | 147 | osd021 |  551G | 1125G |   32   |   307k  |    4   |   247k  | exists,up | | 201 | osd021 |  549G | 1127G |   82   |  1505k  |    5   |  42.4k  | exists,up | | 264 | osd021 | 1503G | 2222G |    3   |  55.2k  |    4   |  12.2k  | exists,up | | 317 | osd021 | 1537G | 2188G |   13   |   138k  |    1   |  6190   | exists,up | | 375 | osd021 | 1369G | 2356G |    1   |   834k  |    5   |  67.4k  | exists,up | | 430 | osd021 | 1424G | 2301G |    1   |  8192   |    6   |  1661k  | exists,up | | 480 | osd021 | 1435G | 2289G |    3   |  16.6k  |    2   |  42.4k  | exists,up | | 535 | osd021 | 1494G | 2231G |    2   |  12.0k  |    1   |  27.8k  | exists,up | | 584 | osd021 | 1484G | 2241G |    1   |  5529   |    1   |  12.7k  | exists,up | | 636 | osd021 | 1394G | 2331G |    2   |   850k  |  406   |  78.1M  | exists,up | +-----+--------+-------+-------+--------+---------+--------+---------+-----------+

3 years, 10 months

1
0
0 0

Ceph config changed on ansible deployed cluster

by Szabo, Istvan (Agoda)

Hi, How is it possible to change config on an ansible deployed cluster due to the missing ceph-deploy. Thank you ________________________________ This message is confidential and is for the sole use of the intended recipient(s). It may also be privileged or otherwise protected by copyright or other legal rules. If you have received it by mistake please let us know by reply email and delete it from your system. It is prohibited to copy this message or disclose its content to anyone. Any confidentiality or privilege is not waived or lost by any mistaken delivery or unauthorized disclosure of the message. All messages sent to and from Agoda may be monitored to ensure compliance with company policies, to protect the company's interests and to remove potential malware. Electronic messages may be intercepted, amended, lost or deleted, or contain viruses.

3 years, 10 months

2
2
0 0

Choose Best PPC Services for successful your Business.

by jamesmacle9＠gmail.com

PPC Campaign is meaningless without a proper goal in mind. As the provider of best ppc services in Delhi, we follow a tested set of steps for a successful campaign. It is very important to lay a set of rules and then place all your efforts playing by them so that you are able to achieve what you want for your business. Without a proper framework, your ad ends up being futile. It is very important to align your campaign with the business goal that you have in mind. Make sure you know what you want your ad to do like generate sales, create awareness, collect relevant user data or just increase the number of visitors. You should know whom to target, agenda of the campaign and the budget. It is as follows- 1. Decide the objective 2. Set the target 3. Lead Generation 4. Site Traffic https://www.pnjsharptech.com/ppc-services-india

3 years, 10 months

1
0
0 0

Ceph Science meeting

by Khan, Babar

Hi Ceph users, Can someone please tell me when is Ceph Science user group meeting? Best regards Babar

3 years, 10 months

2
2
0 0

RadosGw swift / S3

by St-Germain, Sylvain (SSC/SPC)

Hi everyone, I try to configure a simple rados gateway with three nodes and I add a virtual IP address for the load balancer. I make calls to the gateway using S3 and SWIFT. In the case of S3 everything works, I can make requests directly on the node where there is a gateway or use the virtual address and it responds well. In the case of SWIFT, I can query the nodes and it's fine, but when I use the virtual IP address it doesn't respond. The call sequence is the same for the nodes and the virtual IP address. Do you have any leads why it doesn't work? Version Info ceph version : 15.2.4 (7447c15c6ff58d7fce91843b705a268a1917325c) octopus (stable) OS : CentOS 8 Host file (ceph-ansible) ... [rgws] node-01 node-02 node-03 [rgwloadbalancers] node-01 node-02 node-03 ... rgwloadbalancers.yml (ceph-ansible) ########### # GENERAL # ########### haproxy_frontend_port: 80 haproxy_frontend_ssl_port: 443 haproxy_frontend_ssl_certificate: haproxy_ssl_dh_param: 4096 haproxy_ssl_ciphers: - EECDH+AESGCM - EDH+AESGCM haproxy_ssl_options: - no-sslv3 - no-tlsv10 - no-tlsv11 - no-tls-tickets # virtual_ips: - XXX.XXX.XXX.189 # virtual_ip_netmask: 24 virtual_ip_interface: eno5 /etc/ceph/ceph.conf (node1 example) [client.node1.rgw0] host = node1 keyring = /var/lib/ceph/radosgw/ceph-rgw. node1.rgw0/keyring log file = /var/log/ceph/ceph-rgw- node1.rgw0.log rgw frontends = beast endpoint=xxx.xxx.xxx.190:8080 rgw thread pool size = 512 [client.rgw.node2.rgw0] host = node2 keyring = /var/lib/ceph/radosgw/ceph-rgw.node2.rgw0/keyring log file = /var/log/ceph/ceph-rgw- node2.rgw0.log rgw frontends = beast endpoint=xxx.xxx.xxx.191:8080 rgw thread pool size = 512 [client.rgw.node3.rgw0] host = node3 keyring = /var/lib/ceph/radosgw/ceph-rgw.node3.rgw0/keyring log file = /var/log/ceph/ceph-rgw-node3.rgw0.log rgw frontends = beast endpoint=xxx.xxx.xxx.192:8080 rgw thread pool size = 512 Thank you ! Sylvain

3 years, 10 months

1
0
0 0

2024

2023

2022

2021

2020

2019

ceph-users July 2020