- ceph-users - lists.ceph.io

Ceph benchmark tool (cbt)
by Seena Fallah 11 Dec '20

11 Dec '20

Hi all, I want to benchmark my production cluster with cbt. I read a bit of the code and I see something strange in it, for example, it's going to create ceph-osd by it selves ( https://github.com/ceph/cbt/blob/master/cluster/ceph.py#L373) and also shutdown the whole cluster!! ( https://github.com/ceph/cbt/blob/master/cluster/ceph.py#L212) Is there any configuration to not do harmful things with the cluster and for example just test the read_ahead_kb or simply stop some OSDs and other things that can be reverted and not get the cluster fully down?! Thanks.

3 2

All ceph commands hangs - bad magic number in monitor log
by Evrard Van Espen - Weather-Measures 11 Dec '20

11 Dec '20

Hello all, We have a production cluster running since weeks deployed on centos8 with |cephadm| (3 nodes with 6x12TB HDD each, one |mon| and one |mgr| on each node too). Today, the "master" node (the from on which I run all the setup commands) crashed so I rebooted the server. Now, all ceph commands hangs (|ceph -s| for ex), when I do |cephadm shell| it asks me to specify the FSID (showing me 3 fsid) and in the logs of the unit |ceph-<FSID>@mon.ceph-n-01.service| I get this line looping : |Dec 10 16:13:07 ceph-n-01 bash[36847]: debug 2020-12-10T16:13:07.099+0000 7f9251890700 0 cephx: verify_authorizer could not decrypt ticket info: error: bad magic in decode_decrypt, 924161695680779075 != 18374858748799134293 Dec 10 16:13:10 ceph-n-01 bash[36847]: debug 2020-12-10T16:13:10.288+0000 7f9251890700 1 mon.ceph-n-01@0(probing) e3 handle_auth_request failed to assign global_id | Thanks for all your help :)

1 0

removing index for non-existent buckets
by Christopher Durham 10 Dec '20

10 Dec '20

Hi, I am uisng 15.2.7 on CentOS 8.1. I have a number of old buckets that are listed with # radosgw-admin metadata list bucket.instance but are not listed with: # radosgw-admin bucket list Lets say that one of them is: 'old-bucket' and its instance is 'c100feda-5e16-48a4-b908-7be61aa877ef.123.1' The bucket/instance is empty: # radosgw-admin bucket list --bucket old-bucket --bucket-id c100feda-5e16-48a4-b908-7be61aa877ef.123.1[] Again, if I ist the index pool I see the .dir object: # rados -p <indexpoool> ls | grep c100feda-5e16-48a4-b908-7be61aa877ef.dir.c100feda-5e16-48a4-b908-7be61aa877ef.123.1.N (an N for each shard) I THINK I can delete these old indices with the following two commands # radosgw-admin bi purge --bucket old-bucket --bucket-id c100feda-5e16-48a4-b908-7be61aa877ef.123.1# radosgw-admin metadata rm bucket.instance:old-bucket:c100feda-5e16-48a4-b908-7be61aa877ef.123.1 Am I correct? What if I have another zone in a multi site configuration? Will this suffice to remove the indices from both sites? I thought I better check herebefore doing this and causing myself grief. Thanks! -Chris

1 0

Running Mons on msgrv2/3300 only.
by Wesley Dillingham 09 Dec '20

09 Dec '20

We rebuilt all of our mons in one cluster such that they bind only to port 3300 with msgrv2. Previous to this we were binding to both 6789 and 3300. All of our server and client components are sufficiently new (14.2.x) and we haven’t observed any disruption but I am inquiring if this may be problematic for any unforeseen reason. We don’t intend to have any older clients connecting. https://docs.ceph.com/en/latest/rados/configuration/msgr2/ doesn’t mention much about running with only v2 so I just want to make sure we aren’t setting ourselves up for trouble. Thanks. -- Respectfully, Wes Dillingham Site Reliability Engineer IV Storage Engineering / Ceph wdillingham(at)godaddy.com

3 2

CentOS
by DHilsbos＠performair.com 09 Dec '20

09 Dec '20

All; As you may or may not know; this morning RedHat announced the end of CentOS as a rebuild distribution[1]. "CentOS" will be retired in favor of the recently announced "CentOS Stream." Can Ceph be installed on CentOS Stream? Since CentOS Stream is currently at 8, the question really is: Can Ceph Octopus be installed on CentOS Stream 8? How about Nautilus? Thank you, Dominic L. Hilsbos, MBA Director - Information Technology Perform Air International Inc. DHilsbos(a)PerformAir.com www.PerformAir.com [1: https://blog.centos.org/2020/12/future-is-centos-stream/]

4 6

DocuBetter Meeting cancelled this week.
by John Zachary Dover 09 Dec '20

09 Dec '20

The DocuBetter meeting scheduled for one hour from the time of this email is cancelled. Send documentation concerns to me at zac.dover(a)gmail.com. Zac Dover Upstream Docs Ceph

1 0

How to copy an OSD from one failing disk to another one
by huxiaoyu＠horebdata.cn 08 Dec '20

08 Dec '20

Hi, dear cephers, On one ceph i have a failing disk, whose SMART information signals an impending failure but still availble for reads and writes. I am setting up a new disk on the same node to replace it. What is the best procedure to migrate data (or COPY ) from the failing OSD to the new one? Is there any stardard method to copy the OSD from one to another? best regards, samuel huxiaoyu(a)horebdata.cn

3 2

Announcing go-ceph v0.7.0
by John Mulligan 08 Dec '20

08 Dec '20

I'm happy to announce another release of the go-ceph API bindings. This is a regular release following our every-two-months release cadence. https://github.com/ceph/go-ceph/releases/tag/v0.7.0 Changes in the release are detailed in the link above. The bindings aim to play a similar role to the "pybind" python bindings in the ceph tree but for the Go language. These API bindings require the use of cgo. There are already a few consumers of this library in the wild, including the ceph-csi project. Specific questions, comments, bugs etc are best directed at our github issues tracker. -- John Mulligan phlogistonjohn(a)asynchrono.us jmulligan(a)redhat.com _______________________________________________ Dev mailing list -- dev(a)ceph.io To unsubscribe send an email to dev-leave(a)ceph.io

1 0

Ceph on vector machines
by Bobby 08 Dec '20

08 Dec '20

Hi all, Just out of curiosity.....Considering vector machines are being used in HPC applications to accelerate certain kernels, do you think there are some workloads in Ceph that could be good candidates to be offloaded and accelerated on vector machines ? Thanks in advance..... BR

1 0

rgw index shard much larger than others
by Dan van der Ster 08 Dec '20

08 Dec '20

Dear friends, Running 14.2.11, we have one particularly large bucket with a very strange distribution of objects among the shards. The bucket has 512 shards, and most shards have ~75k entries, but shard 0 has 1.75M entries: # rados -p default.rgw.buckets.index listomapkeys .dir.61c59385-085d-4caa-9070-63a3868dccb6.272652427.1.0 | wc -l 1752085 # rados -p default.rgw.buckets.index listomapkeys .dir.61c59385-085d-4caa-9070-63a3868dccb6.272652427.1.1 | wc -l 78388 # rados -p default.rgw.buckets.index listomapkeys .dir.61c59385-085d-4caa-9070-63a3868dccb6.272652427.1.2 | wc -l 78764 We had resharded this bucket (manually) from 32 up to 512 shards just before upgrading from 12.2.12 to 14.2.11 a couple weeks ago. Any idea why shard .0 is getting such an imbalance of entries? Should we manually reshard this bucket again? Thanks! Dan

3 6