- ceph-users - lists.ceph.io

Re: 17.2.6 Dashboard/RGW Signature Mismatch
by Ondřej Kukla 10 May '23

10 May '23

Hello, I have found out that the issue seems to be in this change - https://github.com/ceph/ceph/pull/47207 When I’ve commented out the change and replaced it with the previous value the dashboard works as expected. Ondrej

1 0

Re: 17.2.6 Dashboard/RGW Signature Mismatch
by Ondřej Kukla 10 May '23

10 May '23

Hello, I have found out that the issue seems to be in this change - https://github.com/ceph/ceph/pull/47207 When I’ve commented out the change and replaced it with the previous value the dashboard works as expected. Ondrej

1 0

non root deploy ceph 17.2.5 failed
by Ben 10 May '23

10 May '23

Hi, with following command: sudo cephadm --docker bootstrap --mon-ip 10.1.32.33 --skip-monitoring-stack --ssh-user deployer the user deployer has passwordless sudo configuration. I can see the error below: debug 2023-05-04T12:46:43.268+0000 7fc5ddc2e700 0 [cephadm ERROR cephadm.ssh] Unable to write szhyf-xx1d002-hx15w:/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/cephadm.059bfc99f5cf36ed881f2494b104711faf4cbf5fc86a9594423cc105cafd9b4e: scp: /tmp/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/cephadm.059bfc99f5cf36ed881f2494b104711faf4cbf5fc86a9594423cc105cafd9b4e.new: Permission denied Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 222, in _write_remote_file await asyncssh.scp(f.name, (conn, tmp_path)) File "/lib/python3.6/site-packages/asyncssh/scp.py", line 922, in scp await source.run(srcpath) File "/lib/python3.6/site-packages/asyncssh/scp.py", line 458, in run self.handle_error(exc) File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in handle_error raise exc from None File "/lib/python3.6/site-packages/asyncssh/scp.py", line 456, in run await self._send_files(path, b'') File "/lib/python3.6/site-packages/asyncssh/scp.py", line 438, in _send_files self.handle_error(exc) File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in handle_error raise exc from None File "/lib/python3.6/site-packages/asyncssh/scp.py", line 434, in _send_files await self._send_file(srcpath, dstpath, attrs) File "/lib/python3.6/site-packages/asyncssh/scp.py", line 365, in _send_file await self._make_cd_request(b'C', attrs, size, srcpath) File "/lib/python3.6/site-packages/asyncssh/scp.py", line 343, in _make_cd_request self._fs.basename(path)) File "/lib/python3.6/site-packages/asyncssh/scp.py", line 224, in make_request raise exc Any ideas on this? Thanks, Ben

3 10

cephadm docker registry
by Satish Patel 10 May '23

10 May '23

Folks, I am trying to install ceph on 10 node clusters and planning to use cephadm. My question is if next year i will add new nodes to this cluster then what docker image version cephadm will use to add new nodes? Are there any local registry can i create one to copy images locally? How does cephadm control images?

2 1

v16.2.13 Pacific released
by Yuri Weinstein 10 May '23

10 May '23

We're happy to announce the 13th backport release in the Pacific series. https://ceph.io/en/news/blog/2023/v16-2-13-pacific-released/ Notable Changes --------------- * CEPHFS: Rename the `mds_max_retries_on_remount_failure` option to `client_max_retries_on_remount_failure` and move it from mds.yaml.in to mds-client.yaml.in because this option was only used by MDS client from its birth. * `ceph mgr dump` command now outputs `last_failure_osd_epoch` and `active_clients` fields at the top level. Previously, these fields were output under `always_on_modules` field. Getting Ceph ------------ * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-16.2.13.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: 5378749ba6be3a0868b51803968ee9cde4833a3e

3 2

ceph status is warning with "266 pgs not deep-scrubbed in time"
by Louis Koo 10 May '23

10 May '23

ceph version is: v16.2.10 But I had close the ration with "ceph config set mon mon_warn_pg_not_deep_scrubbed_ratio 0" show the prints: [root@smd-node01 deeproute]# ceph config get mon mon_warn_pg_not_deep_scrubbed_ratio 0.000000

1 0

Change in DMARC handling for the list
by Dan Mick 09 May '23

09 May '23

Several users have complained for some time that our DMARC/DKIM handling is not correct. I've recently had time to go study DMARC, DKIM, SPF, SRS, and other tasty morsels of initialisms, and have thus made a change to how Mailman handles DKIM signatures for the list: If a domain advertises that it will reject or quarantine messages that fail DKIM (through its DMARC policy in the DNS text record _dmarc.<domain>), the message will be rewritten to be "From" ceph.io, and SPF should be correct. I do not know if it will regenerate a DKIM signature in that case for what is now it's own message. The From: address will say something like "From Original Sender via ceph-users <ceph-users(a)ceph.io> so it's somewhat clear who first sent the message, and Reply-To will be set to Original Sender. Again, this will only happen for senders from domains that advertise a strict DMARC policy. This does not include gmail.com, surprisingly. Let me know if you notice anything that seems to have gotten worse. Next on the list is to investigate if DKIM-signing outbound messages, or at least ones that don't already have an ARC-Seal, is appropriate and/or workable.

2 1

ERROR: Distro uos version 20 not supported
by Ben 08 May '23

08 May '23

Hi, This seems not very relevant since all ceph components are running in containers. Any ideas to get over this issue? Any other ideas or suggestions on this kind of deployment? sudo ./cephadm --image 10.21.22.1:5000/ceph:v17.2.5-20230316 --docker bootstrap --mon-ip 10.21.22.1 --skip-monitoring-stack Creating directory /etc/ceph for ceph.conf Verifying podman|docker is present... Verifying lvm2 is present... Verifying time synchronization is in place... No time sync service is running; checked for ['chrony.service', 'chronyd.service', 'systemd-timesyncd.service', 'ntpd.service', 'ntp.service', 'ntpsec.service', 'openntpd.service'] ERROR: Distro uos version 20 not supported uname -a Linux aaaa 4.19.0-91.82.42.uelc20.x86_64 #1 SMP Sat May 15 13:50:04 CST 2021 x86_64 x86_64 x86_64 GNU/Linux Thank you in advance Ben

1 1

pg deep-scrub issue
by Peter 08 May '23

08 May '23

Dear all, I am writing to seek your assistance in resolving an issue with my Ceph cluster. Currently, the cluster is experiencing a problem where the number of Placement Groups (PGs) that need to undergo deepscrub and regular scrub cannot be completed in a timely manner. I have noticed that these PGs appear to be concentrated on a single OSD. I am seeking your guidance on how to address this issue and would appreciate any insights or suggestions you may have. Please find attached the Ceph health detail output for your reference. HEALTH_WARN 13 pgs not deep-scrubbed in time; 7 pgs not scrubbed in time [WRN] PG_NOT_DEEP_SCRUBBED: 13 pgs not deep-scrubbed in time pg 4.426 not deep-scrubbed since 2023-04-22T10:00:21.529716+0800 pg 4.f0 not deep-scrubbed since 2023-04-22T04:55:17.868881+0800 pg 4.b9 not deep-scrubbed since 2023-04-22T16:47:25.219603+0800 pg 4.87 not deep-scrubbed since 2023-04-22T20:01:02.508600+0800 pg 4.31 not deep-scrubbed since 2023-04-23T00:27:39.299893+0800 pg 4.5b9 not deep-scrubbed since 2023-04-19T21:03:47.041934+0800 pg 4.68a not deep-scrubbed since 2023-04-21T19:52:39.251293+0800 pg 4.6a4 not deep-scrubbed since 2023-04-22T16:20:51.078431+0800 pg 4.6ec not deep-scrubbed since 2023-04-21T11:20:33.661595+0800 pg 4.7a4 not deep-scrubbed since 2023-04-20T22:30:44.506420+0800 pg 4.7a2 not deep-scrubbed since 2023-04-16T12:05:56.586205+0800 pg 4.7b4 not deep-scrubbed since 2023-04-17T15:50:10.595292+0800 pg 4.7c8 not deep-scrubbed since 2023-04-19T15:10:12.673655+0800 [WRN] PG_NOT_SCRUBBED: 7 pgs not scrubbed in time pg 4.31e not scrubbed since 2023-04-24T13:34:26.103257+0800 pg 4.5b9 not scrubbed since 2023-04-24T07:20:53.891175+0800 pg 4.68a not scrubbed since 2023-04-24T03:37:58.070854+0800 pg 4.7a4 not scrubbed since 2023-04-24T02:55:25.912789+0800 pg 4.7b4 not scrubbed since 2023-04-24T10:04:46.889422+0800 pg 4.7c8 not scrubbed since 2023-04-24T13:36:07.284271+0800 pg 4.7d2 not scrubbed since 2023-04-24T14:47:19.365551+0800 Peter

3 3

16.2.13 pacific QE validation status
by Yuri Weinstein 08 May '23

08 May '23

Details of this release are summarized here: https://tracker.ceph.com/issues/59542#note-1 Release Notes - TBD Seeking approvals for: smoke - Radek, Laura rados - Radek, Laura rook - Sébastien Han cephadm - Adam K dashboard - Ernesto rgw - Casey rbd - Ilya krbd - Ilya fs - Venky, Patrick upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8) upgrade/pacific-p2p - Laura powercycle - Brad (SELinux denials) ceph-volume - Guillaume, Adam K Thx YuriW

10 26