Hi, after stopping all MON MGR OSD services on all nodes and starting all services after a few seconds this issue is solved. However now the cluster is busy with peering etc. THX Am 15.11.2019 um 14:28 schrieb Ilya Dryomov:
On Fri, Nov 15, 2019 at 11:39 AM Thomas Schneider <74cmonty@gmail.com> wrote:
Hi,
when I execute this command rbd ls -l <pool-name> to list all RBDs I get spamming errors:
2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 Sender did not set CEPH_MSG_FOOTER_SIGNED. 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 Message signature does not match contents. 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1Signature on message: 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 sig: 0 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1Locally calculated signature: 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 sig_check:6229148783016323662 2019-11-15 11:29:19.428 7fd852678700 0 Signature failed. 2019-11-15 11:29:19.428 7fd852678700 0 --1- 10.97.206.91:0/2841811017
v1:10.97.206.97:6884/265976 conn(0x7fd834090770 0x7fd83408c190 :-1 s=READ_FOOTER_AND_DISPATCH pgs=42068 cs=1 l=1).handle_message_footer Signature check failed 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 Sender did not set CEPH_MSG_FOOTER_SIGNED. 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 Message signature does not match contents. 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1Signature on message: 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 sig: 0 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1Locally calculated signature: 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 sig_check:4639667068846516939 2019-11-15 11:29:19.428 7fd852678700 0 Signature failed. 2019-11-15 11:29:19.428 7fd852678700 0 --1- 10.97.206.91:0/2841811017 v1:10.97.206.97:6884/265976 conn(0x7fd83408c990 0x7fd83408b160 :-1 s=READ_FOOTER_AND_DISPATCH pgs=42069 cs=1 l=1).handle_message_footer Signature check failed 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 Sender did not set CEPH_MSG_FOOTER_SIGNED. 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 Message signature does not match contents. 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1Signature on message: 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 sig: 0 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1Locally calculated signature: 2019-11-15 11:29:19.428 7fd852678700 0 SIGN: MSG 1 sig_check:12754808375040063976 2019-11-15 11:29:19.428 7fd852678700 0 Signature failed. 2019-11-15 11:29:19.428 7fd852678700 0 --1- 10.97.206.91:0/2841811017 v1:10.97.206.97:6884/265976 conn(0x7fd834090770 0x7fd83408c190 :-1 s=READ_FOOTER_AND_DISPATCH pgs=42070 cs=1 l=1).handle_message_footer Signature check failed
I allready stopped and started all MON services w/o success.
This is the output of config dump: root@ld3955:~# ceph config-key dump | grep config/ "config/mgr/mgr/balancer/active": "true", "config/mgr/mgr/balancer/mode": "upmap", "config/mgr/mgr/balancer/pool_ids": "11,59,60,61", "config/mgr/mgr/balancer/upmap_max_iterations": "2", "config/mgr/mgr/dashboard/url_prefix": "dashboard", "config/mgr/mgr/devicehealth/enable_monitoring": "false", "config/mgr/target_max_misplaced_ratio": "0.010000",
And this is the config of an OSD showing that cephx authentication is activated: root@ld3955:~# ceph config show osd.0 NAME VALUE SOURCE OVERRIDES IGNORES auth_client_required cephx file auth_cluster_required cephx file auth_service_required cephx file bluestore_block_db_size 10737418240 file cephx_cluster_require_signatures false file cephx_require_signatures false file cephx_sign_messages false file Hi Thomas,
Did you attempt to disable message signing (cephx_sign_messages)? If so, it needs to be disabled on both sides, not just on the OSD.
Thanks,
Ilya