ceph-users April 2023

ceph-users@ceph.io

152 participants
156 discussions

Upgrade from 17.2.5 to 17.2.6 stuck at MDS

by Thomas Widhalm

Hi, If you remember, I hit bug https://tracker.ceph.com/issues/58489 so I was very relieved when 17.2.6 was released and started to update immediately. But now I'm stuck again with my broken MDS. MDS won't get into up:active without the update but the update waits for them to get into up:active state. Seems like a deadlock / chicken-egg problem to me. Since I'm still relatively new to Ceph, could you help me? What I see when watching the update status: { "target_image": "quay.io/ceph/ceph@sha256:1161e35e4e02cf377c93b913ce78773f8413f5a8d7c5eaee4b4773a4f9dd6635", "in_progress": true, "which": "Upgrading all daemon types on all hosts", "services_complete": [ "crash", "mgr", "mon", "osd" ], "progress": "18/40 daemons upgraded", "message": "Error: UPGRADE_OFFLINE_HOST: Upgrade: Failed to connect to host ceph01 at addr (192.168.23.61)", "is_paused": false } (The offline host was one host that broke during the upgrade. I fixed that in the meantime and the update went on.) And in the log: 2023-04-10T19:23:48.750129+0000 mgr.ceph04.qaexpv [INF] Upgrade: Waiting for mds.mds01.ceph04.hcmvae to be up:active (currently up:replay) 2023-04-10T19:23:58.758141+0000 mgr.ceph04.qaexpv [WRN] Upgrade: No mds is up; continuing upgrade procedure to poke things in the right direction Please give me a hint what I can do. Cheers, Thomas -- http://www.widhalm.or.at GnuPG : 6265BAE6 , A84CB603 Threema: H7AV7D33 Telegram, Signal: widhalmt(a)widhalm.or.at

1 year, 1 month

Pacific - not able to add more mons while setting up new cluster

by Boris Behrens

Hi, I am currently facing a rather strange issue and I have no idea where to look next. ceph.conf [global] fsid = ee52ffdf-5f03-4ff1-9c8d-1761a52d5c6a ms_bind_ipv6 = true ms_bind_ipv4 = false #mon_initial_members = 08f1ea96ef02, 08f1ea98b7c2, 08f1ea98ab3e mon_host = [fd00:2380:be45:43::10],[fd00:2380:be45:43::11],[fd00:2380:be45:43::12] auth_cluster_required = none auth_service_required = none auth_client_required = none public_network = fd00:2380:be45:43::/64 I can create the first mon with: monmaptool --create --add `hostname -s` fd00:2380:be45:43::10 --fsid ee52ffdf-5f03-4ff1-9c8d-1761a52d5c6a /tmp/monmap sudo -u ceph ceph-mon --cluster ceph --mkfs -i `hostname -s` --monmap /tmp/monmap systemctl enable --now ceph-mon@`hostname -s`.service systemctl enable --now ceph-mgr@`hostname -s`.service On the first host I can use the ceph command line as I would expect. Normally I then go to the next host and add it to the mons with ceph mon getmap -o /tmp/monmap sudo -u ceph ceph-mon --cluster ceph --mkfs -i `hostname -s` --monmap /tmp/monmap systemctl enable --now ceph-mon@`hostname -s`.service systemctl enable --now ceph-mgr@`hostname -s`.service But the ceph command hangs forever. Ping between the hosts work and when I telnet the remote mon I also get an answer. We do not have any authentication in place, and normally I would expect that it works this way. Any ideas what I can try? I had it working yesterday, but the restarted all nodes at the same time and then it just stopped and I never got it working again. Can it be switch config? I've added the debug output but it looks for as both systems communicate with each other but somehow it does not work: root@08f1ea98b7c2:~# ceph status --debug_ms=20 2023-04-12T15:55:29.253+0000 7f38bed9d700 2 Event(0x7f38c0069620 nevent=5000 time_id=1).set_owner center_id=0 owner=139881696843520 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 Event(0x7f38c0069620 nevent=5000 time_id=1).create_file_event create event started fd=4 mask=1 original mask is 0 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 EpollDriver.add_event add event fd=4 cur_mask=0 add_mask=1 to 3 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 Event(0x7f38c0069620 nevent=5000 time_id=1).create_file_event create event end fd=4 mask=1 current mask is 1 2023-04-12T15:55:29.253+0000 7f38bed9d700 10 stack operator() starting 2023-04-12T15:55:29.253+0000 7f38be59c700 2 Event(0x7f38c0060960 nevent=5000 time_id=1).set_owner center_id=1 owner=139881688450816 2023-04-12T15:55:29.253+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=1).create_file_event create event started fd=7 mask=1 original mask is 0 2023-04-12T15:55:29.253+0000 7f38be59c700 20 EpollDriver.add_event add event fd=7 cur_mask=0 add_mask=1 to 6 2023-04-12T15:55:29.253+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=1).create_file_event create event end fd=7 mask=1 current mask is 1 2023-04-12T15:55:29.253+0000 7f38be59c700 10 stack operator() starting 2023-04-12T15:55:29.253+0000 7f38bdd9b700 2 Event(0x7f38c0061950 nevent=5000 time_id=1).set_owner center_id=2 owner=139881680058112 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 Event(0x7f38c0061950 nevent=5000 time_id=1).create_file_event create event started fd=10 mask=1 original mask is 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 EpollDriver.add_event add event fd=10 cur_mask=0 add_mask=1 to 9 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 Event(0x7f38c0061950 nevent=5000 time_id=1).create_file_event create event end fd=10 mask=1 current mask is 1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 stack operator() starting 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- ready 2023-04-12T15:55:29.253+0000 7f38bf59e700 1 Processor -- start 2023-04-12T15:55:29.253+0000 7f38bf59e700 20 Event(0x7f38c0069620 nevent=5000 time_id=1).wakeup 2023-04-12T15:55:29.253+0000 7f38bf59e700 1 -- start start 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- create_connect v2:[fd00:2380:be45:43::12]:3300/0, creating connection and registering 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 msgr2=0x7f38c0104790 unknown :-1 s=STATE_NONE l=0)._connect 2023-04-12T15:55:29.253+0000 7f38bf59e700 1 --2- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-04-12T15:55:29.253+0000 7f38bf59e700 20 Event(0x7f38c0060960 nevent=5000 time_id=1).wakeup 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- create_connect 0x7f38c0102340 v2:[fd00:2380:be45:43::12]:3300/0 v2:[fd00:2380:be45:43::12]:3300/0 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- connect_to v2:[fd00:2380:be45:43::12]:3300/0 new 0x7f38c0102340 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- create_connect v1:[fd00:2380:be45:43::10]:6789/0, creating connection and registering 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_NONE l=0)._connect 2023-04-12T15:55:29.253+0000 7f38bf59e700 20 Event(0x7f38c0061950 nevent=5000 time_id=1).wakeup 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- create_connect 0x7f38c0104dd0 v1:[fd00:2380:be45:43::10]:6789/0 v1:[fd00:2380:be45:43::10]:6789/0 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- connect_to v1:[fd00:2380:be45:43::10]:6789/0 new 0x7f38c0104dd0 2023-04-12T15:55:29.253+0000 7f38be59c700 20 -- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 msgr2=0x7f38c0104790 unknown :-1 s=STATE_CONNECTING l=0).process 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- create_connect v1:[fd00:2380:be45:43::12]:6789/0, creating connection and registering 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 legacy=0x7f38c010b0f0 unknown :-1 s=STATE_NONE l=0)._connect 2023-04-12T15:55:29.253+0000 7f38bf59e700 20 Event(0x7f38c0069620 nevent=5000 time_id=1).wakeup 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- create_connect 0x7f38c0108c30 v1:[fd00:2380:be45:43::12]:6789/0 v1:[fd00:2380:be45:43::12]:6789/0 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 -- connect_to v1:[fd00:2380:be45:43::12]:6789/0 new 0x7f38c0108c30 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTING l=0).process 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=START_CONNECT pgs=0 cs=0 l=0).send_keepalive 2023-04-12T15:55:29.253+0000 7f38bf59e700 20 Event(0x7f38c0061950 nevent=5000 time_id=2).wakeup 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 -- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 legacy=0x7f38c010b0f0 unknown :-1 s=STATE_CONNECTING l=0).process 2023-04-12T15:55:29.253+0000 7f38bf59e700 1 -- --> v1:[fd00:2380:be45:43::10]:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c010ca30 con 0x7f38c0104dd0 2023-04-12T15:55:29.253+0000 7f38bf59e700 15 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=START_CONNECT pgs=0 cs=0 l=0).send_message inline write is denied, reschedule m=0x7f38c010ca30 2023-04-12T15:55:29.253+0000 7f38bf59e700 10 --1- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).send_keepalive 2023-04-12T15:55:29.253+0000 7f38bf59e700 20 Event(0x7f38c0069620 nevent=5000 time_id=2).wakeup 2023-04-12T15:55:29.253+0000 7f38bf59e700 1 -- --> v1:[fd00:2380:be45:43::12]:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c010dca0 con 0x7f38c0108c30 2023-04-12T15:55:29.253+0000 7f38bf59e700 15 --1- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).send_message inline write is denied, reschedule m=0x7f38c010dca0 2023-04-12T15:55:29.253+0000 7f38bf59e700 1 -- --> v2:[fd00:2380:be45:43::12]:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c010eef0 con 0x7f38c0102340 2023-04-12T15:55:29.253+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=2).create_file_event create event started fd=12 mask=1 original mask is 0 2023-04-12T15:55:29.253+0000 7f38bf59e700 5 --2- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).send_message enqueueing message m=0x7f38c010eef0 type=5 mon_getmap magic: 0 v1 2023-04-12T15:55:29.253+0000 7f38be59c700 20 EpollDriver.add_event add event fd=12 cur_mask=0 add_mask=1 to 6 2023-04-12T15:55:29.253+0000 7f38bf59e700 15 --2- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).send_message inline write is denied, reschedule m=0x7f38c010eef0 2023-04-12T15:55:29.253+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=2).create_file_event create event end fd=12 mask=1 current mask is 1 2023-04-12T15:55:29.253+0000 7f38be59c700 10 NetHandler reconnect reconnect: 114 Operation already in progress 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 Event(0x7f38c0069620 nevent=5000 time_id=2).create_file_event create event started fd=13 mask=1 original mask is 0 2023-04-12T15:55:29.253+0000 7f38be59c700 10 -- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 msgr2=0x7f38c0104790 unknown :-1 s=STATE_CONNECTING_RE l=0).process nonblock connect inprogress 2023-04-12T15:55:29.253+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=2).create_file_event create event started fd=12 mask=2 original mask is 1 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 EpollDriver.add_event add event fd=13 cur_mask=0 add_mask=1 to 3 2023-04-12T15:55:29.253+0000 7f38be59c700 20 EpollDriver.add_event add event fd=12 cur_mask=1 add_mask=2 to 6 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 Event(0x7f38c0069620 nevent=5000 time_id=2).create_file_event create event end fd=13 mask=1 current mask is 1 2023-04-12T15:55:29.253+0000 7f38bed9d700 10 NetHandler reconnect reconnect: 114 Operation already in progress 2023-04-12T15:55:29.253+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=2).create_file_event create event end fd=12 mask=2 current mask is 3 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 Event(0x7f38c0061950 nevent=5000 time_id=2).create_file_event create event started fd=14 mask=1 original mask is 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 EpollDriver.add_event add event fd=14 cur_mask=0 add_mask=1 to 9 2023-04-12T15:55:29.253+0000 7f38bed9d700 10 -- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 legacy=0x7f38c010b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process nonblock connect inprogress 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 Event(0x7f38c0061950 nevent=5000 time_id=2).create_file_event create event end fd=14 mask=1 current mask is 1 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 Event(0x7f38c0069620 nevent=5000 time_id=2).create_file_event create event started fd=13 mask=2 original mask is 1 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 EpollDriver.add_event add event fd=13 cur_mask=1 add_mask=2 to 3 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 Event(0x7f38c0069620 nevent=5000 time_id=2).create_file_event create event end fd=13 mask=2 current mask is 3 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 NetHandler reconnect reconnect: 114 Operation already in progress 2023-04-12T15:55:29.253+0000 7f38bed9d700 10 -- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 legacy=0x7f38c010b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).handle_write 2023-04-12T15:55:29.253+0000 7f38bed9d700 10 --1- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).write_event 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 -- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 legacy=0x7f38c010b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTING_RE l=0).process nonblock connect inprogress 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 Event(0x7f38c0061950 nevent=5000 time_id=2).create_file_event create event started fd=14 mask=2 original mask is 1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 EpollDriver.add_event add event fd=14 cur_mask=1 add_mask=2 to 9 2023-04-12T15:55:29.253+0000 7f38bed9d700 10 NetHandler reconnect reconnect: 111 Connection refused 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 Event(0x7f38c0061950 nevent=5000 time_id=2).create_file_event create event end fd=14 mask=2 current mask is 3 2023-04-12T15:55:29.253+0000 7f38bed9d700 1 -- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 legacy=0x7f38c010b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:[fd00:2380:be45:43::12]:6789/0 2023-04-12T15:55:29.253+0000 7f38be59c700 20 -- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 msgr2=0x7f38c0104790 unknown :-1 s=STATE_CONNECTING_RE l=0).process 2023-04-12T15:55:29.253+0000 7f38bed9d700 2 -- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 legacy=0x7f38c010b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process connection refused! 2023-04-12T15:55:29.253+0000 7f38be59c700 10 NetHandler reconnect reconnect: 111 Connection refused 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTING_RE l=0).handle_write 2023-04-12T15:55:29.253+0000 7f38be59c700 1 -- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 msgr2=0x7f38c0104790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:[fd00:2380:be45:43::12]:3300/0 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 --1- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).fault 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=START_CONNECT pgs=0 cs=0 l=0).write_event 2023-04-12T15:55:29.253+0000 7f38be59c700 2 -- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 msgr2=0x7f38c0104790 unknown :-1 s=STATE_CONNECTING_RE l=0).process connection refused! 2023-04-12T15:55:29.253+0000 7f38bed9d700 20 EpollDriver.del_event del event fd=13 cur_mask=3 delmask=3 to 3 2023-04-12T15:55:29.253+0000 7f38bed9d700 5 --1- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).reset_recv_state 2023-04-12T15:55:29.253+0000 7f38bed9d700 5 --1- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).reset_security 2023-04-12T15:55:29.253+0000 7f38bed9d700 10 --1- >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).fault waiting 0.200000 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTING_RE l=0).process 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 EpollDriver.del_event del event fd=14 cur_mask=3 delmask=2 to 9 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTING_RE l=0).process connect successfully, ready to send banner 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=START_CONNECT pgs=0 cs=0 l=0).read_event 2023-04-12T15:55:29.253+0000 7f38be59c700 10 --2- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=START_CONNECT pgs=0 cs=0 l=0).send_client_banner 2023-04-12T15:55:29.253+0000 7f38be59c700 20 EpollDriver.del_event del event fd=12 cur_mask=3 delmask=3 to 6 2023-04-12T15:55:29.253+0000 7f38be59c700 5 --2- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).reset_recv_state 2023-04-12T15:55:29.253+0000 7f38be59c700 5 --2- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).reset_security 2023-04-12T15:55:29.253+0000 7f38be59c700 1 --2- >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 9 remaining bytes 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING pgs=0 cs=0 l=0).handle_client_banner_write r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING pgs=0 cs=0 l=0).handle_client_banner_write connect write banner done: v1:[fd00:2380:be45:43::10]:6789/0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).wait_server_banner 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=281 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).process 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read continue len=281 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify connect read peer addr v1:[fd00:2380:be45:43::10]:6789/0 on socket 14 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify connect peer addr for me is v1:[fd00:2380:be45:43::11]:44160/0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 1 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:[fd00:2380:be45:43::10]:6789/0 says I am v1:[fd00:2380:be45:43::11]:44160/0 (socket says [fd00:2380:be45:43::11]:44160) 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- [fd00:2380:be45:43::11]:0/2007947341 learned_addr had no addrs 2023-04-12T15:55:29.253+0000 7f38bdd9b700 1 -- [fd00:2380:be45:43::11]:0/2007947341 learned_addr learned my addr [fd00:2380:be45:43::11]:0/2007947341 (peer_addr_for_me v1:[fd00:2380:be45:43::11]:0/0) 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 136 remaining bytes 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_my_addr_write r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_my_addr_write connect sent my addr v1:[fd00:2380:be45:43::11]:0/2007947341 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).send_connect_message 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).send_connect_message connect sending gseq=1 cseq=0 proto=15 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 33 remaining bytes 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_message_write r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_message_write connect wrote (self +) cseq, waiting for reply 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).wait_connect_reply 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=26 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).process 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read continue len=26 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 connect got reply tag 13 connect_seq 1 global_seq 52 proto 15 flags 1 features 4540138314316775423 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_2 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_2 got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).wait_ack_seq 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=8 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_ack_seq r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 2 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_ack_seq got newly_acked_seq 0 vs out_seq 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).discard_requeued_up_to 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 8 remaining bytes 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_in_seq_write r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_in_seq_write send in_seq done 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).client_ready 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=52 cs=1 l=1).client_ready connect success 1, lossy = 1, features 4540138314316775423 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=52 cs=1 l=1).client_ready no authorizer, clearing session_security 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).wait_message 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_event 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).append_keepalive_or_ack 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).prepare_send_message m auth(proto 0 30 bytes epoch 0) v1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).prepare_send_message encoding features 4540138314316775423 0x7f38c010ca30 auth(proto 0 30 bytes epoch 0) v1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_message no session security 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_message sending message type=17 src client.? front=60 data=0 off 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_message sending 1 0x7f38c010ca30 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 144 remaining bytes 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_message sending 0x7f38c010ca30 done. 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message process tag 15 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=8 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_keepalive2_ack r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_keepalive2_ack got KEEPALIVE_ACK 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).wait_message 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message process tag 7 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message begin MSG 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=53 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header got MSG header 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header got envelope type=18 src mon.0 front=24 data=0 off 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_MESSAGE pgs=52 cs=1 l=1).throttle_message 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_BYTES pgs=52 cs=1 l=1).throttle_bytes 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_DISPATCH_QUEUE pgs=52 cs=1 l=1).throttle_dispatch_queue 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_front 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=24 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).handle_message_front r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).handle_message_front got front 24 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_middle 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_data_prepare 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_data msg_left=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_footer 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=21 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer aborted = 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer got 24 + 0 + 0 byte message 2023-04-12T15:55:29.253+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer no session security set 2023-04-12T15:55:29.253+0000 7f38bdd9b700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1). rx mon.0 seq 1 0x7f38c010ca30 auth_reply(proto 1 0 (0) Success) v1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 queue 0x7f38c010ca30 prio 196 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).wait_message 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message process tag 7 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message begin MSG 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=53 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header r=0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header got MSG header 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header got envelope type=4 src mon.0 front=215 data=0 off 0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_MESSAGE pgs=52 cs=1 l=1).throttle_message 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_BYTES pgs=52 cs=1 l=1).throttle_bytes 2023-04-12T15:55:29.253+0000 7f38bd59a700 1 -- [fd00:2380:be45:43::11]:0/2007947341 <== mon.0 v1:[fd00:2380:be45:43::10]:6789/0 1 ==== auth_reply(proto 1 0 (0) Success) v1 ==== 24+0+0 (unknown 1154771820 0 0) 0x7f38c010ca30 con 0x7f38c0104dd0 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_DISPATCH_QUEUE pgs=52 cs=1 l=1).throttle_dispatch_queue 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_front 2023-04-12T15:55:29.253+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=215 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).handle_message_front r=0 2023-04-12T15:55:29.257+0000 7f38bd59a700 1 -- [fd00:2380:be45:43::11]:0/2007947341 >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 msgr2=0x7f38c0104790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).handle_message_front got front 215 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_middle 2023-04-12T15:55:29.257+0000 7f38bd59a700 1 --2- [fd00:2380:be45:43::11]:0/2007947341 >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_data_prepare 2023-04-12T15:55:29.257+0000 7f38bd59a700 5 --2- [fd00:2380:be45:43::11]:0/2007947341 >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).reset_recv_state 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 Event(0x7f38c0060960 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_data msg_left=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_footer 2023-04-12T15:55:29.257+0000 7f38bd59a700 10 --2- [fd00:2380:be45:43::11]:0/2007947341 >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).discard_out_queue started 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=21 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 --2- [fd00:2380:be45:43::11]:0/2007947341 >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).discard_out_queue discard mon_getmap magic: 0 v1 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer r=0 2023-04-12T15:55:29.257+0000 7f38be59c700 5 --2- [fd00:2380:be45:43::11]:0/2007947341 >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).reset_recv_state (warped) reseting crypto handlers 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer aborted = 0 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 Event(0x7f38c0060960 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer got 215 + 0 + 0 byte message 2023-04-12T15:55:29.257+0000 7f38bd59a700 1 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 legacy=0x7f38c010b0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-04-12T15:55:29.257+0000 7f38be59c700 5 --2- [fd00:2380:be45:43::11]:0/2007947341 >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).reset_security 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer no session security set 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).stop 2023-04-12T15:55:29.257+0000 7f38bdd9b700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1). rx mon.0 seq 2 0x7f38b4014b00 mon_map magic: 0 v1 2023-04-12T15:55:29.257+0000 7f38bd59a700 2 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).stop 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 queue 0x7f38b4014b00 prio 196 2023-04-12T15:55:29.257+0000 7f38bd59a700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).reset_recv_state 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 Event(0x7f38c0069620 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).wait_message 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.257+0000 7f38bd59a700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).discard_out_queue started 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).discard_out_queue discard 0x7f38c010dca0 2023-04-12T15:55:29.257+0000 7f38bed9d700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=START_CONNECT pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 Event(0x7f38c0069620 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bed9d700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2023-04-12T15:55:29.257+0000 7f38bd59a700 1 -- [fd00:2380:be45:43::11]:0/2007947341 --> v1:[fd00:2380:be45:43::10]:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c010f080 con 0x7f38c0104dd0 2023-04-12T15:55:29.257+0000 7f38bd59a700 15 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).send_message inline write is denied, reschedule m=0x7f38c010f080 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 Event(0x7f38c0061950 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write 2023-04-12T15:55:29.257+0000 7f38bd59a700 10 -- [fd00:2380:be45:43::11]:0/2007947341 dispatch_throttle_release 24 to dispatch throttler 239/104857600 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 -- [fd00:2380:be45:43::11]:0/2007947341 done calling dispatch on 0x7f38c010ca30 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_event 2023-04-12T15:55:29.257+0000 7f38bd59a700 1 -- [fd00:2380:be45:43::11]:0/2007947341 <== mon.0 v1:[fd00:2380:be45:43::10]:6789/0 2 ==== mon_map magic: 0 v1 ==== 215+0+0 (unknown 253804068 0 0) 0x7f38b4014b00 con 0x7f38c0104dd0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).prepare_send_message m mon_subscribe({config=0+,monmap=0+}) v3 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).prepare_send_message encoding features 4540138314316775423 0x7f38c010f080 mon_subscribe({config=0+,monmap=0+}) v3 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_message no session security 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_message sending message type=15 src client.? front=58 data=0 off 0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_message sending 2 0x7f38c010f080 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 133 remaining bytes 0 2023-04-12T15:55:29.257+0000 7f38bd59a700 10 -- [fd00:2380:be45:43::11]:0/2007947341 dispatch_throttle_release 215 to dispatch throttler 215/104857600 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 -- [fd00:2380:be45:43::11]:0/2007947341 done calling dispatch on 0x7f38b4014b00 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).write_message sending 0x7f38c010f080 done. 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=1 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message process tag 7 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message begin MSG 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=53 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header r=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header got MSG header 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header got envelope type=62 src mon.0 front=4 data=0 off 0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_MESSAGE pgs=52 cs=1 l=1).throttle_message 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_BYTES pgs=52 cs=1 l=1).throttle_bytes 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_DISPATCH_QUEUE pgs=52 cs=1 l=1).throttle_dispatch_queue 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_front 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=4 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).handle_message_front r=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).handle_message_front got front 4 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_middle 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_data_prepare 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_data msg_left=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_footer 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=21 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer r=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer aborted = 0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer got 4 + 0 + 0 byte message 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer no session security set 2023-04-12T15:55:29.257+0000 7f38bdd9b700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1). rx mon.0 seq 3 0x7f38b4014df0 config(0 keys) v1 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 queue 0x7f38b4014df0 prio 196 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).wait_message 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.257+0000 7f38bd59a700 1 -- [fd00:2380:be45:43::11]:0/2007947341 <== mon.0 v1:[fd00:2380:be45:43::10]:6789/0 3 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f38b4014df0 con 0x7f38c0104dd0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message process tag 7 2023-04-12T15:55:29.257+0000 7f38bd59a700 10 -- [fd00:2380:be45:43::11]:0/2007947341 dispatch_throttle_release 4 to dispatch throttler 4/104857600 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message begin MSG 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 -- [fd00:2380:be45:43::11]:0/2007947341 done calling dispatch on 0x7f38b4014df0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=53 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header r=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header got MSG header 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).handle_message_header got envelope type=4 src mon.0 front=215 data=0 off 0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_MESSAGE pgs=52 cs=1 l=1).throttle_message 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_BYTES pgs=52 cs=1 l=1).throttle_bytes 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=THROTTLE_DISPATCH_QUEUE pgs=52 cs=1 l=1).throttle_dispatch_queue 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_front 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=215 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).handle_message_front r=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).handle_message_front got front 215 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_middle 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_data_prepare 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_data msg_left=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_MESSAGE_FRONT pgs=52 cs=1 l=1).read_message_footer 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=21 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer r=0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer aborted = 0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer got 215 + 0 + 0 byte message 2023-04-12T15:55:29.257+0000 7f38bdd9b700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1).handle_message_footer no session security set 2023-04-12T15:55:29.257+0000 7f38bdd9b700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=READ_FOOTER_AND_DISPATCH pgs=52 cs=1 l=1). rx mon.0 seq 4 0x7f38b40151a0 mon_map magic: 0 v1 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 queue 0x7f38b40151a0 prio 196 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).wait_message 2023-04-12T15:55:29.257+0000 7f38bd59a700 1 -- [fd00:2380:be45:43::11]:0/2007947341 <== mon.0 v1:[fd00:2380:be45:43::10]:6789/0 4 ==== mon_map magic: 0 v1 ==== 215+0+0 (unknown 253804068 0 0) 0x7f38b40151a0 con 0x7f38c0104dd0 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.257+0000 7f38bd59a700 10 -- [fd00:2380:be45:43::11]:0/2007947341 dispatch_throttle_release 215 to dispatch throttler 215/104857600 2023-04-12T15:55:29.257+0000 7f38bd59a700 20 -- [fd00:2380:be45:43::11]:0/2007947341 done calling dispatch on 0x7f38b40151a0 2023-04-12T15:55:29.257+0000 7f38bf59e700 1 -- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 legacy=0x7f38c0107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).stop 2023-04-12T15:55:29.257+0000 7f38bf59e700 2 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).stop 2023-04-12T15:55:29.257+0000 7f38bf59e700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).reset_recv_state 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0061950 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=OPENED pgs=52 cs=1 l=1).discard_out_queue started 2023-04-12T15:55:29.257+0000 7f38bdd9b700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CLOSED pgs=52 cs=1 l=1).reset_recv_state (warped) reseting security handlers 2023-04-12T15:55:29.257+0000 7f38bdd9b700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CLOSED pgs=52 cs=1 l=1).reset_security 2023-04-12T15:55:29.257+0000 7f38bdd9b700 20 EpollDriver.del_event del event fd=14 cur_mask=1 delmask=3 to 9 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown [fd00:2380:be45:43::11]:0/2007947341 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 Processor -- stop 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0069620 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bf59e700 1 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown_connections 2023-04-12T15:55:29.257+0000 7f38bf59e700 5 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown_connections mark down v1:[fd00:2380:be45:43::12]:6789/0 0x7f38c0108c30 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::12]:6789/0 conn(0x7f38c0108c30 0x7f38c010b0f0 :-1 s=CLOSED pgs=0 cs=0 l=0).stop 2023-04-12T15:55:29.257+0000 7f38bf59e700 5 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown_connections mark down v1:[fd00:2380:be45:43::10]:6789/0 0x7f38c0104dd0 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0104dd0 0x7f38c0107290 :-1 s=CLOSED pgs=52 cs=1 l=1).stop 2023-04-12T15:55:29.257+0000 7f38bf59e700 5 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown_connections mark down v2:[fd00:2380:be45:43::12]:3300/0 0x7f38c0102340 2023-04-12T15:55:29.257+0000 7f38bf59e700 1 --2- [fd00:2380:be45:43::11]:0/2007947341 >> v2:[fd00:2380:be45:43::12]:3300/0 conn(0x7f38c0102340 0x7f38c0104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-04-12T15:55:29.257+0000 7f38bf59e700 5 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown_connections delete 0x7f38c0102340 2023-04-12T15:55:29.257+0000 7f38bf59e700 5 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown_connections delete 0x7f38c0104dd0 2023-04-12T15:55:29.257+0000 7f38bf59e700 5 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown_connections delete 0x7f38c0108c30 2023-04-12T15:55:29.257+0000 7f38bf59e700 1 -- [fd00:2380:be45:43::11]:0/2007947341 >> [fd00:2380:be45:43::11]:0/2007947341 conn(0x7f38c0062e70 msgr2=0x7f38c00632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 --1- [fd00:2380:be45:43::11]:0/2007947341 >> [fd00:2380:be45:43::11]:0/2007947341 conn(0x7f38c0062e70 0x7f38c00632e0 :-1 s=NONE pgs=0 cs=0 l=0).stop 2023-04-12T15:55:29.257+0000 7f38bf59e700 2 --1- [fd00:2380:be45:43::11]:0/2007947341 >> [fd00:2380:be45:43::11]:0/2007947341 conn(0x7f38c0062e70 0x7f38c00632e0 :-1 s=NONE pgs=0 cs=0 l=0).stop 2023-04-12T15:55:29.257+0000 7f38bf59e700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> [fd00:2380:be45:43::11]:0/2007947341 conn(0x7f38c0062e70 0x7f38c00632e0 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0069620 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 --1- [fd00:2380:be45:43::11]:0/2007947341 >> [fd00:2380:be45:43::11]:0/2007947341 conn(0x7f38c0062e70 0x7f38c00632e0 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0060960 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0061950 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bed9d700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> [fd00:2380:be45:43::11]:0/2007947341 conn(0x7f38c0062e70 0x7f38c00632e0 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers 2023-04-12T15:55:29.257+0000 7f38bed9d700 5 --1- [fd00:2380:be45:43::11]:0/2007947341 >> [fd00:2380:be45:43::11]:0/2007947341 conn(0x7f38c0062e70 0x7f38c00632e0 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 -- [fd00:2380:be45:43::11]:0/2007947341 wait: waiting for dispatch queue 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 -- [fd00:2380:be45:43::11]:0/2007947341 wait: dispatch queue is stopped 2023-04-12T15:55:29.257+0000 7f38bf59e700 1 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown_connections 2023-04-12T15:55:29.257+0000 7f38bf59e700 5 -- [fd00:2380:be45:43::11]:0/2007947341 shutdown_connections delete 0x7f38c0062e70 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0069620 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0060960 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0061950 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 -- [fd00:2380:be45:43::11]:0/2007947341 wait: done. 2023-04-12T15:55:29.257+0000 7f38bf59e700 1 -- [fd00:2380:be45:43::11]:0/2007947341 wait complete. 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 -- ready 2023-04-12T15:55:29.257+0000 7f38bf59e700 1 Processor -- start 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0069620 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bf59e700 1 -- start start 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 -- create_connect v1:[fd00:2380:be45:43::10]:6789/0, creating connection and registering 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_NONE l=1)._connect 2023-04-12T15:55:29.257+0000 7f38bf59e700 20 Event(0x7f38c0060960 nevent=5000 time_id=3).wakeup 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 -- create_connect 0x7f38c0102340 v1:[fd00:2380:be45:43::10]:6789/0 v1:[fd00:2380:be45:43::10]:6789/0 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 -- connect_to v1:[fd00:2380:be45:43::10]:6789/0 new 0x7f38c0102340 2023-04-12T15:55:29.257+0000 7f38bf59e700 10 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=START_CONNECT pgs=0 cs=0 l=1).send_keepalive 2023-04-12T15:55:29.257+0000 7f38bf59e700 1 -- --> v1:[fd00:2380:be45:43::10]:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c0067e30 con 0x7f38c0102340 2023-04-12T15:55:29.257+0000 7f38bf59e700 15 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=START_CONNECT pgs=0 cs=0 l=1).send_message inline write is denied, reschedule m=0x7f38c0067e30 2023-04-12T15:55:29.257+0000 7f38be59c700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTING l=1).process 2023-04-12T15:55:29.257+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=4).create_file_event create event started fd=12 mask=1 original mask is 0 2023-04-12T15:55:29.257+0000 7f38be59c700 20 EpollDriver.add_event add event fd=12 cur_mask=0 add_mask=1 to 6 2023-04-12T15:55:29.257+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=4).create_file_event create event end fd=12 mask=1 current mask is 1 2023-04-12T15:55:29.257+0000 7f38be59c700 10 NetHandler reconnect reconnect: 114 Operation already in progress 2023-04-12T15:55:29.257+0000 7f38be59c700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress 2023-04-12T15:55:29.257+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=4).create_file_event create event started fd=12 mask=2 original mask is 1 2023-04-12T15:55:29.257+0000 7f38be59c700 20 EpollDriver.add_event add event fd=12 cur_mask=1 add_mask=2 to 6 2023-04-12T15:55:29.257+0000 7f38be59c700 20 Event(0x7f38c0060960 nevent=5000 time_id=4).create_file_event create event end fd=12 mask=2 current mask is 3 2023-04-12T15:55:29.257+0000 7f38be59c700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTING_RE l=1).handle_write 2023-04-12T15:55:29.257+0000 7f38be59c700 10 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=START_CONNECT pgs=0 cs=0 l=1).write_event 2023-04-12T15:55:29.257+0000 7f38be59c700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTING_RE l=1).process 2023-04-12T15:55:29.257+0000 7f38be59c700 20 EpollDriver.del_event del event fd=12 cur_mask=3 delmask=2 to 6 2023-04-12T15:55:29.257+0000 7f38be59c700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTING_RE l=1).process connect successfully, ready to send banner 2023-04-12T15:55:29.257+0000 7f38be59c700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=START_CONNECT pgs=0 cs=0 l=1).read_event 2023-04-12T15:55:29.257+0000 7f38be59c700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=START_CONNECT pgs=0 cs=0 l=1).send_client_banner 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 9 remaining bytes 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING pgs=0 cs=0 l=1).handle_client_banner_write r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING pgs=0 cs=0 l=1).handle_client_banner_write connect write banner done: v1:[fd00:2380:be45:43::10]:6789/0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).wait_server_banner 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=281 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=281 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify connect read peer addr v1:[fd00:2380:be45:43::10]:6789/0 on socket 12 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify connect peer addr for me is v1:[fd00:2380:be45:43::11]:44170/0 2023-04-12T15:55:29.261+0000 7f38be59c700 1 --1- >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:[fd00:2380:be45:43::10]:6789/0 says I am v1:[fd00:2380:be45:43::11]:44170/0 (socket says [fd00:2380:be45:43::11]:44170) 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 learned_addr had no addrs 2023-04-12T15:55:29.261+0000 7f38be59c700 1 -- [fd00:2380:be45:43::11]:0/4275451039 learned_addr learned my addr [fd00:2380:be45:43::11]:0/4275451039 (peer_addr_for_me v1:[fd00:2380:be45:43::11]:0/0) 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 136 remaining bytes 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_my_addr_write r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_my_addr_write connect sent my addr v1:[fd00:2380:be45:43::11]:0/4275451039 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).send_connect_message 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).send_connect_message connect sending gseq=1 cseq=0 proto=15 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 33 remaining bytes 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_message_write r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_message_write connect wrote (self +) cseq, waiting for reply 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).wait_connect_reply 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=26 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=26 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 connect got reply tag 13 connect_seq 1 global_seq 53 proto 15 flags 1 features 4540138314316775423 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_2 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_2 got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).wait_ack_seq 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=8 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_ack_seq r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 2 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_ack_seq got newly_acked_seq 0 vs out_seq 0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).discard_requeued_up_to 0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 8 remaining bytes 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_in_seq_write r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_in_seq_write send in_seq done 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).client_ready 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=53 cs=1 l=1).client_ready connect success 1, lossy = 1, features 4540138314316775423 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=53 cs=1 l=1).client_ready no authorizer, clearing session_security 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).wait_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_event 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).append_keepalive_or_ack 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message m auth(proto 0 30 bytes epoch 0) v1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message encoding features 4540138314316775423 0x7f38c0067e30 auth(proto 0 30 bytes epoch 0) v1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message no session security 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending message type=17 src client.? front=60 data=0 off 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 1 0x7f38c0067e30 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 144 remaining bytes 0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 0x7f38c0067e30 done. 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message process tag 15 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=8 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_keepalive2_ack r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_keepalive2_ack got KEEPALIVE_ACK 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).wait_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message process tag 7 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message begin MSG 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=53 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header got MSG header 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header got envelope type=18 src mon.0 front=24 data=0 off 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_MESSAGE pgs=53 cs=1 l=1).throttle_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_BYTES pgs=53 cs=1 l=1).throttle_bytes 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_DISPATCH_QUEUE pgs=53 cs=1 l=1).throttle_dispatch_queue 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_front 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=24 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).handle_message_front r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).handle_message_front got front 24 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_middle 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_data_prepare 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_data msg_left=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_footer 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=21 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer aborted = 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer got 24 + 0 + 0 byte message 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer no session security set 2023-04-12T15:55:29.261+0000 7f38be59c700 5 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1). rx mon.0 seq 1 0x7f38c0067e30 auth_reply(proto 1 0 (0) Success) v1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 queue 0x7f38c0067e30 prio 196 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).wait_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message process tag 7 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message begin MSG 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=53 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header got MSG header 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header got envelope type=4 src mon.0 front=215 data=0 off 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_MESSAGE pgs=53 cs=1 l=1).throttle_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_BYTES pgs=53 cs=1 l=1).throttle_bytes 2023-04-12T15:55:29.261+0000 7f38aeffd700 1 -- [fd00:2380:be45:43::11]:0/4275451039 <== mon.0 v1:[fd00:2380:be45:43::10]:6789/0 1 ==== auth_reply(proto 1 0 (0) Success) v1 ==== 24+0+0 (unknown 2435360628 0 0) 0x7f38c0067e30 con 0x7f38c0102340 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_DISPATCH_QUEUE pgs=53 cs=1 l=1).throttle_dispatch_queue 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_front 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=215 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).handle_message_front r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).handle_message_front got front 215 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_middle 2023-04-12T15:55:29.261+0000 7f38aeffd700 1 -- [fd00:2380:be45:43::11]:0/4275451039 --> v1:[fd00:2380:be45:43::10]:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0068070 con 0x7f38c0102340 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_data_prepare 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_data msg_left=0 2023-04-12T15:55:29.261+0000 7f38aeffd700 15 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).send_message inline write is denied, reschedule m=0x7f38c0068070 2023-04-12T15:55:29.261+0000 7f38aeffd700 20 Event(0x7f38c0060960 nevent=5000 time_id=5).wakeup 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_footer 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=21 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer aborted = 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer got 215 + 0 + 0 byte message 2023-04-12T15:55:29.261+0000 7f38aeffd700 10 -- [fd00:2380:be45:43::11]:0/4275451039 dispatch_throttle_release 24 to dispatch throttler 239/104857600 2023-04-12T15:55:29.261+0000 7f38aeffd700 20 -- [fd00:2380:be45:43::11]:0/4275451039 done calling dispatch on 0x7f38c0067e30 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer no session security set 2023-04-12T15:55:29.261+0000 7f38be59c700 5 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1). rx mon.0 seq 2 0x7f38b0025be0 mon_map magic: 0 v1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 queue 0x7f38b0025be0 prio 196 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).wait_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.261+0000 7f38aeffd700 1 -- [fd00:2380:be45:43::11]:0/4275451039 <== mon.0 v1:[fd00:2380:be45:43::10]:6789/0 2 ==== mon_map magic: 0 v1 ==== 215+0+0 (unknown 253804068 0 0) 0x7f38b0025be0 con 0x7f38c0102340 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_event 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message m mon_subscribe({config=0+,monmap=0+}) v3 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message encoding features 4540138314316775423 0x7f38c0068070 mon_subscribe({config=0+,monmap=0+}) v3 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message no session security 2023-04-12T15:55:29.261+0000 7f38aeffd700 10 -- [fd00:2380:be45:43::11]:0/4275451039 dispatch_throttle_release 215 to dispatch throttler 215/104857600 2023-04-12T15:55:29.261+0000 7f38aeffd700 20 -- [fd00:2380:be45:43::11]:0/4275451039 done calling dispatch on 0x7f38b0025be0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending message type=15 src client.? front=58 data=0 off 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 2 0x7f38c0068070 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 133 remaining bytes 0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 0x7f38c0068070 done. 2023-04-12T15:55:29.261+0000 7f38bf59e700 1 -- [fd00:2380:be45:43::11]:0/4275451039 --> v1:[fd00:2380:be45:43::10]:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c0068350 con 0x7f38c0102340 2023-04-12T15:55:29.261+0000 7f38bf59e700 15 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).send_message inline write is denied, reschedule m=0x7f38c0068350 2023-04-12T15:55:29.261+0000 7f38bf59e700 20 Event(0x7f38c0060960 nevent=5000 time_id=5).wakeup 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_event 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message m mon_subscribe({mgrmap=0+}) v3 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message encoding features 4540138314316775423 0x7f38c0068350 mon_subscribe({mgrmap=0+}) v3 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message no session security 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending message type=15 src client.4108 front=39 data=0 off 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 3 0x7f38c0068350 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 114 remaining bytes 0 2023-04-12T15:55:29.261+0000 7f38bf59e700 1 -- [fd00:2380:be45:43::11]:0/4275451039 --> v1:[fd00:2380:be45:43::10]:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c006b410 con 0x7f38c0102340 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 0x7f38c0068350 done. 2023-04-12T15:55:29.261+0000 7f38bf59e700 15 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).send_message inline write is denied, reschedule m=0x7f38c006b410 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message m mon_subscribe({osdmap=0}) v3 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message encoding features 4540138314316775423 0x7f38c006b410 mon_subscribe({osdmap=0}) v3 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message no session security 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending message type=15 src client.4108 front=39 data=0 off 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 4 0x7f38c006b410 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 114 remaining bytes 0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 0x7f38c006b410 done. 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message process tag 7 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message begin MSG 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=53 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header got MSG header 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header got envelope type=62 src mon.0 front=4 data=0 off 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_MESSAGE pgs=53 cs=1 l=1).throttle_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_BYTES pgs=53 cs=1 l=1).throttle_bytes 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_DISPATCH_QUEUE pgs=53 cs=1 l=1).throttle_dispatch_queue 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_front 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=4 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).handle_message_front r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).handle_message_front got front 4 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_middle 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_data_prepare 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_data msg_left=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_footer 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=21 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer aborted = 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer got 4 + 0 + 0 byte message 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer no session security set 2023-04-12T15:55:29.261+0000 7f38be59c700 5 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1). rx mon.0 seq 3 0x7f38b0025f40 config(0 keys) v1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 queue 0x7f38b0025f40 prio 196 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).wait_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.261+0000 7f38aeffd700 1 -- [fd00:2380:be45:43::11]:0/4275451039 <== mon.0 v1:[fd00:2380:be45:43::10]:6789/0 3 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f38b0025f40 con 0x7f38c0102340 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message process tag 7 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message begin MSG 2023-04-12T15:55:29.261+0000 7f38aeffd700 10 -- [fd00:2380:be45:43::11]:0/4275451039 dispatch_throttle_release 4 to dispatch throttler 4/104857600 2023-04-12T15:55:29.261+0000 7f38aeffd700 20 -- [fd00:2380:be45:43::11]:0/4275451039 done calling dispatch on 0x7f38b0025f40 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=53 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header got MSG header 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).handle_message_header got envelope type=4 src mon.0 front=215 data=0 off 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_MESSAGE pgs=53 cs=1 l=1).throttle_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_BYTES pgs=53 cs=1 l=1).throttle_bytes 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=THROTTLE_DISPATCH_QUEUE pgs=53 cs=1 l=1).throttle_dispatch_queue 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_front 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=215 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).handle_message_front r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).handle_message_front got front 215 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_middle 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_data_prepare 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_data msg_left=0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_MESSAGE_FRONT pgs=53 cs=1 l=1).read_message_footer 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=21 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer r=0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer aborted = 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer got 215 + 0 + 0 byte message 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1).handle_message_footer no session security set 2023-04-12T15:55:29.261+0000 7f38be59c700 5 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=READ_FOOTER_AND_DISPATCH pgs=53 cs=1 l=1). rx mon.0 seq 4 0x7f38b0026270 mon_map magic: 0 v1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 queue 0x7f38b0026270 prio 196 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).wait_message 2023-04-12T15:55:29.261+0000 7f38be59c700 20 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2023-04-12T15:55:29.261+0000 7f38aeffd700 1 -- [fd00:2380:be45:43::11]:0/4275451039 <== mon.0 v1:[fd00:2380:be45:43::10]:6789/0 4 ==== mon_map magic: 0 v1 ==== 215+0+0 (unknown 253804068 0 0) 0x7f38b0026270 con 0x7f38c0102340 2023-04-12T15:55:29.261+0000 7f38aeffd700 10 -- [fd00:2380:be45:43::11]:0/4275451039 dispatch_throttle_release 215 to dispatch throttler 215/104857600 2023-04-12T15:55:29.261+0000 7f38aeffd700 20 -- [fd00:2380:be45:43::11]:0/4275451039 done calling dispatch on 0x7f38b0026270 2023-04-12T15:55:29.261+0000 7f38bf59e700 1 -- [fd00:2380:be45:43::11]:0/4275451039 --> v1:[fd00:2380:be45:43::10]:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389c004f50 con 0x7f38c0102340 2023-04-12T15:55:29.261+0000 7f38bf59e700 15 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).send_message inline write is denied, reschedule m=0x7f389c004f50 2023-04-12T15:55:29.261+0000 7f38bf59e700 20 Event(0x7f38c0060960 nevent=5000 time_id=5).wakeup 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_event 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message m mon_command({"prefix": "get_command_descriptions"} v 0) v1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).prepare_send_message encoding features 4540138314316775423 0x7f389c004f50 mon_command({"prefix": "get_command_descriptions"} v 0) v1 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message no session security 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending message type=50 src client.4108 front=80 data=0 off 0 2023-04-12T15:55:29.261+0000 7f38be59c700 20 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 5 0x7f389c004f50 2023-04-12T15:55:29.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 155 remaining bytes 0 2023-04-12T15:55:29.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_message sending 0x7f389c004f50 done. 2023-04-12T15:55:32.261+0000 7f38adffb700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).send_keepalive 2023-04-12T15:55:32.261+0000 7f38adffb700 20 Event(0x7f38c0060960 nevent=5000 time_id=5).wakeup 2023-04-12T15:55:32.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write 2023-04-12T15:55:32.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_event 2023-04-12T15:55:32.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).append_keepalive_or_ack 2023-04-12T15:55:32.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 9 remaining bytes 0 2023-04-12T15:55:42.261+0000 7f38adffb700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).send_keepalive 2023-04-12T15:55:42.261+0000 7f38adffb700 20 Event(0x7f38c0060960 nevent=5000 time_id=5).wakeup 2023-04-12T15:55:42.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write 2023-04-12T15:55:42.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).write_event 2023-04-12T15:55:42.261+0000 7f38be59c700 10 --1- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 0x7f38c0067590 :-1 s=OPENED pgs=53 cs=1 l=1).append_keepalive_or_ack 2023-04-12T15:55:42.261+0000 7f38be59c700 10 -- [fd00:2380:be45:43::11]:0/4275451039 >> v1:[fd00:2380:be45:43::10]:6789/0 conn(0x7f38c0102340 legacy=0x7f38c0067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 9 remaining bytes 0 ^CInterrupted -- Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groÃƒ¼en Saal.

1 year, 1 month

pacific v16.2.1 (hot-fix) QE Validation status

by Yuri Weinstein

Details of this release are summarized here: https://tracker.ceph.com/issues/59426#note-3 Release Notes - TBD Seeking approvals/reviews for: smoke - Josh approved? orch - Adam King approved? (there are infrastructure issues in the runs, but we want to release this ASAP) Thx YuriW

1 year, 1 month

RBD snapshot mirror syncs all snapshots

by Andreas Teuchert

Hello, I setup two-way snapshot-based RBD mirroring between two Ceph clusters. After enabling mirroring for an image that already had regular snapshots independently from RBD mirror on the source cluster, the image and all snapshots were synced to the destination cluster. Is there a way to avoid having all snapshots being synced? We only need the latest version of the image on the destination cluster and the snapshots add around 200% disk space overhead on average. Best regards, Andreas

1 year, 1 month

Ceph Leadership Team Meeting, 2023-04-12 Minutes

by Patrick Donnelly

Hi folks, Today we discussed: - Just short of 1 exabyte of Ceph storage reported to Telemetry. Telemetry's data is public and viewable at: https://telemetry-public.ceph.com/d/ZFYuv1qWz/telemetry?orgId=1 If your cluster is not reporting to Telemetry, please consider it! :) - A request from the Ceph Foundation Board to begin tracking component (e.g. CephFS) roadmaps in docs (or somewhere else appropriate). Concurrently, leads may also begin sending out status updates on a ~quarterly basis. To be discussed further. - Cephalocon schedule is available: https://ceph2023.sched.com/ - A regression was reported for the exporter in 17.2.6: https://github.com/ceph/ceph/pull/50718#issuecomment-1503376925 A follow-up hotfix/announcement is planned. - Next week's meeting is canceled due to Cephalocon/travel. Meeting minutes available here as always: https://pad.ceph.com/p/clt-weekly-minutes -- Patrick Donnelly, Ph.D. He / Him / His Red Hat Partner Engineer IBM, Inc. GPG: 19F28A586F808C2402351B93C3301A3E258DD79D

1 year, 1 month

Re: avg apply latency went up after update from octopus to pacific

by Jan-Tristan Kruse

Hi, we solved our latency-problems in two clusters by redeploying all OSDs. Since then, we did not reencounter the problems described. Greetings, Jan

1 year, 1 month

[RGW] Rebuilding a non master zone

by Gilles Mocellin

Hello cephers ! As I was asking in another thread ([RGW] Rebuilding a non master zone), I try to find the best way to rebuild a zone in a multisite config. The goal is to get rid of remaining Large OMAP objects. The simplest way, as I can rely only on the primary zone, is to : - remove the zone from the zonegroup - delete the pools - recreate them by restarting radosgw instances - add the zone in the zonegroup Is there a simpler way ? One question I already asked was : can I delete only index and data pools (ZONE.rgw.buckets.data and ZONE.rgw.buckets.index), the multisite config (zones and zonegroup) should be still there, and perhaps it will just resync (or I can force a sync init) ? Another thing, about ceph-ansible, which I still use. I configure my zones with the multisite config of ceph-ansible, but one thing bothers me : it defines the zone endpoints on each radosgw instances, even with the loadbalancer configured. So, do you think I'd better not configure multisite with ceph-ansible, and do it manually ? Is there a way that will make things easier to migrate to cephadm ?

1 year, 1 month

Pacific dashboard: unable to get RGW information

by Michel Jouvin

Hi, Our cluster is running Pacific 16.2.10. We have a problem using the dashboard to display information about RGWs configured in the cluster. When clicking on "Object Gateway", we get an error 500. Looking in the mgr logs, I found that the problem is that the RGW is accessed by its IP address rather than its name. As the RGW has SSL enabled, the certificate cannot be matched against the IP address. I digged into the configuration but I was not able to identify where an IP address rather than a name was used (I checked in particular the zonegroup parameters and names are used to define endpoints). Did I make something wrong in the configuration or is it a know issue when using SSL-enabled RGW? Best regards, Michel

1 year, 1 month

Module 'cephadm' has failed: invalid literal for int() with base 10:

by Duncan M Tooke

Hi, Our Ceph cluster is in an error state with the message: # ceph status cluster: id: 58140ed2-4ed4-11ed-b4db-5c6f69756a60 health: HEALTH_ERR Module 'cephadm' has failed: invalid literal for int() with base 10: '352.broken' This happened after trying to re-add an OSD which had failed. Adopting it back in to the Ceph failed because a directory was causing problems in /var/lib/ceph/{cephid}/osd.352. To re-add the OSD I renamed it to osd.352.broken (rather than delete it), re-ran the command and then everything worked perfectly. Then 5 minutes later the ceph orchestrator went into "HEALTH_ERR" I've removed that directory, but "cephadm" isn't cleaning up after itself. Does anyone know if there's a way I can clear the cache for this directory it's tried to inventory and failed? Thanks, Duncan -- Dr Duncan Tooke | Research Cluster Administrator Centre for Computational Biology, Weatherall Institute of Molecular Medicine, University of Oxford, OX3 9DS www.imm.ox.ac.uk<http://www.imm.ox.ac.uk>

1 year, 1 month

radosgw-admin bucket stats doesn't show real num_objects and size

by viplanghe6＠gmail.com

The radosgw-admin bucket stats show there are 209266 objects in this bucket, but it included failed multiparts, so that make the size parameter is also wrong. When I use boto3 to count objects, the bucket only has 209049 objects. The only solution I can find is to use lifecycle to clean these failed multiparts, but in production, the client will decide to use lifecycle or not? So are there any way to exclude the failed multiparts in bucket statistic? Does Ceph allow to set auto clean failed multiparts globally? Thanks! "usage": { "rgw.main": { "size": 593286801276, "size_actual": 593716080640, "size_utilized": 593286801276, "size_kb": 579381642, "size_kb_actual": 579800860, "size_kb_utilized": 579381642, "num_objects": 209266 }

1 year, 1 month

Jump to page:

2024

2023

2022

2021

2020

2019

ceph-users April 2023