That was all that it logged. In the meantime I did some further test. I've created a new erasure coded datapool 'ecpool_test' and if I create a new rbd image with this data pool I can create snapshots, but I can't create snapshots on both new and existing images with existing data pool 'ecpool_hdd' #create new image on existing erasure code data-pool ecpool_hdd root@zephir:~# rbd create -p rbd --data-pool ecpool_hdd test_ecpool_hdd --size 10G #create new image on new erasure code data-pool ecpool_test root@zephir:~# rbd create -p rbd --data-pool ecpool_test test_ecpool_test --size 10G # trying to create snap-shot of image with data pool ecpool_hdd -> fails root@zephir:~# rbd snap create test_ecpool_hdd@backup --debug-ms 1 --debug-rbd 20 2023-04-17T21:52:43.623+0200 7f3f787174c0 1 Processor -- start 2023-04-17T21:52:43.623+0200 7f3f787174c0 1 -- start start 2023-04-17T21:52:43.623+0200 7f3f787174c0 1 --2- >> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x562a3dd350c0 0x562a3dd35490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-04-17T21:52:43.623+0200 7f3f787174c0 1 --2- >> [v2: 192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562a3dd359d0 0x562a3dd42730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-04-17T21:52:43.623+0200 7f3f787174c0 1 --2- >> [v2: 192.168.43.208:3300/0,v1:192.168.43.208:6789/0] conn(0x562a3dd42c70 0x562a3dd45050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-04-17T21:52:43.623+0200 7f3f787174c0 1 -- --> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a3dc24b70 con 0x562a3dd350c0 2023-04-17T21:52:43.623+0200 7f3f787174c0 1 -- --> [v2: 192.168.1.10:3300/0,v1:192.168.1.10:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a3dc1e1b0 con 0x562a3dd359d0 2023-04-17T21:52:43.623+0200 7f3f787174c0 1 -- --> [v2: 192.168.43.208:3300/0,v1:192.168.43.208:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a3dbba680 con 0x562a3dd42c70 2023-04-17T21:52:43.623+0200 7f3f7668d700 1 --2- >> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x562a3dd350c0 0x562a3dd35490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supporte d=3 required=0 2023-04-17T21:52:43.623+0200 7f3f7668d700 1 --2- >> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x562a3dd350c0 0x562a3dd35490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.1.1:3300 /0 says I am v2:192.168.1.1:43298/0 (socket says 192.168.1.1:43298) 2023-04-17T21:52:43.623+0200 7f3f7668d700 1 -- 192.168.1.1:0/3758799544 learned_addr learned my addr 192.168.1.1:0/3758799544 (peer_addr_for_me v2: 192.168.1.1:0/0) 2023-04-17T21:52:43.623+0200 7f3f75e8c700 1 --2- 192.168.1.1:0/3758799544
[v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562a3dd359d0 0x562a3dd42730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_pe er_banner_payload supported=3 required=0 2023-04-17T21:52:43.623+0200 7f3f7668d700 1 -- 192.168.1.1:0/3758799544 >> [v2:192.168.43.208:3300/0,v1:192.168.43.208:6789/0] conn(0x562a3dd42c70 msgr2=0x562a3dd45050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-04-17T21:52:43.623+0200 7f3f7668d700 1 --2- 192.168.1.1:0/3758799544 [v2:192.168.43.208:3300/0,v1:192.168.43.208:6789/0] conn(0x562a3dd42c70 0x562a3dd45050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-04-17T21:52:43.623+0200 7f3f7668d700 1 -- 192.168.1.1:0/3758799544 >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562a3dd359d0 msgr2=0x562a3dd42730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-04-17T21:52:43.623+0200 7f3f7668d700 1 --2- 192.168.1.1:0/3758799544 [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562a3dd359d0 0x562a3dd42730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-04-17T21:52:43.623+0200 7f3f7668d700 1 -- 192.168.1.1:0/3758799544 --> [v2:192.168.1.1:3300/0,v1:192.168.1.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a3dbd1d60 con 0x562a3dd350c0 2023-04-17T21:52:43.623+0200 7f3f7668d700 1 --2- 192.168.1.1:0/3758799544 [v2:192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x562a3dd350c0 0x562a3dd35490 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800a700 tx=0x7f3f68005b10 comp rx=0 tx= 0).ready entity=mon.0 client_cookie=b20073a6af526567 server_cookie=0 in_seq=0 out_seq=0 2023-04-17T21:52:43.623+0200 7f3f7568b700 1 -- 192.168.1.1:0/3758799544 <== mon.0 v2:192.168.1.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 467+0+0 (secure 0 0 0) 0x7f3f680089b0 con 0x562a3dd350c0 2023-04-17T21:52:43.623+0200 7f3f7568b700 1 -- 192.168.1.1:0/3758799544 <== mon.0 v2:192.168.1.1:3300/0 2 ==== config(39 keys) v1 ==== 1461+0+0 (secure 0 0 0) 0x7f3f68008b10 con 0x562a3dd350c0 2023-04-17T21:52:43.623+0200 7f3f7568b700 1 -- 192.168.1.1:0/3758799544 <== mon.0 v2:192.168.1.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 467+0+0 (secure 0 0 0) 0x7f3f68011e60 con 0x562a3dd350c0 Creating snap: 10% complete...failed. rbd: failed to create snapshot: (95) Operation not supported root@zephir:~#
# trying to create snapshot of image with new data pool ecpool_test -> success root@zephir:~# rbd snap create test_ecpool_test@backup --debug-ms 1 --debug-rbd 20 2023-04-17T21:52:52.883+0200 7f3d15ceb4c0 1 Processor -- start 2023-04-17T21:52:52.883+0200 7f3d15ceb4c0 1 -- start start 2023-04-17T21:52:52.883+0200 7f3d15ceb4c0 1 --2- >> [v2: 192.168.43.208:3300/0,v1:192.168.43.208:6789/0] conn(0x5603e9c7e530 0x5603e9c7e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-04-17T21:52:52.883+0200 7f3d15ceb4c0 1 --2- >> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x5603e9c785c0 0x5603e9c789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-04-17T21:52:52.883+0200 7f3d15ceb4c0 1 --2- >> [v2: 192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x5603e9c78f30 0x5603e9c852f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-04-17T21:52:52.883+0200 7f3d15ceb4c0 1 -- --> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9b64b70 con 0x5603e9c785c0 2023-04-17T21:52:52.883+0200 7f3d15ceb4c0 1 -- --> [v2: 192.168.1.10:3300/0,v1:192.168.1.10:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9b5e1b0 con 0x5603e9c78f30 2023-04-17T21:52:52.883+0200 7f3d15ceb4c0 1 -- --> [v2: 192.168.43.208:3300/0,v1:192.168.43.208:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9afa680 con 0x5603e9c7e530 2023-04-17T21:52:52.883+0200 7f3d0bfff700 1 --2- >> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x5603e9c785c0 0x5603e9c789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supporte d=3 required=0 2023-04-17T21:52:52.883+0200 7f3d0bfff700 1 --2- >> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x5603e9c785c0 0x5603e9c789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.1.1:3300 /0 says I am v2:192.168.1.1:41638/0 (socket says 192.168.1.1:41638) 2023-04-17T21:52:52.883+0200 7f3d0bfff700 1 -- 192.168.1.1:0/2685923383 learned_addr learned my addr 192.168.1.1:0/2685923383 (peer_addr_for_me v2: 192.168.1.1:0/0) 2023-04-17T21:52:52.883+0200 7f3d14825700 1 --2- 192.168.1.1:0/2685923383
[v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x5603e9c78f30 0x5603e9c852f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_pe er_banner_payload supported=3 required=0 2023-04-17T21:52:52.883+0200 7f3d0bfff700 1 -- 192.168.1.1:0/2685923383 >> [v2:192.168.43.208:3300/0,v1:192.168.43.208:6789/0] conn(0x5603e9c7e530 msgr2=0x5603e9c7e900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-04-17T21:52:52.883+0200 7f3d0bfff700 1 --2- 192.168.1.1:0/2685923383 [v2:192.168.43.208:3300/0,v1:192.168.43.208:6789/0] conn(0x5603e9c7e530 0x5603e9c7e900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-04-17T21:52:52.883+0200 7f3d0bfff700 1 -- 192.168.1.1:0/2685923383 >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x5603e9c78f30 msgr2=0x5603e9c852f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-04-17T21:52:52.883+0200 7f3d0bfff700 1 --2- 192.168.1.1:0/2685923383 [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x5603e9c78f30 0x5603e9c852f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-04-17T21:52:52.883+0200 7f3d0bfff700 1 -- 192.168.1.1:0/2685923383 --> [v2:192.168.1.1:3300/0,v1:192.168.1.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603e9b11d60 con 0x5603e9c785c0 2023-04-17T21:52:52.883+0200 7f3d0bfff700 1 --2- 192.168.1.1:0/2685923383 [v2:192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x5603e9c785c0 0x5603e9c789f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00a700 tx=0x7f3cfc005b10 comp rx=0 tx= 0).ready entity=mon.0 client_cookie=d9d113e873a32a9f server_cookie=0 in_seq=0 out_seq=0 2023-04-17T21:52:52.883+0200 7f3d13823700 1 -- 192.168.1.1:0/2685923383 <== mon.0 v2:192.168.1.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 467+0+0 (secure 0 0 0) 0x7f3cfc008a30 con 0x5603e9c785c0 2023-04-17T21:52:52.883+0200 7f3d13823700 1 -- 192.168.1.1:0/2685923383 <== mon.0 v2:192.168.1.1:3300/0 2 ==== config(39 keys) v1 ==== 1461+0+0 (secure 0 0 0) 0x7f3cfc008b90 con 0x5603e9c785c0 2023-04-17T21:52:52.883+0200 7f3d13823700 1 -- 192.168.1.1:0/2685923383 <== mon.0 v2:192.168.1.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 467+0+0 (secure 0 0 0) 0x7f3cfc0063a0 con 0x5603e9c785c0 Creating snap: 100% complete...done. root@zephir:~#
root@zephir:~# ceph osd pool ls detail | egrep "ecpool_hdd|ecpool_test" pool 37 'ecpool_hdd' erasure profile 3-2-jerasure size 5 min_size 4 crush_rule 5 object_hash rjenkins pg_num 128 pgp_num 128 autoscale_mode on last_change 72385 lfor 0/0/65311 flags hashpspool,ec_overwrites,selfmanaged_snaps stripe_width 12288 compression_algorithm lz4 compression_mode aggressive compression_required_ratio 0.875 application cephfs,rbd pool 87 'ecpool_test' erasure profile 3-2-jerasure size 5 min_size 4 crush_rule 9 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode on last_change 72720 flags hashpspool,ec_overwrites,selfmanaged_snaps stripe_width 12288 compression_algorithm lz4 compression_mode aggressive compression_required_ratio 0.825 application cephfs,rbd root@zephir:~# root@zephir:~# rbd config pool list ecpool_hdd > ecpool_hdd.txt root@zephir:~# rbd config pool list ecpool_test > ecpool_test.txt root@zephir:~# diff ecpool_hdd.txt ecpool_test.txt root@zephir:~# I'm currently running ceph osd pool repair ecpool_hdd and will check later if that fixes the problem Cheers Reto Am Mo., 17. Apr. 2023 um 21:18 Uhr schrieb Ilya Dryomov <idryomov@gmail.com
:
On Mon, Apr 17, 2023 at 6:37 PM Reto Gysi <rlgysi@gmail.com> wrote:
Hi Ilya,
Thanks for the reply. Here's is the output:
root@zephir:~# rbd status ceph-dev Watchers: watcher=192.168.1.1:0/338620854 client.19264246
cookie=18446462598732840969
root@zephir:~# rbd snap create ceph-dev@backup --debug-ms 1 --debug-rbd
20
2023-04-17T18:23:16.211+0200 7f5e05dca4c0 1 Processor -- start 2023-04-17T18:23:16.211+0200 7f5e05dca4c0 1 -- start start 2023-04-17T18:23:16.211+0200 7f5e05dca4c0 1 --2- >> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x5558b4e3c260 0x5558b4e3c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-04-17T18:23:16.211+0200 7f5e05dca4c0 1 --2- >> [v2: 192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x5558b4e3cc00 0x5558b4e452d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-04-17T18:23:16.211+0200 7f5e05dca4c0 1 --2- >> [v2: 192.168.43.208:3300/0,v1:192.168.43.208:6789/0] conn(0x5558b4e45810 0x5558b4e47bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-04-17T18:23:16.211+0200 7f5e05dca4c0 1 -- --> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558b4d29b70 con 0x5558b4e3c260 2023-04-17T18:23:16.211+0200 7f5e05dca4c0 1 -- --> [v2: 192.168.1.10:3300/0,v1:192.168.1.10:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558b4d231b0 con 0x5558b4e3cc00 2023-04-17T18:23:16.211+0200 7f5e05dca4c0 1 -- --> [v2: 192.168.43.208:3300/0,v1:192.168.43.208:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558b4cbf680 con 0x5558b4e45810 2023-04-17T18:23:16.211+0200 7f5e04103700 1 --2- >> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x5558b4e3c260 0x5558b4e3c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supporte d=3 required=0 2023-04-17T18:23:16.211+0200 7f5e04103700 1 --2- >> [v2: 192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x5558b4e3c260 0x5558b4e3c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:192.168.1.1:3300 /0 says I am v2:192.168.1.1:42714/0 (socket says 192.168.1.1:42714) 2023-04-17T18:23:16.211+0200 7f5e04103700 1 -- 192.168.1.1:0/1614127865 learned_addr learned my addr 192.168.1.1:0/1614127865 (peer_addr_for_me v2:192.168.1.1:0/0) 2023-04-17T18:23:16.211+0200 7f5e03902700 1 --2- 192.168.1.1:0/1614127865 >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x5558b4e3cc00 0x5558b4e452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_pe er_banner_payload supported=3 required=0 2023-04-17T18:23:16.211+0200 7f5e04103700 1 -- 192.168.1.1:0/1614127865
[v2:192.168.43.208:3300/0,v1:192.168.43.208:6789/0] conn(0x5558b4e45810 msgr2=0x5558b4e47bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-04-17T18:23:16.211+0200 7f5e04103700 1 --2- 192.168.1.1:0/1614127865 >> [v2: 192.168.43.208:3300/0,v1:192.168.43.208:6789/0] conn(0x5558b4e45810 0x5558b4e47bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-04-17T18:23:16.211+0200 7f5e04103700 1 -- 192.168.1.1:0/1614127865 [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x5558b4e3cc00 msgr2=0x5558b4e452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-04-17T18:23:16.211+0200 7f5e04103700 1 --2- 192.168.1.1:0/1614127865 >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x5558b4e3cc00 0x5558b4e452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-04-17T18:23:16.211+0200 7f5e04103700 1 -- 192.168.1.1:0/1614127865 --> [v2:192.168.1.1:3300/0,v1:192.168.1.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558b4cd6d60 con 0x5558b4e3c260 2023-04-17T18:23:16.211+0200 7f5e04103700 1 --2- 192.168.1.1:0/1614127865 >> [v2:192.168.1.1:3300/0,v1:192.168.1.1:6789/0] conn(0x5558b4e3c260 0x5558b4e3c630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5df400a700 tx=0x7f5df4005b10 comp rx=0 tx= 0).ready entity=mon.0 client_cookie=2d9464291c26a0e7 server_cookie=0 in_seq=0 out_seq=0 2023-04-17T18:23:16.211+0200 7f5e03101700 1 -- 192.168.1.1:0/1614127865 <== mon.0 v2:192.168.1.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 467+0+0 (secure 0 0 0) 0x7f5df40089b0 con 0x5558b4e3c260 2023-04-17T18:23:16.211+0200 7f5e03101700 1 -- 192.168.1.1:0/1614127865 <== mon.0 v2:192.168.1.1:3300/0 2 ==== config(39 keys) v1 ==== 1461+0+0 (secure 0 0 0) 0x7f5df4008b10 con 0x5558b4e3c260 2023-04-17T18:23:16.211+0200 7f5e03101700 1 -- 192.168.1.1:0/1614127865 <== mon.0 v2:192.168.1.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 467+0+0 (secure 0 0 0) 0x7f5df4011e60 con 0x5558b4e3c260 Creating snap: 10% complete...failed. rbd: failed to create snapshot: (95) Operation not supported
Can you double check if this output is complete? It looks truncated to me -- the debug log part (lines beginning with a timestamp) should be many times longer.
Try collecting it as follows and attach log.txt file:
$ rbd snap create ceph-dev@backup --debug-ms 1 --debug-rbd 20 >log.txt 2>&1
Thanks,
Ilya