27 Jan
2023
27 Jan
'23
4:52 p.m.
Hello Team,
Please help me i deploy two ceph cluster with 6 node configuration almost 800tb of
capacity. and configurae in the DC-DR configuration for the data high availability. i
eanbel the rwg and rbd block device mirroring for the replocatio of the data. we have the
10 GBPS fiber replication network .
when we first start rbd mirror from our dc to dr starting time when we are replication our
exsisting data that time we are getting almomst 8 GBPS replication speed and it's work
fine. once all the exesting images data replicated now we are facing the replication speed
issue . now only we are getting the 5 to 10 mbps relication speed. we also try to find the
option like rbd_journal_max_payload_bytes and rbd_mirror_journal_max_fetch_bytes but max
payload size we try to increase but we don't get any result regarding the speed. it
still same . and rbd_mirror_journal_max_fetch_bytes option we are not able to find on the
our ceph version. i also try to modify some other values and increase like
rbd_mirror_memory_target
rbd_mirror_memory_cache_min
you also can find some refrence regarding this values for increase performace.
Eugen
[1]
https://tracker.ceph.com/projects/ceph/repository/revisions/1ef12ea0d29f955…
[2]
https://github.com/ceph/ceph/pull/27670
Information of my ceph Cluster.
Version: ceph version 17.2.5 (98318ae89f1a893a6ded3a640405cdbb33e08757) quincy (stable)
rbd-mirror daemon version: 17.2.5
Mirror mode; pool
max image mirro at time: 5
replication network: 10 gbps (dedicated)
Client: DC cluster we are continue writing the 50 to 400 mbps data but
replication only 5 to 10 mbps.
issue: speed only we get the 4 to 5 mbps. also we have the 10 Gbps replication network
bandwidth.
Note::- I also try to find the option rbd_mirror_journal_max_fetch_bytes but i'm not
able to find the this option in the configuration. also when i try to set from the
command
line it's showing error like
command:
ceph config set client.rbd rbd_mirror_journal_max_fetch_bytes 33554432
error:
Error EINVAL: unrecognized config option 'rbd_mirror_journal_max_fetch_bytes'