On 9/11/19 11:07 PM, burcarjo(a)gmail.com wrote:
I have a cephFS 13.2.6 setup composed by 3 OSDs nodes
+ 1 MDS + 1 monitor. All the nodes are working with CentOS Linux release 7.6.1810 (Core)
When writing multiple lot of files (500MB) then the "ls" command of this
directory works very slow from an external client (if I list the directory from the same
client node that is writing the files then the operation returns immediately):
[cephuser@stor2demo ~]$ time ll -h /mnt/cephfs/dir1/dir2
real 2m40.246s
user 0m0.002s
sys 0m0.003s
The Ceph logs shows this information:
[cephuser@stor1demo ~]$ ceph health detail
HEALTH_WARN 1 MDSs report slow metadata IOs; 1 MDSs report slow requests; 1/10269 objects
misplaced (0.010%)
MDS_SLOW_METADATA_IO 1 MDSs report slow metadata IOs
mdsstor1demo(mds.0): 5 slow metadata IOs are blocked > 30 secs, oldest blocked
for 34 secs
MDS_SLOW_REQUEST 1 MDSs report slow requests
mdsstor1demo(mds.0): 2 slow requests are blocked > 30 secs
OBJECT_MISPLACED 1/10269 objects misplaced (0.010%)
Why this behaviour ?
What is your hardware for metadata pool?
k