OSD CPU and write latency increase after upgrade from 15.2.16 to 17.2.6
Hi, Recently, I upgraded Ceph from 15.2.16 to 17.2.6, but I found that OSD CPU usage increased from 30% to 90% or more, and OSD subop_w_latency increased from 600us to 5ms. This is incredible. My hardware environment: 12 nodes x 12 NVMe (Intel P4510 4T) I tried to set the OSD configuration to the default value and saw no improvement either. Have you ever encountered this problem? What might have gone wrong? Best regards, Tony Yao
After analysis, our cluster used compression, but did not use isal during compression. The compilation of ISAL compress in the current code depends on the macro HAVE_NASM_X64_AVX2. However, the macro HAVE_NASM_X64_AVX2 has been removed, resulting in the compression not using ISAL even if the compressor_zlib_isal parameter is set to true. At 2023-12-06 09:51:42, "Tony Yao" <yaoguo_tao@163.com> wrote:
Hi,
Recently, I upgraded Ceph from 15.2.16 to 17.2.6, but I found that OSD CPU usage increased from 30% to 90% or more, and OSD subop_w_latency increased from 600us to 5ms. This is incredible.
My hardware environment:
12 nodes x 12 NVMe (Intel P4510 4T)
I tried to set the OSD configuration to the default value and saw no improvement either.
Have you ever encountered this problem? What might have gone wrong?
Best regards, Tony Yao _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (1)
-
Tony Yao