Wow, crimson osd has some big problems if its latency is 10ms. OK, let's just wait until it's fixed.<br><br>Problem is that you don't know which data to resync without journaling. AFAIK Linstor/drbd9 does a similar thing, something like "write intent journaling", to provide fast resyncs, even though they don't have EC (they have it in beta). So I think the client-based approach can only be possible without fully ditching atomicity. Maybe for example it should involve some additional lazy synchronization among OSDs themselves using pglogs from client-driven writes. Hm.. sounds like it's even not unreal in ceph..:-)<br><br>Regarding the latency test, it also depends on network latency, so local test isn't the same as a clustered one. But thanks anyway. Pech OSD seems fast :-)<br>-- <br>With best regards,<br>  Vitaliy Filippov