AWS SDK change (CRC32 checksums on multiple objects)
Hi, a colleague brought this to my attention: | AWS recently updated their SDKs to enable CRC32 checksums on multiple | object operations by default. | R2 does not currently support CRC32 checksums, and the default | configurations will return header related errors such as Header | 'x-amz-checksum-algorithm' with value 'CRC32' not implemented. https://www.cloudflarestatus.com/incidents/t5nrjmpxc1cj Is this likely to affect Ceph/radosgw users, if they update their clients to the new AWS SDKs? Or does radosgw already support this? thanks, Dave -- ** Dave Holland ** Systems Support -- Informatics Systems Group ** ** dh3@sanger.ac.uk ** Wellcome Sanger Institute, Hinxton, UK ** ---------------------------------------------------------------------- The Wellcome Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is Wellcome Sanger Institute, Wellcome Genome Campus, Hinxton, CB10 1SA.
I think we have to wait for the reef and quincy backport https://tracker.ceph.com/issues/63153 Am Di., 28. Jan. 2025 um 11:36 Uhr schrieb Dave Holland <dh3@sanger.ac.uk>:
Hi,
a colleague brought this to my attention:
| AWS recently updated their SDKs to enable CRC32 checksums on multiple | object operations by default. | R2 does not currently support CRC32 checksums, and the default | configurations will return header related errors such as Header | 'x-amz-checksum-algorithm' with value 'CRC32' not implemented. https://www.cloudflarestatus.com/incidents/t5nrjmpxc1cj
Is this likely to affect Ceph/radosgw users, if they update their clients to the new AWS SDKs? Or does radosgw already support this?
thanks, Dave -- ** Dave Holland ** Systems Support -- Informatics Systems Group ** ** dh3@sanger.ac.uk ** Wellcome Sanger Institute, Hinxton, UK **
---------------------------------------------------------------------- The Wellcome Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is Wellcome Sanger Institute, Wellcome Genome Campus, Hinxton, CB10 1SA. _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
On 28.01.25 11:52 AM, Stephan Hohn wrote:
I think we have to wait for the reef and quincy backport https://tracker.ceph.com/issues/63153
And there also is a new issue by Casey in the tracker to add support for CRC-64NVME: https://tracker.ceph.com/issues/69105 Regards Christian
As far as https://tracker.ceph.com/issues/63153 is concerned, https://github.com/ceph/ceph/pull/58435 (its reef backport) applies cleanly on top of 18.2.4. Backport to Quincy is less obvious -- Also, unsure if a new Quincy release is expected (17.2.8 should be the latest of the Quincy series). Cheers, Enrico On 1/28/25 12:13, Christian Rohmann wrote:
On 28.01.25 11:52 AM, Stephan Hohn wrote:
I think we have to wait for the reef and quincy backport https://tracker.ceph.com/issues/63153
And there also is a new issue by Casey in the tracker to add support for CRC-64NVME: https://tracker.ceph.com/issues/69105
Regards
Christian _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Enrico Bocchi CERN European Laboratory for Particle Physics IT - Storage & Data Management - General Storage Services Mailbox: G20500 - Office: 31-2-010 1211 Genève 23 Switzerland
On 28/1/25 19:33, Enrico Bocchi wrote:
Also, unsure if a new Quincy release is expected (17.2.8 should be the latest of the Quincy series).
https://pad.ceph.com/p/csc-weekly-minutes 17.2.8 - EOL That seems pretty clear to me. Also it's in line with expectations (one more point release after ${n+2}.2.0 release), and it did run for quite some months after the roughly expected June cutoff.
participants (5)
-
Christian Rohmann
-
Dave Holland
-
Enrico Bocchi
-
Gregory Orange
-
Stephan Hohn