Hello,
source code should be compressible, maybe just creating something like
a tar.gz per repo or so? That way you would get much bigger objects
that could improve speed and make it easier to store on any storage
system.
--
Martin Verges
Managing director
Mobile: +49 174 9335695
E-Mail: martin.verges(a)croit.io
Chat:
https://t.me/MartinVerges
croit GmbH, Freseniusstr. 31h, 81247 Munich
CEO: Martin Verges - VAT-ID: DE310638492
Com. register: Amtsgericht Munich HRB 231263
Web:
https://croit.io
YouTube:
https://goo.gl/PGE1Bx
Am Sa., 30. Jan. 2021 um 16:01 Uhr schrieb Loïc Dachary <loic(a)dachary.org>rg>:
>
> Bonjour,
>
> In the context Software Heritage (a noble mission to preserve all source code)[0],
artifacts have an average size of ~3KB and there are billions of them. They never change
and are never deleted. To save space it would make sense to write them, one after the
other, in an every growing RBD volume (more than 100TB). An index, located somewhere else,
would record the offset and size of the artifacts in the volume.
>
> I wonder if someone already implemented this idea with success? And if not... does
anyone see a reason why it would be a bad idea?
>
> Cheers
>
> [0]
https://docs.softwareheritage.org/
>
> --
> Loïc Dachary, Artisan Logiciel Libre
>
>
>
>
>
>
> _______________________________________________
> ceph-users mailing list -- ceph-users(a)ceph.io
> To unsubscribe send an email to ceph-users-leave(a)ceph.io