Re: [RFC] Using LZ4 compression by default

On Aug 2, 2017, at 2:59 PM, Evgeny Kotkov <evgeny.kotkov_at_visualsvn.com> wrote:
> With the recently added support for LZ4 compression (r1801940 et al),
> we now have an option of using it by default for the on-disk data and
> over the wire.
> [...]
> The amount of the required additional space is proportional
> to the difference between the compression ratio of LZ4 and zlib-5,
> which can be roughly estimated as around 30-35% for compressible
> binary and text files, although that may vary depending on the
> actual data.
>
> To illustrate how these changes will affect the speed of some of the
> operations, the 'svn import' of a 2 GB file over HTTP on LAN in my
> environment takes 18 seconds instead of 63 seconds.

Regarding on disk storage, for small repos a 30% size increase is probably not material, but it may be significant for large repos. Is it feasible to get the best of both worlds by using LZ4 for fast commits and then recompress using zlib in svnadmin pack?
Received on 2017-08-04 16:30:51 CEST