[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Proposal: new fsfs.conf properties

From: Paul Hammant <paul_at_hammant.org>
Date: Tue, 11 Jul 2017 16:07:24 -0400

So I'm after a time saving. I'm perfectly happy for the backend to waste
space (in my configuration), I just don't want it to take 15 mins to
transfer a single 15GB file into Subversion.

In my configuration, I'd like to pre-advise Subversion to save as much time
as possible for uploads, by skipping steps that are known in advance to be
meaningless for the use case.

- Paul

On Tue, Jul 11, 2017 at 4:00 PM, Daniel Shahaf <danielsh_at_apache.org> wrote:

> On Tue, Jul 11, 2017 at 01:39:56PM +0000, Markus Schaber wrote:
> > To summarize it up:
> >
> > I expect significant benefits in some use cases by skipping the
> > compression, thus I'm +1 if benchmarks prove it's worth the effort.
>
> It is easy to have deltification without compression, either by using
> svndiff0 (instead of svndiff1) or by using svndiff1 with zlib
> compression level set appropriately.
>
> > I see the danger of drastically increased bandwith and storage size
> > (transferring/storing the whole mp3 instead of just some changed meta
> > data bytes) in some common use cases when deltification is skipped.
> > Thus, I'm skeptical (count it as -0), and I'd kindly suggest to do
> > some benchmarks for those cases before implementation, and clear
> > documentation of the possible negative effects if it's implemented.
>
> Regarding compression, would it make sense for the server to compute the
> compressed delta, and it turns out to be larger than X% of the
> uncompressed&undeltified file, to just store the latter? I.e., to
> compute the DELTA rep but use a PLAIN rep if the DELTA rep would be
> larger than X% (in bytes) of the PLAIN rep?
>
> IIRC this is already so with X=100, but for some filetypes it might make
> sense to set X lower.
>
> Cheers,
>
> Daniel
>
Received on 2017-07-11 22:07:28 CEST

This is an archived mail posted to the Subversion Dev mailing list.