[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: svn list -R of medium-size repository takes 10 hours.

From: Jean-Marc Godbout <jmgodbout_at_gmail.com>
Date: 2005-08-22 09:44:14 CEST

One thing that issue 2151 does mention is that we shouldn't have any
DeltaV properties in allprop queries, which we currently do. One of
the more expensive ones is "checked-in". Simply removing it causes
"svn list" to fail because it expects it. However, returning a bogus
value, such as simply "/" allows "svn list" to complete sucesfully,
and it does improve the times a whole lot! (note that I don't know how
the rest of subversion reacts to this, I think commit makes use of
"checked-in").

200 file test:
With: 1.09
Without: 0.73

800 file test
With: 6.38
Without: 3.20

1600 file test
With: 20.43
Without: 8.84

The difference in time is pretty important. Also, note that this is in
a VM, times are somewhat different in real world - Still, we are
talking about twice the speed.

An important note is that when removing the "checked-in" property,
traditional dav clients like cadaver also gain a pretty substantial
speed improvement (the server is much speedier).

I do realise that we are getting a bit far from the original issue
here. Removing some of the props have 3 benefits:
1. Making us more "DeltaV" compliant... we don't care so much for this
2. The server responds faster to queries
3. The server needs to send less data

I think part 3 has been the bulk of the issue in Carsten's case. I
doubt that there will be THAT MUCH of a difference by simply removing
the un needed properties in terms of the amount of data... but then
again I could be wrong. As well, with mod_deflate enabled the amount
of data should become less of an issue and #2 would become more
important.

There are a couple "todo"s in issue 2151 which I'll attempt to get to
in the next few days. But as a summary, it *seems* possible to
partially fix Carsten's problem.

Cheers
Jean-Marc Godbout

On 8/21/05, Philip Martin <philip@codematters.co.uk> wrote:
> Jean-Marc Godbout <jmgodbout@gmail.com> writes:
>
> > Actually, I might be wrong about "svn list" after all. After a couple
> > more attempts, here's what I've got:
> >
> > svn - mod_dav_svn == slow
> > cadaver - mod_dav_svn == slow
> > cadaver - mod_dav == fast!
> >
> > The slow part of this equation seems to be mod_dav_svn.
>
> That's issue 2151.
>
> --
> Philip Martin
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: dev-help@subversion.tigris.org
>
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Received on Mon Aug 22 09:45:21 2005

This is an archived mail posted to the Subversion Dev mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.