[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: How long do your svn dumps take

From: <kmradke_at_rockwellcollins.com>
Date: Mon, 20 Apr 2009 11:02:13 -0500

Stefan Sperling <stsp_at_elego.de> wrote on 04/19/2009 07:56:26 AM:
> On Sat, Apr 18, 2009 at 09:51:38PM -0400, Bob Archer wrote:
> >
> > Hi All...
> >
> >
> > I am upgrading from 1.5.5 to 1.6.1 today. Up to this point I have
only
> > been using svnadmin update. But, I decided it was time to do a
> > dump/load as many have recommended.
> >
> >
> > But, dumping one of our repo took about 5 hours. This is a 20GB
repo.
> > Is this normal. I see in the book it talks about doing a nightly
dump
> > so you can back up. Do people really run dumps that take 4+ hours?
>
> This rings a bell.
>
> I have been told by a user of an svnadmin dump that took 9+ hours.
> I have been meaning to reproduce the problem but did not have the time.
> (No pun intended! :)
>
> In that particular case it was reported that the dump took _longer_
> when started incrementally from a revision somewhere in the middle of
> revision history than when taking it from revision 0 on onwards.
>
> I believe there may be problem, but we need some more data.

Just a random datapoint, but the number of directories in one directory
seems to really affect svnadmin verify performance. (Essentially just
a dump followed by a load...) We have a fairly small repo (3G) that has
8000 directories inside a top level directory. A verify takes over 40
hours now. It seems to get really bad after a couple thousand dirs. We
have a 160G repo with twice the number of files and revisions that
takes <2 hours on the same server. All FSFS using Subversion 1.5.

I seem to remember it being mentioned that Subversion wasn't
optimized for large numbers of files/dirs inside one directory.

I'll see if I can get this moved to a server where I can enable
profiling...

Kevin R.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=1826723

To unsubscribe from this discussion, e-mail: [users-unsubscribe_at_subversion.tigris.org].
Received on 2009-04-20 18:03:21 CEST

This is an archived mail posted to the Subversion Users mailing list.