[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Problem Loading Huge Repository

From: Daniel Shahaf <d.s_at_daniel.shahaf.name>
Date: Fri, 17 Jun 2011 17:54:13 +0300

Thomas Harold wrote on Fri, Jun 17, 2011 at 10:31:43 -0400:
> On 6/16/2011 7:05 PM, Bruno Antunes wrote:
> >
> >Do you know any faster way to load the dump file or to filter out
> >some projects/revisions so I can speed up the process?
> >
>
> Are you CPU-bound? Or are you limited by disk speed? If you're limited
> by disk access times, make sure that the source file that you're loading
> from is on a different disk then the destination repository. Even if you
> toss the 45GB dump file onto a USB2 external disk, you'll see a speed
> increase.
>
> And if you have a choice of file systems for the repository to be stored
> on, make sure that it's something which can deal with a few hundred
> thousand tiny files. On Linux, I'd suggest going with ext4 over ext3.
> While db/revs in a FSFS repository can have its revisions packed to
> reduce the file count, the db/revprops folder still consists of 1 tiny
> file for every revision in the project in a FSFS repository.

revprops/ is sharded.

And in 1.7 (including the recent 1.7.0-alpha1) it is packed, too.

>
Received on 2011-06-17 16:55:00 CEST

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.