[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Problem Loading Huge Repository

From: Thomas Harold <thomas-lists_at_nybeta.com>
Date: Fri, 17 Jun 2011 10:31:43 -0400

On 6/16/2011 7:05 PM, Bruno Antunes wrote:
>
> Do you know any faster way to load the dump file or to filter out
> some projects/revisions so I can speed up the process?
>

Are you CPU-bound? Or are you limited by disk speed? If you're limited
by disk access times, make sure that the source file that you're loading
from is on a different disk then the destination repository. Even if you
toss the 45GB dump file onto a USB2 external disk, you'll see a speed
increase.

And if you have a choice of file systems for the repository to be stored
on, make sure that it's something which can deal with a few hundred
thousand tiny files. On Linux, I'd suggest going with ext4 over ext3.
While db/revs in a FSFS repository can have its revisions packed to
reduce the file count, the db/revprops folder still consists of 1 tiny
file for every revision in the project in a FSFS repository.
Received on 2011-06-17 16:32:20 CEST

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.