[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: some questions/comments on using fsfs for file system

From: Oliver Jowett <oliver_at_opencloud.com>
Date: 2004-08-12 23:38:05 CEST

Greg Hudson wrote:
>>The time to load dump file using svnadmin:
>> BDB: 5 hrs 5% processor
>> FSFS: 1 hr 30% processor usage
> I heard tell this morning of a change to cvs2svn to make it use
> bdb-txn-nosync, allegedly speeding up conversion by a factor of four
> or so. So you might be able to get comparable conversion performance
> between the two back ends now.

You can either pass --bdb-txn-nosync directly to cvs2svn, or make
cvs2svn create a dumpfile and pass --bdb-txn-nosync when creating the
repo yourself.

When doing our conversion, 'svnadmin load' took ~10 hours by default.
Creating the repo with --bdb-txn-nosync sped things up to ~2 hours. In
both cases 'svnadmin load' was I/O bound.

Putting the whole repository in tmpfs sped it up even more, from ~2
hours to ~20 minutes (and then it was CPU bound, not I/O bound). Note
that you don't even need enough RAM to fit it all in memory for this to
be a win; in our case, most of the tmpfs mount got pushed out to swap
(~600mb repo on a 256mb machine). Obviously you have to remember to copy
the repo somewhere permanent afterwards if you do this :)


To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Thu Aug 12 23:38:49 2004

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.