[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Problem Loading Huge Repository

From: <kmradke_at_rockwellcollins.com>
Date: Fri, 17 Jun 2011 08:15:01 -0500

Bruno Antunes <bema_at_dei.uc.pt> wrote on 06/16/2011 06:05:13 PM:
>
> As part of the work of my PhD thesis I need to load the ASF
> Subversion repository into my own local repository in order to mine
> and extract information from the repository without overloading the
> ASF servers.
>
> I have downloaded the repository dump and started loading it into my
> own repository. But the repository is huge (~45GB), and loading it
> using 'svnadmin load' will take me days (~15).
>
> I tried 'svndumpfilter' to filter out some projects but I get the
> error 'svndumpfilter: Unsupported dumpfile version: 3'. I'm using
> 'svndumpfilter' version 1.6.12. Is there any way to overcome this error?

You have a "--deltas" dump which svndumpfilter does not support, however
a non-deltas dump would be *significantly* larger.

> Do you know any faster way to load the dump file or to filter out
> some projects/revisions so I can speed up the process?

You might try keeping the dumpfile and the new repo on different
physical disks. 45GB shouldn't take 15 days. I've loaded 300GB+ dump
files in under a day on 3 year old low end server hardware...

Kevin R.
Received on 2011-06-17 15:15:37 CEST

This is an archived mail posted to the Subversion Users mailing list.