Re: Problem Loading Huge Repository
Bruno Antunes <bema_at_dei.uc.pt> wrote on 06/16/2011 06:05:13 PM:
> As part of the work of my PhD thesis I need to load the ASF
> Subversion repository into my own local repository in order to mine
> and extract information from the repository without overloading the
> ASF servers.
> I have downloaded the repository dump and started loading it into my
> own repository. But the repository is huge (~45GB), and loading it
> using 'svnadmin load' will take me days (~15).
> I tried 'svndumpfilter' to filter out some projects but I get the
> error 'svndumpfilter: Unsupported dumpfile version: 3'. I'm using
> 'svndumpfilter' version 1.6.12. Is there any way to overcome this error?
You have a "--deltas" dump which svndumpfilter does not support, however
a non-deltas dump would be *significantly* larger.
> Do you know any faster way to load the dump file or to filter out
> some projects/revisions so I can speed up the process?
You might try keeping the dumpfile and the new repo on different
physical disks. 45GB shouldn't take 15 days. I've loaded 300GB+ dump
files in under a day on 3 year old low end server hardware...
Received on 2011-06-17 15:15:37 CEST
This is an archived mail posted to the Subversion Users