Re: svnadmin load runs out of memory

I know there is an incompatability between 0.33.1 and 0.34.0. Thats one
of the reasons I was doing the dump and load cycle. The other reason is
that I'd forgotten to do the deltify and I needed to reduce the size of
the repositiory (It had got up to 4.5Gb although there are only 146
revisions!). Another question on this: Does a svnadmin load do the
deltification?

There are several revisions that fail. rev 65 fails but then I can run a
recover and it says that rev 65 exists(?) so I can then continue and
load the other revisions. But before the load is complete it fails on
about (128) and a recover doesn't fix it.

The only file that was changed in the revisions that fail is the large
SQL script.

I think you're right about the memory. I'm not entirely sure how Windows
works (Who is?), but I think a program can only ever allocate a max of
4Gb. The additional 2Gb may or may not be usable by other programs?

Cheers.
Dave.

Edmund Horner wrote:

> Dave Oxley wrote:
>
>> I'm trying to do a load into 0.34.0 after a dump but wherever I try
>> it, it runs out of memory.
>> I've tried it on my WinXP box that has 2Gb of memory and 4Gb page
>> file. It allocates all of the 2Gb physical and 2Gb of the page file
>> and then falls over. My Linux box has less memory and falls over
>> earlier.
>> I've been storing an SQL dump of a database in the repos, but the
>> file is only 60Mb, but this seems to be what is killing the load.
>> Also svnadmin (0.33.1) ran out of memory when I was trying to do
>> deltify's.
>>
>> Any ideas what I can do?
>
>
> Firstly (since you mention 0.33.1 and 0.34.0, and there is an
> incompatibility between them), are you using the same svnadmin to
> create the repository as well as load into it?
>
> How many nodes are there in the revision it fails on? You could use
> svndumpfilter to separate out the large file and load it by itself.
> At the least this will reduce the test-case for debugging (and it does
> sound a bit like a bug to me).
>
> PS. I may be totally of my depth, but I would have thought the maximum
> useful page file + memory was 4GB, i.e. 2GB of your file will be
> unused however much memory your programs need.
>
> HTH, Edmund.
>
>
>
>
> ________________________________________________________________________
> This e-mail has been scanned for all viruses by Star Internet. The
> service is powered by MessageLabs. For more information on a proactive
> anti-virus service working around the clock, around the globe, visit:
> http://www.star.net.uk
> ________________________________________________________________________
>
> ________________________________________________________________________
> This e-mail has been scanned for all viruses by Star Internet. The
> service is powered by MessageLabs. For more information on a proactive
> anti-virus service working around the clock, around the globe, visit:
> http://www.star.net.uk
> ________________________________________________________________________

-- 
* Dave Oxley *
* +44 (0)7966 249 344
* * * * Dave@JungleMoss.com * * <mailto:Dave@JungleMoss.com>
* * * * http://www.daveoxley.co.uk * * <http://www.daveoxley.co.uk> *
* "Linux: Because reboots are for hardware upgrades!" * * *   * *
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org