[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: berkeley DB error

From: Branko Čibej <brane_at_xbc.nu>
Date: 2004-01-30 00:21:42 CET

dannys@changind.com wrote:

>Okay, so I made a test script to create an ever increasing file to
>test file sizes and number of commits. (I'll include the scripts
>below).
>
>So right now the problem is that I've gotten to about 129 revisions in
>the repository. The checked out filesize is only 132 MB. However,
>when I do a dump/load, I'm getting this error when loading around
>revision 113:
>
> svn: Berkeley DB error while reading representation for filesystem
> test-repo/db:Cannot allocate memory
>
>I get the same error if I do a deltify.
>
>I've tried this on both subversion-0.36.0-8282.rh90 and
>subversion-0.37.0-1.rh90.
>
>
>This machine has 1 GB of memory and 3 GB of swap, and isn't really
>doing much of anything right now other than running subversion.
>
>Any ideas?
>
>

Having repeated your tests on Windows, I see that svnadmin seems to
_sometimes_ use the the same amount of memory as the size of the file
(that's either the commit size, or the size of the largest file in the
commit -- I can't tell the difference). This may well be related to
deltification, and my best guess would be that it either happens when
the delta is larger than the fulltext (that's when we discard the delta
and keep the stored fulltext instead), or when we're computing skip
deltas. I think this is an issue for 1.0.1.

Funny thing, though -- I ran the test with 100 revisions, and my strings
file is about 200M -- pretty good compression, considering that the
successive versions are generated from a random bytestream. But my
bzip2'd dump file is more than 4.5 Gigs! (the unpacked size would be a
bit more than 5 Gig, of course). Either Cygwin has a horrible
implementaiton of /dev/urandom, or we're doing something fairly
phenomenal in the deltification phase.

-- 
Brane Čibej   <brane_at_xbc.nu>   http://www.xbc.nu/brane/
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Fri Jan 30 00:22:06 2004

This is an archived mail posted to the Subversion Users mailing list.