[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Db4 shared mem, ENOMEM on large import

From: Daniel Berlin <dan_at_dberlin.org>
Date: 2002-03-08 16:54:40 CET

On Fri, 8 Mar 2002, Ben Collins wrote:

> Well, in response to the memory usage, the import of the tree I am doing
> now only takes 103megs instead of 300megs of memory. Still getting the
> failures in close_edit (more specifically in svn_fs_commit_txn when
> calling svn_fs_retry_txn, on down into svn_fs_rep_contents_size).
>
> After placing an abort just before the error return (and running under
> gdb) I get this:
>
> bottom:/usr/src/svn/repo/db# db4.0_stat -d strings
> db_stat: Lock table is out of available locks

> db_stat: open: strings: Cannot allocate memory
> db_stat: Database handles open during environment close
> db_stat: dbenv->close: Invalid argument
>
> bottom:/usr/src/svn/repo/db# db4.0_stat -d strings -N
> 53162 Btree magic number.
> 8 Btree version number.
> Flags: duplicates
> 2 Minimum keys per-page.
> 4096 Underlying database page size.
> 3 Number of levels in the tree.
> 12253 Number of unique keys in the tree.
> 24513 Number of data items in the tree.
> 7 Number of tree internal pages.
> 15772 Number of bytes free in tree internal pages (45% ff).
> 701 Number of tree leaf pages.
> 1375370 Number of bytes free in tree leaf pages (52% ff).
> 33 Number of tree duplicate pages.
> 100950 Number of bytes free in tree duplicate pages (25% ff).
> 38954 Number of tree overflow pages.
> 18M Number of bytes free in tree overflow pages (88% ff).
> 0 Number of pages on the free list.
>
> bottom:/usr/src/svn/repo/db# db4.0_stat -C f
> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
> Lock region parameters
> locker table size: 1031, object table size: 1031, obj_off: 351896, osynch_off: 0, locker_off: 343640, lsynch_off: 0, need_dd: 0
> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
> Lock free list
> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
> Object free list
> 0x40296f88
> 0x40296fd0
> (lots more free objects).
>
> So, somewhere we are running out of locks.

In fact, it doesn't add up right either.

Since you have 701 leaf pages, we could read lock every page in the
database, and still not run out of locks (in fact, not even close).

--Dan

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Received on Fri Mar 8 16:55:17 2002

This is an archived mail posted to the Subversion Dev mailing list.