[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Is my repository too large?

From: Dave Oxley <dave_at_daveoxley.co.uk>
Date: 2004-02-22 15:29:38 CET

Help, I think my repository may have grown too large.

First some history: I reported a problem a while ago where I use subversion to hold backups of a database. The backups are just sql scripts, so only diffs should be stored which should be quite small. The deltification occasionaly fails (memory usage goes nuts and the system runs out of memory). It appears to be random. We have been having to run svnadmin recover on the db every 1 or 2 days.

Now I got this error while trying to check in a file to the repos:

Sending db_backups/db.sql
Transmitting file data .svn: Berkeley DB error
svn: Commit failed (details follow):
svn:
Berkeley DB error while checkpointing after Berkeley DB transaction for filesystem /var/repos/db:
Invalid argument

Doing a hot-backup.py gives:
Beginning hot backup of '/var/repos'.
Youngest revision is 1370
Backing up repository to '/var/repos-bkup/repos-1370'...
svn: Can't copy '/var/repos/db/strings' to '/var/repos-bkup/repos-1370/db/strings.tmp': File too large
Unable to backup the repository.

And running svnadmin recover gives:
Please wait; recovering the repository may take some time...
svn: DB_RUNRECOVERY: Fatal error, run database recovery

ls -l of db (I replace the user with ???):
[root@cowboy db]# ls -l
total 3458680
-rw-r--r-- 1 ??? ??? 5795840 Feb 22 13:51 changes
-rw-r--r-- 1 ??? ??? 8192 Feb 21 08:31 copies
-rw-rw-r-- 1 ??? ??? 16384 Feb 22 14:23 __db.001
-rw-rw-r-- 1 ??? ??? 278528 Feb 22 14:23 __db.002
-rw-rw-r-- 1 ??? ??? 327680 Feb 22 14:23 __db.003
-rw-rw-r-- 1 ??? ??? 917504 Feb 22 14:23 __db.004
-rw-rw-r-- 1 ??? ??? 16384 Feb 22 14:23 __db.005
-rw-r--r-- 1 ??? ??? 1474 Dec 7 14:25 DB_CONFIG
-rw-rw-r-- 1 ??? ??? 1716 Feb 22 14:23 log.0000000001
-rw-r--r-- 1 ??? ??? 5263360 Feb 22 13:51 nodes
-rw-r--r-- 1 ??? ??? 34664448 Feb 22 13:51 representations
-rw-r--r-- 1 ??? ??? 36864 Feb 22 13:51 revisions
-rw-r--r-- 1 ??? ??? 3491323904 Feb 22 13:51 strings
-rw-r--r-- 1 ??? ??? 339968 Feb 22 13:51 transactions
-rw-r--r-- 1 ??? ??? 8192 Feb 21 08:31 uuids

We are currently using SVN 0.35.0, Apache 2.0.48 on Fedora Core 1.

Firstly I need help getting my repos back into working order.

Secondly has the deltification process had any fixes recently that might fix what we've been seeing?

Cheers.

-- 
* Dave Oxley *
* "Linux: Because reboots are for hardware upgrades!" * * *   * *
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Received on Sun Feb 22 15:29:16 2004

This is an archived mail posted to the Subversion Dev mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.