Re: ["Kirby C. Bohling" <kbohling@birddog.com>] Re: Disk/Memory Consumption of SVN

On Fri, Feb 01, 2002 at 01:49:03PM -0600, Kirby C. Bohling wrote:
>....
> > I tried using db_archive there, and it told me this:
> >
> > db_archive: region error detected; run recovery.
> > db_archive: Ignoring log file: log.0000000082: unsupported log version 5
> > db_archive: PANIC: Invalid argument
> > db_archive: open: DB_RUNRECOVERY: Fatal error, run database recovery

Oops. wrong version (as you noted)

> > So then I did:
> >
> > db_recover
> >
> > Now all my __db files are gone... oops!

Use "db_recover -e" to create the "environment" files (the __db things).

Normally, we do the following:

$ /usr/local/BerkeleyDB.4.0/bin/db_recover -veh /path/to/repos/db

I don't know why it removes the environment files by default.

>...
> > going on. Just FYI, this took 4.2 hours of running check in. It is my
> > opinion that this is a VM problem because I am using all of the ram on
> > the box. I have all the patch files so I can estimate the rough size of
> > changes if you are interested in the performance of this. I will send

It sounds like you've got a nice data set for this. We will certainly be
performing a lot more analysis of both time and memory. I've already noticed
that the client does a lot of redundant I/O for its work. And we haven't
even started on the server yet.

> > more information when I get the stuff rebuilt. There are roughly 800MB
> > of log files so it appears to be a log file issue, not a repository
> > issue.

I would recommend that between each of your imports, to do the following:

$DB_BIN/db_archive -h $REPOS/db | tee /dev/tty | xargs rm

That will give you a list of the files, send them to the screen, and then
remove them. Adjust as necessary :-)

> > By the write times it appears to have just cycled thru the 10M
> > files and create a new one, and the blowing away the old ones would be safe.

db_archive will only list the log files that are no longer in use, so there
is no worry -- if listed, it is "safe"

Cheers,
-g

-- 
Greg Stein, http://www.lyra.org/
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org