Re: Streamy FS writes found detrimental.

On Tue, Feb 26, 2002 at 08:55:59PM -0500, Daniel Berlin wrote:
> On Tue, 26 Feb 2002, Greg Stein wrote:
>...
> > The real bulk is caused by 'strings', so the record keeping ought to be
> > quite easy. Although, recall that we create/destroy DB environments all the
> > time. That 10 meg could come across 100 different requests and DB open/close
> > operations. Where's the counter go then? :-)
>
> Well, we can cleanup at open and close time too, eliminating the problem
> entirely.
> Besides, that's why i said "somewhere". I meant keep it
> persistent by putting it "somewhere".
> It doesn't really matter where.

*nod*

Probably start with a little function that simply tosses obsolete logs. Then
we can screw around with how to get it called.

> The problem with doing it every commit is that it actually does a
> little real work (looking for checkpoints in the logfiles, etc).
> Then again, maybe i'm just used to imports where commits are very
> frequent.

Well, if we keep it as a post-commit script, then we can *only* do it at
commit time. However, by the time that script runs, you may have accumulated
several gig of logs due to that huge repository import :-)

Something internal would be needed for that situation, but then we get into
the FS configuration thing. eek!

I mean consider what that config means:

* put it into httpd.conf and have a mod_dav_svn directive to configure it.
  but that leaves out ra_local.

* put it into REPOS/conf/fs.conf. now we gotta read and parse that thing as
  part of the FS operation.

Others? ...

> Do we have any stats on how often a commit occurs in the subversion db?

1381 commits in almost exactly six months. So a little over 200 a month, or
about 7 per day on average.

> > BDB itself, or the fact that we're using it?
>
> BDB itself.
> Using it was a good choice, given the options available, which are
> "something or nothing", basically.
> :)

Yup! :-)

Cheers,
-g

-- 
Greg Stein, http://www.lyra.org/
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org