[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Bloated rev file.

From: John Szakmeister <john_at_szakmeister.net>
Date: 2005-12-09 13:10:02 CET

On Friday 09 December 2005 05:58, Oscar Fuentes wrote:
> John Szakmeister <john@szakmeister.net> writes:
> > Can you provide a reproduction recipe? I can make to a change to a small
> > file, and I only see a small rev file. Is the file located in the same
> > directory as a lot of other files? If so, how many files are in that
> > directory.
>
> The file is on a directory with ~740 files.
>
> > I have noticed that FSFS tends to write a full plaintext
> > representation for directory contents more often that it probably should,
> > so that may be what your specific problem is.
>
> Is 800 files considered a large directory on the scenario you
> describe? Too bad if the answer is yes, as the repo size is
> skyrocketing due to commits consising on a few line deltas. It will
> become worse as that directory is expected to contain thousands of
> files on a year or two.

That's probably fairly sizeable. It might be possible to store the directory
contents as a delta as a previous revision. Actually, the algorithm might do
that already, but you haven't seen it yet due to the way the skip-deltas are
computed.

> > As for the diff itself, we do use
> > a binary delta compression on the backend, and the diff will be relative
> > to the size of the change. You must have a great deal of files along the
> > path to the file in question, or in the same directory as the file in
> > question.
>
> There are some large projects out there using svn that have
> directories with thousands of files. I wonder how nobody noticed this.

Perhaps. If you have things structured and broken up into a directory
hierarchy, then the effects are far less noticeable.

-John

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Fri Dec 9 13:14:31 2005

This is an archived mail posted to the Subversion Users mailing list.