[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

[Subclipse-users] Re: Subversion and Very,Very Large Repositories

From: Mark Phippard <markp_at_softlanding.com>
Date: 2006-02-28 16:03:41 CET

"Roger Ashby" <roger.ashby@gmail.com> wrote on 02/28/2006 09:58:55 AM:

> On 2/28/06, Mark Phippard <markp@softlanding.com> wrote:
>
> > In general, Subversion can handle very large repositories. The one
> > scalability issue I am aware of is if you create a flat repository,
that
> > does not scale well. In other words, avoid having one folder with
> > thousands of files in it. If you structure your imagine so that there
are
> > a lot of folders the repository should scale fine as long as the
> > underlying disks and filesystem can handle it.
>
> The directory structure is pretty set in stone, because we have quite
> a few internal processes that depend on it when looking for files.
> There are actually several directories with thousands of images.

I think the main issue is that when you commit something to one of those
folders, the resulting revision file has to contain meta-information about
all of the files in that folder so the revision files are just larger than
would be ideal. In your case, that information probably pales in
comparison to what you are committing, but when it is a text file it turns
what would be a 1K revision file into a 100K revision file.

The other issue is that Subversion does not let you checkout files, just
folders. So when you checkout these folders you have to always checkout
all of those thousands of images.

Mark

_____________________________________________________________________________
Scanned for SoftLanding Systems, Inc. and SoftLanding Europe Plc by IBM Email Security Management Services powered by MessageLabs.
_____________________________________________________________________________

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subclipse.tigris.org
For additional commands, e-mail: users-help@subclipse.tigris.org
Received on Tue Feb 28 17:15:07 2006

This is an archived mail posted to the Subclipse Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.