[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Subversion and Very,Very Large Repositories

From: Russ Brown <rbrown_at_ebuyer.com>
Date: 2006-02-28 15:42:19 CET

On Tue, 2006-02-28 at 09:22 -0500, Mark Phippard wrote:
> "Roger Ashby" <roger.ashby@gmail.com> wrote on 02/28/2006 09:03:55 AM:
>
> > I have however run into an issue, it seems that the
> > repository is being saved in one big file, and I've reach the max file
> > limit for my machine.
>
> It sounds like you created a BDB repository. The default format as of
> Subversion 1.2 is "fsfs". With this format there is one file per revision
> of the repository (commit).
>
> > My second question is, does it make sense to have this much data (it
> > could grow to several TB over the next 5 years) under revision control
> > can subversion handle it or should I be using some other solutions.
>
> In general, Subversion can handle very large repositories. The one
> scalability issue I am aware of is if you create a flat repository, that
> does not scale well. In other words, avoid having one folder with
> thousands of files in it. If you structure your imagine so that there are
> a lot of folders the repository should scale fine as long as the
> underlying disks and filesystem can handle it.
>

I'm not sure how this would make a difference. FSFS doesn't store the
files in the repository in physical folders on the disk: only as a
series of revisions. From what I remember, filesystem lookup performance
becomes a potential issue for fsfs only when you have a very large
number of revisions: not when you have a a flat file structure in the
repository.

Or does the Subversion filesystem have a similar lookup performance
issue?

> Mark
>
>
> _____________________________________________________________________________
> Scanned for SoftLanding Systems, Inc. and SoftLanding Europe Plc by IBM Email Security Management Services powered by MessageLabs.
> _____________________________________________________________________________
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>

-- 
Russ
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Tue Feb 28 23:10:52 2006

This is an archived mail posted to the Subversion Users mailing list.