[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Subversion and Very,Very Large Repositories

From: Ryan Schmidt <subversion-2006Q1_at_ryandesign.com>
Date: 2006-02-28 15:22:04 CET

On Feb 28, 2006, at 15:03, Roger Ashby wrote:

> I administer a repository of images (about 300,000
> tifs,pdfs,pngs,jpgs, and some zips with no single file larger than
> 700MB, however only 1/3 of those are more then a MB in size and of
> those that are they mostly range between 1-40MB) that currently totals
> about 700GB data. I've been tasked with coming up with a revision
> control/digital asset management solution on a very limited budget. I
> ultimately settled upon using svk (because of the lightweight checkout
> copy management) with a subversion repository in the background. I
> decided to incrementally capacity test the subversion repository a few
> Gigs at a time. I have however run into an issue, it seems that the
> repository is being saved in one big file, and I've reach the max file
> limit for my machine.

The FSFS backend stores one file per revision. I don't know how the
BDB backend stores things. Most people recommend using FSFS, not BDB.
You should use the current version of Subversion, 1.3.0. To properly
support large files, you should use APR 1.2 (and, if you want Apache,
then Apache 2.2.x), not APR 0.9 (which came with Apache 2.0.x).

As to whether it makes sense to store this much information in
Subversion, others may have an opinion on that.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Tue Feb 28 15:43:42 2006

This is an archived mail posted to the Subversion Users mailing list.