[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: svn cleanup performance

From: Duncan Murdoch <murdoch_at_stats.uwo.ca>
Date: 2006-03-25 15:57:16 CET

On 3/25/2006 8:59 AM, Alex Kiesel wrote:
> On Sat, 2006-03-25 at 08:49 -0500, Nico Kadel-Garcia wrote:
>> Alex Kiesel wrote:
>>> Hi all,
>>>
>>> (I've searched the archives but was unable to find an answer or
>>> discussion on this)
>>>
>>> we've got an svn repository with ~70000 files and directories.
>>> Updating it on a daily basis takes a long time (so I've put that into
>>> a cron). However, occasionally, errors occur and I have to svn
>>> cleanup.
>> 7000 files is one thing. How big is the repository in disk size? And are
>> most of the files in one directory? Linux ext2 or ext3 filesystems before
>> the 2.6 kernel would take quite some time to deal with many thousands of
>> files in one directory, for example.
>
> Disk size of the repo is %%% GB. There are no directories with really
> many files, the maximum is probably 100 files per dir.
> One reason the repo grew so big was that when converting from CVS, all
> tags became real directories, and as we had many tags, the number of
> files was multiplied.

Why would you be doing a cleanup on the root? You shouldn't normally
have the root checked out in the usual trunk/branches/tags structure,
you just check out one of (or maybe a few of) the trunk, a branch, or a
tag.

Duncan Murdoch

>
>>> I noticed that `svn cleanup` at the root of the repository takes
>>> _really_ long time (more than 30 minutes) and eats up up to 200 MB of
>>> RAM.
>>>
>>> Is there any way to tweak this, to make it faster and/or slimmer
>>> (apart from making sure only to work on smaller sub-trees of the
>>> repo)? I assume this is server-independent; my box is a FreeBSD box,
>>> but it also occurs on various Linux boxes.
>> Are you using bdb or fshs for the repository on the server? And which
>> particular version of subversion, with which particular FreeBSD release and
>> filesystem?
>
> We used to use bdb, but the server has lately been converted to fsfs. I
> am using subversion 1.3.x (client), FreeBSD 5.4, UFS2 with softupdates
> enabled.
>
> (However, the problem exists on Linux boxes, too).
>
> The server is a subversion 1.2.x, but as far as I understand, "cleanup"
> does not contact the server, does it?
>
> Regards,
> -Alex
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Sat Mar 25 15:58:11 2006

This is an archived mail posted to the Subversion Users mailing list.