[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Huge number of rev files in in svn repository

From: Nico Kadel-Garcia <nkadel_at_comcast.net>
Date: 2006-06-12 21:51:11 CEST

Jon Smirl wrote:
> On 6/12/06, Les Mikesell <lesmikesell@gmail.com> wrote:
>> On Mon, 2006-06-12 at 13:24 -0400, Jon Smirl wrote:
>>> After importing Mozilla in to svn using cvs2svn, a big problem is
>>> that my svn repository has 450,000 files in it. Two directories have
>>> 220,000 files each in them. ext3 collapses under that size of
>>> directory since it does sequential looks ups for file names.
>> Directory indexing is optional in ext3. See the dir_index
>> option in tune2fs.
> I am running git-svnimport over my svn repository. This creates a huge
> load on svn since it is reading every changeset on every branch. I
> suspended my import job and converted the directory over to one with
> dir_index enabled.
> After the change, I'm still pretty much totally CPU bound with 20% in
> user space and 80% in the kernel. The svn process is using all of the
> CPU extracting the changesets. Disk activity is light and no swapping
> is happening. The svn import process is 400MB and about 400MB of disk
> is in the cache.
> Tomorrow I'll reboot and install oprofile so that I can try and track
> down why so much time is being spent in the kernel.

Can you turn off "atime" for wherever the repository? Fasciniating system
software may have significant dependencies on it, so I wouldn't recommend it
for /, but for /var/www/svn I think it would be fine.

Also, anytime you have 200,000 files in a single project directory,
something sounds like it's not really configured for performance. Why do you
have so many files in single directories?

To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Mon Jun 12 21:52:29 2006

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.