Re: Huge number of rev files in in svn repository

On 6/12/06, Les Mikesell <lesmikesell@gmail.com> wrote:
> On Mon, 2006-06-12 at 13:24 -0400, Jon Smirl wrote:
>
> > After importing Mozilla in to svn using cvs2svn, a big problem is that
> > my svn repository has 450,000 files in it. Two directories have
> > 220,000 files each in them. ext3 collapses under that size of
> > directory since it does sequential looks ups for file names.
>
> Directory indexing is optional in ext3. See the dir_index
> option in tune2fs.

I am running git-svnimport over my svn repository. This creates a huge
load on svn since it is reading every changeset on every branch. I
suspended my import job and converted the directory over to one with
dir_index enabled.

After the change, I'm still pretty much totally CPU bound with 20% in
user space and 80% in the kernel. The svn process is using all of the
CPU extracting the changesets. Disk activity is light and no swapping
is happening. The svn import process is 400MB and about 400MB of disk
is in the cache.

Tomorrow I'll reboot and install oprofile so that I can try and track
down why so much time is being spent in the kernel.

-- 
Jon Smirl
jonsmirl@gmail.com
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org