Jon Smirl wrote:
> On 6/12/06, Les Mikesell <lesmikesell@gmail.com> wrote:
>> On Mon, 2006-06-12 at 13:24 -0400, Jon Smirl wrote:
>>
>>> After importing Mozilla in to svn using cvs2svn, a big problem is
>>> that my svn repository has 450,000 files in it. Two directories have
>>> 220,000 files each in them. ext3 collapses under that size of
>>> directory since it does sequential looks ups for file names.
>>
>> Directory indexing is optional in ext3. See the dir_index
>> option in tune2fs.
>
> I am running git-svnimport over my svn repository. This creates a huge
> load on svn since it is reading every changeset on every branch. I
> suspended my import job and converted the directory over to one with
> dir_index enabled.
>
> After the change, I'm still pretty much totally CPU bound with 20% in
> user space and 80% in the kernel. The svn process is using all of the
> CPU extracting the changesets. Disk activity is light and no swapping
> is happening. The svn import process is 400MB and about 400MB of disk
> is in the cache.
>
> Tomorrow I'll reboot and install oprofile so that I can try and track
> down why so much time is being spent in the kernel.
Can you turn off "atime" for wherever the repository? Fasciniating system
software may have significant dependencies on it, so I wouldn't recommend it
for /, but for /var/www/svn I think it would be fine.
Also, anytime you have 200,000 files in a single project directory,
something sounds like it's not really configured for performance. Why do you
have so many files in single directories?
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Mon Jun 12 21:52:29 2006