[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Subdirectories for db/revs/* on fsfs backend

From: Garrett Rooney <rooneg_at_electricjellyfish.net>
Date: 2004-07-21 04:41:32 CEST

Michael wrote:

> --- Benjamin Pflugmann <benjamin-svn-dev@pflugmann.de> wrote:
>
>>PS: For curiosity, I did some measurements (on old Athlon 800 with
>>some 20GB IDE disc, ext3, 100MBit). In a directory with 37000 empty
>>files:
>>
>>[snip timing info]
>>
>>So the bottleneck I see with this limited test is NFS when you stat a
>>lot of files (no surprise) and apparently it has non-linear scaling.
>
>
> I have to agree. The only time speed has been an issue with large
> directories and ls for me was when I was accessing an NFS mount.
>
> I did the same test with 100,000 files on a FreeBSD box and got the
> following results:
>
> $ ~/tmp> time ls > /dev/null
>
> real 0m1.578s
> user 0m0.180s
> sys 0m1.368s
> $ ~/tmp> time ls -l > /dev/null
>
> real 0m1.975s
> user 0m0.597s
> sys 0m1.359s
>

Let's keep in mind that Subversion itself never actually needs to read
the entire contents of the directory, like ls is doing. libsvn_fs_fs is
specifically written not to have to do that. So yeah, it kind of sucks
that the directory is so big, but for normal use this is not a serious
issue. Yes, there are cases where it is a problem, and we will fix it,
but let's try and keep this in perspective here.

-garrett

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Received on Wed Jul 21 04:42:01 2004

This is an archived mail posted to the Subversion Dev mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.