[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

RE: More FSFS performance comments

From: Johnathan Gifford <jgifford_at_wernervas.com>
Date: 2006-09-07 15:30:08 CEST

Yes Troy,

Please let us know. We are currently running 1.3.0 with over 15,000
revisions and have found that in our single repository that all projects
checkout significantly much quicker than one particular project. We
think this is due to the size and breadth of that one project's
directory structure. While almost all of our projects take less than
three minutes to do a full checkout, this one project consistently takes
more than three. Even a switch from branch to branch results in long
switch times of around one minute (and then another two for Eclipse to
build the project workspace). What's different about this project, lots
of directories deep (up to 10 layers in some sections) with lots of
files at the senior levels of the directory structure.

How do your full working copying check out times compare to an export
time? It might be the underly .svn folder choking on the number of
files and directories.

Johnathan Gifford

>>> On Wed, Sep 6, 2006 at 10:45 PM, in message
<930F5D613A943B41A5392993AC82940305BD8C47@EXCHANGE.trader>, "Lakshman
Srilakshmanan" <lakshman.srilakshmanan@tradingpost.com.au> wrote:
> Hi Troy,
>
> Do you have one project that occupies ~2GB of space, or multiple
> projects contained in one repository consuming ~2GB of space. I
suspect
> the later, because we have multiple projects contained in multiple
> repositories occupying ~1.7GB and no performance impact. The largest
> project is ~120MB.
>
> Maybe you should consider re- organising your repository into
smaller
> ones. :)
>
> BTW : Were you suggesting that it takes ~6min to checkout the entire
> ~2GB ?
>
> Thanks
> Lakshman
>
>
>> ----- Original Message-----
>> From: Troy Curtis Jr [mailto:troycurtisjr@gmail.com]
>> Sent: Thursday, 7 September 2006 11:50 AM
>> To: users@subversion.tigris.org
>> Subject: More FSFS performance comments
>>
>> Hey everyone, it's me again complaining about FSFS performance
issues.
>>
>> I was really excited to hear about the improvements in the disk
usage
>> and performance of FSFS in the 1.4 release. So I got approval and
>> converted our 1.3.2 repo of ~2 GB / 60000+ revs over to 1.4. I was
>> really hoping (but not expecting) for one of the 50% repo size
>> reductions that are possible , but it only shaved off 300 MB or so.
>> Oh well that was not to big of a deal as disk space is cheap.
>>
>> I was really banking on the performance improvements (recap, FSFS:
~6
>> min checkout times, ~35 min hotcopy times and BDB: ~3 min checkout
>> times, ~7 min hotcopy times). Alas, my checkout times increased to
>> just over ~8 minutes! Granted this was only a single test case (all
I
>> had time for today) and there may have been some gzipping happening
on
>> the server.
>>
>> So in the end, I must use BDB. I just hope that I do not have to
many
>> admin issues!
>>
>> Oh, I do have a question. I did a dump on my 2GB repo with the
>> -- deltas option and the resulting dump file was (uncompressed)
just
>> under 400MB. Why is the size blowing up so much in the repo since
it
>> supposedly stores stuff as deltas also? I was thinking it might
have
>> something to do with having 10's of 1000s of small revs files
taking
>> up more disk space than is necessary, but the BDB repo is only
>> slightly smaller (<100 MB). What about the properties,
specifically
>> the svn:keywords property that cvs2svn sets? Could that account
for
>> the size? Maybe it is worth another 15 hour conversion to test
it...
>>
>> Thanks for everything and I really do like subversion a lot.
>>
>> Troy Curtis
>>
>> --
>> "Beware of spyware. If you can, use the Firefox browser." - USA
Today
>> Download now at http://getfirefox.com
>> Registered Linux User #354814 ( http://counter.li.org/)
>>
>>
---------------------------------------------------------------------
>> To unsubscribe, e- mail: users- unsubscribe@subversion.tigris.org
>> For additional commands, e- mail: users- help@subversion.tigris.org
>
>
>
---------------------------------------------------------------------
> To unsubscribe, e- mail: users- unsubscribe@subversion.tigris.org
> For additional commands, e- mail: users- help@subversion.tigris.org

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Thu Sep 7 15:34:05 2006

This is an archived mail posted to the Subversion Users mailing list.