Mike,
Below are the results of my observations, which should answer all
of your questions. However, so that we have a frame of reference
I also timed how long it took to transfer the same 1GB file between
client and server directly via the network by using windows drag and drop.
The results were significantly less, which suggests to me that adding
Subversion tuning options for large files should results in significant
performance gains. Also, the time was significantly longer for the
commit (1h25mins), so the binary differencing algorithm must be the main
performance bottleneck, probably stage 4 of the commit. See below for more
information.
Computer Specifications of both Client & Server:
Pentium 4, 2.4GHz
RAM: 512MB
OS: WinXP SP1
File specifications:
Size 1,322,282KB
Type zip file
Contents 659 Paint Shop Pro tga files
Network:
Microsoft local area network
Direct file transfer:
Client-CPU 10%
Server-CPU 11%
Network 80%
Total time 2.5 mins
Initial Import into Repository:
First 5 mins (stage 1):
Client-CPU 85%
Server-CPU 2%
Network 0%
Next 19 mins (stage 2):
Client-CPU 7%
Server-CPU 11%
Network 16%
Total time 24 Mins
Initial Checkout:
First 8 mins (stage 1):
Client-CPU 60%
Server-CPU 80%
Network 35%
Next 5 mins (stage 2):
Client-CPU 11%
Server-CPU 5%
Network 0%
Total time 13 Mins
Commit after making a change:
First 5 mins (stage 1):
Client-CPU 11%
Server-CPU 0%
Network 0%
Next 17 mins (stage 2):
Client-CPU 100%
Server-CPU 0%
Network 0%
Next 18 mins (stage 3):
Client-CPU 8%
Server-CPU 15%
Network 11%
Next 45 mins (stage 4):
Client-CPU 4%
Server-CPU 45%
Network 0%
Total time 1 hour 25 mins
Jim C
-----Original Message-----
From: Cassimatis, Jim [mailto:Cassimatis@ali.com.au]
Sent: Thursday, 18 November 2004 10:19 AM
To: 'Mike Mason'
Cc: 'users@subversion.tigris.org'
Subject: RE: Switching off file compression for JPEGs in the repository
Mike,
Thanks for all your help. I will do some timing and observations
today and then get back to you with answers to your questions.
I know about AlienBrain and our Art people are already looking at it.
However, it would be nice if we were all (S/W Devs & Artists) using
the same tool, since Subversion has been designed to work will all
types of files.
Jim C
-----Original Message-----
From: Mike Mason [mailto:mgm@thoughtworks.net]
Sent: Thursday, 18 November 2004 3:36 AM
To: Cassimatis, Jim
Cc: 'users@subversion.tigris.org'
Subject: Re: Switching off file compression for JPEGs in the repository
Cassimatis, Jim wrote:
>You hit the nail on the head. We need tuning options for large
>files. Also, I agree that the pristine copy could in fact be part
>of the problem. Where do we go from here?
>
>
We've still not diagnosed the exact problem -- are you adding new files
or checking in changes to existing files when you get the problem? Is it
CPU time on the client, disk access on the client, network traffic, or
CPU or disk on the server? I'm not a Subversion developer and so can't
speak to whether large file support (i.e. tuning options for Subversion
to do quicker things with large files) is even on anyone's radar, I'm
just trying to help gather some more information about the problem.
Have you looked at AlienBrain? It's version control for creative types
and so might be better suited to what you want to do.
Cheers,
Mike.
----------------------------------------------------------------------
IMPORTANT NOTICES
This email (including any documents referred to in, or attached, to this
email) may contain information that is personal, confidential or the subject
of copyright or other proprietary rights in favour of Aristocrat, its
affiliates or third parties. This email is intended only for the named
addressee. Any privacy, confidence, copyright or other proprietary rights in
favour of Aristocrat, its affiliates or third parties, is not lost because
this email was sent to you by mistake.
If you received this email by mistake you should: (i) not copy, disclose,
distribute or otherwise use it, or its contents, without the consent of
Aristocrat or the owner of the relevant rights; (ii) let us know of the
mistake by reply email or by telephone (+61 2 9413 6300); and (iii) delete
it from your system and destroy all copies.
Any personal information contained in this email must be handled in
accordance with applicable privacy laws.
Electronic and internet communications can be interfered with or affected by
viruses and other defects. As a result, such communications may not be
successfully received or, if received, may cause interference with the
integrity of receiving, processing or related systems (including hardware,
software and data or information on, or using, that hardware or software).
Aristocrat gives no assurances in relation to these matters.
If you have any doubts about the veracity or integrity of any electronic
communication we appear to have sent you, please call +61 2 9413 6300 for
clarification.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Thu Nov 18 06:06:09 2004