RE: svn not sutable for large multimedia assets?

I started a thread on a similar subject last week called "Switching off file
compression for JPEGs in the repository". You may want to go back and look
at it. The only difference is that the other thread focused on the
performance problems associated with large binary files which you have not
even included in your list. A 1GB zip file (worst case type binary file)
takes 1h25m to commit after a change on a P4 2.4GHz PC.

We concluded that AlienBrain is a better choice for large multimedia files.

Jim Cassimatis
Software Manager
Platform Development - Software
Aristocrat Technologies Australia
PH (02) 9697 4286
Fax (02) 9663 1412
Mb 0418 230 810

-----Original Message-----
From: Dierk Ohlerich [mailto:d.ohlerich@49games.de]
Sent: Thursday, 25 November 2004 7:20 AM
To: users@subversion.tigris.org
Subject: svn not sutable for large multimedia assets?

This is a "prove me wrong and make me happy" mail :-)

I love svn for my code, but i fear that we can't use it for multimedia
content in the foreseeable future. I am specifically talking about game
development here, our current solution is "alienbrain".

We are doing multiple projects simultaneously, each having about 20 GB
of working copy in 25000 files and 150 GB history. I see the following
problems:

(1) Most files are binary. We need file locking. I see this is one of
your top priorities in the roadmap. (fine)

(2) We need a way of removing old versions from the database. Our
projects grow with the performance of graphics cards. We will produce
more than 500 GB worth of history-data next year. Deleting old versions
is acceptable, while "taping" or "burning" them away is of course much
better.

(3) It seems that there are many reports that very large repositories
get slower and slower. If this is a function of the number of revisions
stored in the repository, we should be save. But if it is a function of
the size of the database, we have a problem here.

(4) Subversion stores a hidden, local copy of each file. This is good
for source-codes, but my working copy of all projects is 50 GB at the
moment, doubling that would hurt. I also fear that it slows down
updating the working copy, because of all the disk access. Updating all
clients after a large batch export is painfully slow.

(5) Some files need no revision control since they are automatically
generated, or come from an application that does it's own revision
controlling. The revision control system is misused as an instrument of
deployment. I don't want to feel guilty of doing a batch export, being
punished by having to burn 5 CD's for the history backup.

On the other hand, the differenced data storage and free branching would
  be really nice to have. I think the first three points are critical,
the other two are acceptable. Once you have file-locking implemented, I
will surely try out svn in smaller projects. Is there any estimate on
the release date of version 1.2 ?

-- 
<<< Dierk "Chaos" Ohlerich, 49Games >>>
----------------------------------------------------------------------
IMPORTANT NOTICES
This email (including any documents referred to in, or attached, to this
email) may contain information that is personal, confidential or the subject
of copyright or other proprietary rights in favour of Aristocrat, its
affiliates or third parties. This email is intended only for the named
addressee. Any privacy, confidence, copyright or other proprietary rights in
favour of Aristocrat, its affiliates or third parties, is not lost because
this email was sent to you by mistake.
If you received this email by mistake you should: (i) not copy, disclose,
distribute or otherwise use it, or its contents, without the consent of
Aristocrat or the owner of the relevant rights; (ii) let us know of the
mistake by reply email or by telephone (+61 2 9413 6300); and (iii) delete
it from your system and destroy all copies.
Any personal information contained in this email must be handled in
accordance with applicable privacy laws.
Electronic and internet communications can be interfered with or affected by
viruses and other defects. As a result, such communications may not be
successfully received or, if received, may cause interference with the
integrity of receiving, processing or related systems (including hardware,
software and data or information on, or using, that hardware or software).
Aristocrat gives no assurances in relation to these matters.
If you have any doubts about the veracity or integrity of any electronic
communication we appear to have sent you, please call +61 2 9413 6300 for
clarification.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org