Re: large binary data repositories with many files

ListMan wrote:
>
> hi, we have lots of binary data that we are trying to data manage with
> subversion. as you can see from the example below svn can be kind of
> slow, a commit can take up to 68mins.. are there certain binary
> characteristics of files that lend themselves to efficient diff
> generation? is there a place i can research the algorithm used by
> svn? any ideas how we can speed this up with svn?
>
> raw
> performance repository workarea
> size files(dirs) copy add commit update
> size size files(dirs)
> 2.1G 5331(2061) 6m 4m 68mins
> 1.2G 4.2G 44011(22671)
>
> ---------------------------------------------------------------------
68 mins for a 2.1GB commit is awfully slow. Assuming a 30% size
reduction with the delta,
that would mean ~ 3 Mbits/s transfer rate from the client onto the
disk. What protocol
was used - how much was the network component in your timing analysis, I
am trying to gather.

-- 
Rahul Bhargava,
Subversion,CVS Solutions
WANdisco,Inc.
Pleasanton, CA
http://www.wandisco.com
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
>
>
This email and any attachments may contain private, confidential and privileged material for the sole use ofthe intended recipient. If you are not the intended recipient, please immediately delete this email and any attachments.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org