Re: Parallelising SVN Checkout
On Tue, Sep 4, 2012 at 10:26 AM, Jonathan Holloway <
> Has anybody had any success in parallelising Subversion checkouts in the
> past on a subfolder level
> to improve performance at all?
> By this I mean using svn sparse directories with --depth intermediates to
> produce a skeleton structure,
> such as:
> * subfoldera - handled by a checkout thread
> * subfolderb - handled by a checkout thread
> then forking a process/starting a thread to svn update the subfolders?
> Does this make sense from a
> performance point of view or is the bottleneck of disk I/O always
> hit pretty early on by doing this?
> I've done this with a Python script and the multiprocessing module (and
> daemon processes) so far. I
> just wanted to check to see if there was an existing solution to this.
You will not be able to do this with SVN 1.7+ as there is a single working
copy admin area that will be locked by the first process that obtains the
lock. If you are using HTTP(S), you can switch to using the ra_serf
library which opens multiple connections to the server and fetches multiple
files at once. In 1.8, this will be the new HTTP client library.
Received on 2012-09-04 16:31:21 CEST
This is an archived mail posted to the Subversion Users