[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: svnsync experience

From: Jonathan Ashley <jonathan.ashley_at_praxis-his.com>
Date: 2007-05-14 15:44:23 CEST

I can confirm this memory leak - after copying around 10000 revisions,
my svnsync process is now using over 500M of memory.

Is there a report of this in the Subversion issue tracker? I can't find
one, but I'm not very familiar with the interface.


Jon Ashley
> -----Original Message-----
> From: grimm26@gmail.com [mailto:grimm26@gmail.com] On Behalf Of Mark
> Sent: 31 January 2007 17:21
> To: users@subversion.tigris.org
> Subject: Re: svnsync experience
> For the initial setup, you don't really _have_to use svnsync 
> to get the repository copied.  You should be able to use 
> whatever means (rsync, ftp) to get a copy of the repository 
> to the mirror location and then mimic what svnsync init does 
> by setting some revision properties on rev 0.
> You need:
> svn:sync-from-uuid : <uuid of source repo> 
> svn:sync-last-merged-rev : <set to current youngest rev> 
> svn:date : <set to a zulu time like 
> 2006-12-29T22:40:20.478163Z> svn:sync-from-url : <svn url of 
> the source repository>
> Then, set up the svnsync hooks you need and let her rip.
> On 1/31/07, Wichert Akkerman <wichert@wiggy.net> wrote:
> > I'm in the process up setting up backups/read-only mirrors for 
> > svn.plone.org using svnsync and so far my experience is somewhat 
> > sub-optimal. I'm wondering if that is specific for my 
> setup, or if I 
> > am hitting some svnsync problems.
> >
> > I need to replicate three repositories, totalling somewhat over 55k 
> > changesets and about 1gb of data combined. There are two 
> problems I am 
> > seeing:
> >
> > - svnsync appears have a memory leak. Looking at the process listing
> >   on every synced changeset it looses between a hunderd kB to over
> >   a megabyte of data. With 55k changesets needing to be 
> processed that
> >   is somewhat problematic.
> >
> > - svnsync is slow: it processes one changeset every 3-5 seconds. The
> >   latency between the machines is 160ms and neither of them are
> >   overloaded.
> >
> > Combined this means it takes me about a week to setup one 
> mirror (and 
> > I need to setup two) for the repositories and requires me 
> to manually 
> > restart the svnsync process regularly to prevent the machine from 
> > running out of memory. I'm really happy to have a tool like 
> svnsync, 
> > but currently it is slightly painful to use.
> >
> > Are there things I can tweak or look into that can help?
> >
> > Wichert.
> >
> > --
> > Wichert Akkerman <wichert@wiggy.net>    It is simple to make things.
> > http://www.wiggy.net/                   It is hard to make 
> things simple.
> >
> > 
> ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> > For additional commands, e-mail: users-help@subversion.tigris.org
> >
> >
> --
> Mark
> "Blessed is he who finds happiness in his own foolishness, 
> for he will always be happy."
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
This email is confidential and intended solely for the use of the individual to whom it is addressed. If you are not the intended recipient, be advised that you have received this email in error and that any use, disclosure, copying or distribution or any action taken or omitted to be taken in reliance on it is strictly prohibited. If you have received this email in error please contact the sender. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of Praxis. 
Although this email and any attachments are believed to be free of any virus or other defect, no responsibility is accepted by Praxis or any of its associated companies for any loss or damage arising in any way from the receipt or use thereof. The IT Department at Praxis can be contacted at it.support@praxis-his.com.
Praxis High Integrity Systems Ltd:
Company Number: 3302507, registered in England and Wales
Registered Address: 20 Manvers Street, Bath. BA1 1PX
VAT Registered in Great Britain: 682635707
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Mon May 14 15:44:49 2007

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.