Re: [w] cvs2svn takes very long time to execute (days!)

Hi Martin, Chris, *!

On Fri, Feb 13, 2004 at 02:39:52PM -0500, Martin Gadbois wrote:
> I am trying to convert our CVS to Subversion, but cvs2svn takes a very long
> time to execute, and
> things seems to slow down with time. Pass 4 takes the longest.
>
> At one point I 'imported' 1 year of commits before stopping.
>
> I simply did not have the patience to complete it, mostly due to the
> slowdown.
>
> Our CVS tree is big:
> - - earliest commit is ~2000
> - - cvsroot is 1.4G, ~17700 files
> - - One tag is used per build, we are now at build 2700.
> - - A dozen or so of branches.
> - - I had to modify cvs2svn slightly to accept branches with two different
> names

I had the same probs with cvs2svn. Passes 1 to 3 went pretty fast. But when
the programms output said "commiting revision xxxx" things started to slow
down. That is, the first "commits" went real fast, but when xxxx evolved to
around 18000 to 20000, each commit needed around 20 to 30 seconds (with our
repository I reached Jan 2002 at that point, so I stopped the conversion).

Our repository holds about 2.1G but I don't think that size is the problem,
as there was a report on this list that a repository of about 10G had been
converted in 10h. I suspect, it's about the number of commits.
(BTW: Is the author of cvs2svn reading this list?)

> Is it common to take that much time? (Should I just go on a week vacation
> while it converts?)

Good idea, didn't think of that yet; I should do that! :^))

> Any hints on what takes that much time? (I profiled the script and most of
> the time was to execute
> 'co' and in enroot_names())

Is this a possible explanation for the slow down (i.e. that early commits
are fast and later are slow)?

On Fri, Feb 13, 2004 at 11:50:49AM -0800, Chris Wein wrote:
> Try creating a dumpfile only and see if that helps. I am (literally!)
> converting a 700MB repository with 15000+ revisions and its taken about
> 2 hours (so far, 90% done) on RH7.3 P4@3GHZ. Once the dumpfile is done
> then import into svn.

1) I'm still not sure if the slowing down pass I can observe is pass 4
   or pass 5 (I think pass 4 is dumpfile creation!?).

2) If pass 4 is fast and 5 the slow-down: Would importing of a dumpfile
   manually be faster?

regards, Kai

-- 
"Commerce, n. A kind of transaction in which A plunders from B the goods of
 C, and for compensation B picks the pocket of D of money beloging to E."
 ( what is e-commerce, then? )                               <Ambrose Bierce>
KBartels@picturesafe.de                  +                 www.picturesafe.de
picturesafe GmbH, Lueerstr. 3, D-30175 Hannover          fon:+49 511 85620 56
++ PGP Key fingerprint  1324 98A8 3BF8 4166 05E1  82D3 E168 6849 6022 5D32 ++
-----BEGIN GEEK CODE BLOCK-----
VERSION: 3.12
GCS d- s: a C++$ UL/S++$ P++ L++ E W-- N w--- !O !M PS+ PE Y+ PGP+ t R@ tv+>-
b+>++ DI++ G e+++ h* y?
------END GEEK CODE BLOCK------
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org