[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: svn import hangs in fs type repository

From: Ryan Schmidt <subversion-2005_at_ryandesign.com>
Date: 2005-09-28 18:54:32 CEST

On Sep 27, 2005, at 22:27, Mark Phippard wrote:

> "v.kalra.w" <vkalra@agere.com> wrote on 09/27/2005 04:18:49 PM:
>
>> We've been using subversion for some small projects and have been
>> happy
>> enough with it that we want to move some of our big stuff under it.
>> Unfortunately, the very first such project has run into various
>> unexplained hangs at import time and some of the team members are
>> having
>> second thoughts about it. I've googled for the scenarios and
>> looked at
>> the mailing list archives, but I cannot seem to find anything similar
>> that others may have run across.
>>
>> First the basics: We're trying to put about 10GB worth of data in
>> about
>> 6000 files under svn. The files are a mix of binary and ascii files,
>> mostly ascii. The repository type does NOT use Berkley DB -- We've
>> tried
>> verisons 1.1.3 and 1.2.1, going over http or using the NFS file
>> system
>> via the file:// mechanism, but in all cases, the import hangs part of
>> the way through the process. The whole process takes hours to go
>> through, so it is very frustrating to find it hang yet another time.
>
> Depending on how your APR (on the server) was compiled it may not
> be able
> to handle files that are > 2GB. If you commit more than 2 GB at
> one time,
> you will have a revision file in the fsfs repository that APR cannot
> handle due to its size. I am not saying that is the problem, but
> that is
> somewhere to start.

I understood that APR 0.9 has this 2-GB limitation, and that APR 1.0
does not. And that if you want to move from APR 0.9 to 1.0, you
should dump your repositories first and reload after. Of course, for
you, since you don't have any repositories yet, you can forget that
step.

> So my recommendation would be to go back to the idea of breaking the
> import into chunks.

Since you're in a time crunch, maybe, I just hate workarounds. Seems
like it would be better in the long run to figure out why it's acting
this way and if there's a way to fix it. But if it's only the APR 0.9
2-GB revision-size limit, then this workaround (importing in smaller
chunks) should work and be safe.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Wed Sep 28 19:02:23 2005

This is an archived mail posted to the Subversion Users mailing list.