Hi Robert! Thanks for responding. I had kind of given up on help, but
I did get this working by using a BDB backend instead of a FSFS
backend. Once I did this, it put our entire repository dating back
from 1992 into Subversion. Thanks for creating this script!
In googling, the problem seems to be Python uses this fopen command
which has a hard limit of 255 on Solaris which sucks for large repos
like ours. With FSFS backend, everything seems to be little small
files and when the commit got too much, it would core. Using BDB, it
only opens a few files and was faster importing as well. Even so, I
might try switching from the BDB to FSFS now and see if it will work.
If any maintainers are reading, on Solaris, I had to add a -lxml2 to
the libsvn_ra_dav-1.la before the python bindings would work.
As for the script, I am using this one, practically verbatim:
http://svn.haxx.se/dev/archive-2005-01/0106.shtml
The only change I made was to force it to create the server type as a
BDB.
On Apr 14, 2005, at 8:50 AM, Robert Zeh wrote:
> Joey Mukherjee wrote:
>
>> Ok, with the new 1.1.4, I am now able to run sccs2svn.py; however, I
>> did have to add a dependence on libxml2 in the libsvn_client-1.la
>> file. After doing that, the python programs which depend on client
>> now will work. At least I think they do, because I am now getting a
>> different error.
>>
>> The script will run and it looks like its working, but after it runs
>> for a while, I get the following error:
>>
>> Traceback (most recent call last):
>> File "./sccs2svn.py", line 475, in ?
>> core.run_app(run)
>> File "/opt/local/subversion-1.1.4/lib/svn-python/svn/core.py", line
>> 33, in run_app
>> return apply(func, (pool,) + args, kw)
>> File "./sccs2svn.py", line 409, in run
>> interface.add(i)
>> File "./sccs2svn.py", line 243, in add
>> svn.delta.svn_txdelta_send_string(delta.getFileContents(),
>> File "./sccs2svn.py", line 143, in getFileContents
>> return os.popen(command).read()
>> OSError: [Errno 24] Too many open files
>>
>> I did a "limit descriptors 1024" before running it, but it gets the
>> same error.
>>
>> The question is, how do I reduce the number of open files that
>> Subversion uses.
>>
>> This is on a Solaris 2.9 system with Subversion 1.1.4 with a FSFS
>> backend.
>>
>> Thanks for any help!
>> Joey
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
>> For additional commands, e-mail: users-help@subversion.tigris.org
>>
> Could you send me a copy of the script that you have? It looks like
> I've forgotten to
> close a file at some point.
>
> Robert
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
>
Joey
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Thu Apr 14 16:32:04 2005